-- Logs begin at Mon 2022-07-25 18:23:50 UTC, end at Mon 2022-07-25 20:21:41 UTC. -- Jul 25 19:13:57.771676 dv-cinder-850939-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 19:13:57.784919 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 19:13:57 2022] *** Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: nodename: dv-cinder-850939-1-iscsi Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: machine: x86_64 Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: clock source: unix Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: pcre jit disabled Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: detected number of CPU cores: 4 Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: current working directory: / Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: detected binary path: /usr/bin/uwsgi-core Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: your processes number limit is 47680 Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: your memory page size is 4096 bytes Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: detected max file descriptor number: 2048 Jul 25 19:13:57.787189 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: lock engine: pthread robust mutexes Jul 25 19:13:57.788452 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: thunder lock: enabled Jul 25 19:13:57.788452 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 19:13:57.788452 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 19:13:57.829461 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: Python main interpreter initialized at 0x5646fb8e99c0 Jul 25 19:13:57.829461 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: python threads support enabled Jul 25 19:13:57.829461 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: your server socket listen backlog is limited to 100 connections Jul 25 19:13:57.829461 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: your mercy for graceful operations on workers is 90 seconds Jul 25 19:13:57.830032 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 19:13:57.830032 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: *** Operational MODE: preforking *** Jul 25 19:13:57.830295 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: *** uWSGI is running in multiple interpreter mode *** Jul 25 19:13:57.830295 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: spawned uWSGI master process (pid: 103335) Jul 25 19:13:57.830476 dv-cinder-850939-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 19:13:57.831060 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: spawned uWSGI worker 1 (pid: 103336, cores: 1) Jul 25 19:13:57.831395 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: spawned uWSGI worker 2 (pid: 103337, cores: 1) Jul 25 19:13:57.831582 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 19:13:58.562157 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 19:13:58.742032 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 19:13:59.764132 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:13:59.764132 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: from cryptography.utils import int_from_bytes Jul 25 19:13:59.765123 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:13:59.765123 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: from cryptography.utils import int_from_bytes Jul 25 19:13:59.943189 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:13:59.943189 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: from cryptography.utils import int_from_bytes Jul 25 19:13:59.944166 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:13:59.944166 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: from cryptography.utils import int_from_bytes Jul 25 19:14:02.491898 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:14:02.492474 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:14:02.492829 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:14:02.493261 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:14:02.493567 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:14:02.493996 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.494362 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.494726 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.495087 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.495453 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.495835 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.496200 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.496560 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.496934 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.497236 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.497671 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.498054 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-1-iscsi {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.498520 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.499219 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.499714 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.500239 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.500723 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.502008 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.502453 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.503084 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.505015 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.505015 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.505015 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.505015 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.505015 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.505665 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.505665 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.505914 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.506141 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.506553 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.506868 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-1-iscsi {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.507147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.507589 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.508121 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.508759 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.509232 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.509735 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.510194 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.510644 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.511139 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.511604 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.512011 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.512406 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.512848 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.513503 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.513950 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.514341 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.514801 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.515194 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.515670 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.516050 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.516457 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.516996 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.517401 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.517766 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.518122 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.518465 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.518849 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.519480 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.520074 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.520291 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.520695 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.521183 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.521589 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.521961 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.522335 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.522764 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.523211 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.523643 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.524035 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.524415 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.525031 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.525558 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.525916 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.526298 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.526714 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.527101 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.527741 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.528131 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.528594 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.528968 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.529337 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.529706 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.530088 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.530480 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.530846 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.531155 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.531629 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.532005 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.532796 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.532796 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.533338 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.533670 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.534035 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.534407 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.534779 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.535149 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.535539 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.536175 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.536602 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.536915 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.537228 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.537538 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.537865 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.538187 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.538503 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.538801 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.539110 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.539416 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.539768 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.540074 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.540377 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.540699 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.541002 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.541304 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.541619 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.541923 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.542222 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.542681 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.543025 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.543327 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.543672 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.543977 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.544280 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.544753 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.545069 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.545361 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.545871 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.546184 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.546496 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.546828 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.547150 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.547470 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.547807 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.548641 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.548950 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.549268 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.549606 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.549932 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.550274 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.550587 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.550920 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.551249 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.551588 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.552071 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.552247 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.552528 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.552834 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.553143 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.553450 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.553785 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.554410 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.554817 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.555163 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.555480 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.555833 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.556259 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.556620 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.556949 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.557270 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.557576 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.557920 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.558266 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.558575 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.558896 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.559221 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.559595 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.559873 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.560390 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.560857 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.561192 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.561531 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.561965 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.562400 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.562746 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.563192 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.564370 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.564721 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.565126 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.565452 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.565774 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.566296 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.566648 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.566956 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.567271 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.567609 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.567918 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.568226 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.568530 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.568840 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.569143 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.569464 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.569796 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.570102 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.570437 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.570786 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.571103 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.571411 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.571745 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.572050 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.572362 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.572666 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.572971 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.573293 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.573601 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.573902 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.574292 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.574777 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.575110 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.575638 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.575958 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.576269 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.576581 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.576892 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.577221 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.577533 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.577842 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.578203 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.578537 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.578841 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.579159 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.580050 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.580365 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.580668 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.581043 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.581500 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.581887 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.582362 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.582868 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.583288 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.583736 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.584238 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.584553 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.584893 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.585227 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.585541 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.585850 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.586166 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.586474 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.586820 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.587265 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.587469 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.587832 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.588150 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.588476 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.588784 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.589097 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.589412 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.589714 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.590248 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.590405 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.590915 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.591222 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.591636 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.591875 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.592194 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.592506 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.592816 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.593124 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.593431 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.593776 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.594110 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.594424 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.594735 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.595816 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.596165 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.596477 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.596872 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.597182 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.597619 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.597808 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.598245 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.598590 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.598870 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.599359 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.599856 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.600259 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.600829 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.601319 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.601998 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.602486 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.602895 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.603305 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.603862 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.604208 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.604736 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.605153 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.605470 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.605779 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.606099 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.606546 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.607003 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.607372 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.607809 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.608215 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.608583 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.608980 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.609288 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.609702 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.610035 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.610381 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.611375 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.611828 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.612235 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.612570 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.612981 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.613294 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.613716 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.614193 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.614565 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.615008 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.615324 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.615767 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.616159 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.616669 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.616989 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.617309 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.617625 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.618049 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.618251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.618567 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.618875 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.619186 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.619494 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.620065 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.620171 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.620471 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.620777 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.621081 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.621422 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.621687 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.621994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.622309 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.622893 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.623217 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.623577 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.623867 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.624190 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.624507 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.624833 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.625157 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.625622 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.625810 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.626192 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.627022 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.627335 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.627986 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.628179 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.628482 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.628788 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.629093 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.629394 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.629698 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.630163 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.630302 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.630616 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.630918 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.631227 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.631698 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.631913 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.632169 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.632479 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.632777 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.633078 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.633416 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.633721 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.634050 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.634374 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.634717 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.635019 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.635315 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.635775 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.635963 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.636270 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.636565 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.637043 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.637354 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.637660 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.637965 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.638269 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.638572 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.638876 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.639182 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.639482 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.639802 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.640115 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.640423 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.640720 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.641018 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.641323 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.641628 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.641996 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.642435 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.642811 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.643129 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.643432 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.643760 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.644064 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.644371 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.644677 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.644983 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.645307 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.645614 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.645925 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.646217 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.646525 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.646826 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.647129 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.647433 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.647780 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.648091 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.648389 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.648724 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.649103 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.649408 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.649708 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.650013 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.650312 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.650613 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.650910 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.651208 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.651529 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.651852 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.652158 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.652456 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.652757 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.653055 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.653395 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.653697 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.654053 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.654358 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.654667 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.654982 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.655291 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.655620 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.655934 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.656232 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.656545 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.656849 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.658700 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.658700 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.658700 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.659030 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.659216 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.659545 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.659870 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.660300 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.660709 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.661014 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.661327 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.661635 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.662034 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.662267 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.662526 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.662832 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.663143 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.663549 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.663787 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.664099 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.664405 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.664810 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.665014 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.665321 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.665644 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.665951 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.666248 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.666553 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.666856 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.667157 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.667454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.667915 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.668224 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.668531 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.668832 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.669138 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.669445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.669757 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.670071 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.670370 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.670785 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.671088 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.671394 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.671727 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.672029 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.672330 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.672666 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.673031 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.674074 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.674471 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.674780 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.675105 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.675411 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.675757 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.676223 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.676536 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.676839 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.677261 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.677561 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.677869 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.678189 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.678504 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.678829 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.679129 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.679441 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.679776 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.680097 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.680419 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.680731 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.681039 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.681340 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.681657 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.681972 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.682289 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.682597 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.683015 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.683335 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.683678 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.684000 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.684320 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.684621 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.684921 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.685230 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.685529 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.685829 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.686147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.686526 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.686752 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.687061 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.687359 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.687684 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.688405 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.688405 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.688635 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.688635 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.688635 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.690300 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.690566 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.690869 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.691193 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.691497 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.691826 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.692121 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.692423 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.692767 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.693067 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.693390 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.693722 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.694050 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.694431 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.694693 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.695021 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.695395 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.695679 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.696005 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.696308 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.696608 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.696916 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.697220 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.697523 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.697822 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.698128 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.698426 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.698725 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.699024 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.699346 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.699678 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.700001 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.700303 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.700601 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.700900 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.701203 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.701542 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.701842 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.702177 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.702495 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.702814 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.703144 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.703452 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.703803 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.704118 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.705219 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.705659 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.705988 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.706364 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.706682 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.707003 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.707310 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.707651 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.707973 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.708291 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.708875 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.709199 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.709640 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.709903 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.710133 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.710440 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.710750 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.711057 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.711456 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.711699 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.712144 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.712337 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.712658 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.712989 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.713327 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.713647 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.713955 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.714266 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.714575 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.714931 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.715245 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.715865 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.716154 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.716469 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.716778 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.717091 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.717392 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.717703 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.718013 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.718319 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.718623 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.718931 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.719241 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.719602 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.720118 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.720497 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.720810 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.721126 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.721447 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.722007 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.722323 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.722656 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.722988 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.723313 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.723668 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.723980 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.724310 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.724616 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.724921 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.725230 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.725537 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.725839 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.726162 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.726469 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.726772 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.727087 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.727394 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.727988 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.728336 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.728652 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.728976 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.729298 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.729612 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.729924 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.730241 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.730547 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.730852 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.731166 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.731480 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.731809 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.732121 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.732431 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.732741 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.733042 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.733350 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.733654 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.734048 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.734290 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.734596 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.734890 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.735199 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.735641 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.735952 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.736262 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.736565 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.736873 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.737173 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.737484 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.738396 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.738396 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.738396 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.738675 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.739030 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.739358 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.739694 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.739997 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.740319 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.740627 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.740950 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.741259 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.741565 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.741965 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.742228 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.742813 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.743144 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.743461 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.743829 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.744256 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.744535 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.744768 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.745072 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.745395 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.745702 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.746008 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.746313 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.746621 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.746924 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.747228 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.747558 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.747863 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.748167 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.748470 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.748773 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.749077 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.749380 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.749695 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.750040 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.750362 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.750671 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.751645 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.752097 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.752549 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.752863 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.753177 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.753493 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.753807 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.754145 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.754462 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.754764 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.755195 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.755581 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.755855 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.756175 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.756493 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.756802 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.757122 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.757434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.757862 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.758059 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.758384 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.758723 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.759049 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.759372 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.759707 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.760011 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.760314 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.760626 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.760940 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.761249 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.761550 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.761855 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.762165 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.762469 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.762769 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.763072 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.763373 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.763710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.764011 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.764313 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.764616 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.764921 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.765218 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.765518 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.765824 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.766125 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.766428 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.766836 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.767678 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.768012 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.768322 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.768656 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.768974 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.769292 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.769605 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.769924 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.770234 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.770555 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.770870 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.771189 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.771500 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.771860 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.772162 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.772482 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.772783 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.773143 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.773400 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.773693 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.774022 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.774344 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.774648 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.775058 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.775291 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.775635 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.775952 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.776260 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.776587 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.776900 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.777204 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.777509 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.777814 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.778131 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.778434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.778740 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.779047 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.779361 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.779698 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.780026 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.780352 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.780663 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.780985 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.781306 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.781657 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.781967 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.782360 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.782888 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.783022 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.783336 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.783666 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.783910 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:14:02.852868 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:14:02.853450 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:14:02.853751 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:14:02.854164 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:14:02.854498 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:14:02.854810 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.855200 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.855469 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.855844 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.856179 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.856495 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.856824 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.857148 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.857480 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.857746 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.858071 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.858399 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-1-iscsi {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.858729 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.859072 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.859382 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.859741 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.860046 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.860371 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.861041 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.861944 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.862271 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.862580 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.862900 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.863249 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.863602 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.863943 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.864245 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.864556 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.864883 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.865195 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.865610 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-1-iscsi {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.865933 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.866244 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.866559 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.866993 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.867308 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.867660 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.867976 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.868316 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.868629 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.868962 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.869284 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.869601 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.869925 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.870225 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.870538 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.870849 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.871168 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.871471 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.871804 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.872056 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.872507 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.872693 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.873014 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.873337 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.873595 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.873839 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.874161 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.874481 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.874792 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.875086 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.875394 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.875728 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.876038 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.877689 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.877999 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.878318 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.878656 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.878978 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.879306 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.879645 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.879983 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.880395 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.880646 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.880958 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.881303 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.881623 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.881936 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.882258 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.882580 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.882892 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.883202 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.883542 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.883856 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.884337 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.884507 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.884760 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.885068 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.885373 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.885700 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.886004 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.886313 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.886621 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.886925 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.887227 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.887572 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.887866 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.888171 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.888477 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.888783 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.889093 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.889398 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.889711 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.890037 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.890405 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.890662 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.891191 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.891480 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.893675 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.893675 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.893675 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.893675 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.893675 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.894287 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.894287 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.894745 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.894901 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.895097 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.895420 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.895829 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.896526 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.896526 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.896878 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.897184 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.897332 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.898053 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.898053 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.898363 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.898504 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.898755 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.899060 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.899385 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.901759 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.901759 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.901759 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.901759 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.901759 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:14:02.901759 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.901759 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.902788 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.902788 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.902788 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.903161 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.903161 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.903469 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.903816 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.904143 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.904454 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.904765 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.905075 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.905395 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.905713 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.906044 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.906357 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.906673 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.906999 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.907338 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.908910 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.909290 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.909616 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.909936 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.910289 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.910643 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.910959 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.911285 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.911644 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.911962 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.912277 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.912588 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.912916 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.913252 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.913566 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.913888 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.914206 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.914520 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.914891 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.915146 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.915458 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.915838 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.916161 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.916477 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.916792 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.917112 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.917429 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.917742 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.918055 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.918366 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.918675 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.918982 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.919372 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.919711 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.920051 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.920409 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.920697 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.921039 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.921347 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.921670 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.922140 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.922463 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.922776 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.923791 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.924893 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.925216 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.925557 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.925880 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.926196 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.926527 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.926840 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.927151 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.927473 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.927818 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.928135 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.928452 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.928766 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.929100 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.929417 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.929734 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.930075 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.930409 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.930720 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.931053 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.931379 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.931730 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.932038 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.932352 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.932657 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.932966 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.933271 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.933582 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.933888 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.934194 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.934494 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.934800 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.935104 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.935436 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.935782 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.936084 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.936388 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.936694 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.937044 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.937352 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.937700 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.938040 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.938365 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.938903 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.939942 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.940271 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.940588 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.940911 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.941354 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.941556 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.941882 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.942192 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.942517 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.942837 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.943167 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.943485 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.943833 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.944144 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.944461 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.944804 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.945145 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.945467 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.945787 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.946132 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.946416 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.946730 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.947043 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.947359 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.947700 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.948070 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.948362 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.948640 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.948954 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.949278 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.949591 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.949914 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.950219 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.950536 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.950874 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.951209 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.951581 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.951860 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.952186 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.952549 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.952849 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.953207 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.953640 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.953753 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO dbcounter [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Registered counter for database nova_api Jul 25 19:14:02.953948 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.954409 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.955477 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.955826 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.956198 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.956484 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.956805 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.957154 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.957508 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.957893 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.958083 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.958416 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.958726 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.959065 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.959369 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.959712 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.960018 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.960343 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.960659 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.960955 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.961264 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.961639 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.961944 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.962231 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.962536 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.962853 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.963178 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.963487 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.963825 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.964138 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.964449 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.964848 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.965151 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.965397 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.965982 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.966293 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.966601 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.966917 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.967240 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.967587 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.967883 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.968197 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.968500 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.968813 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.969138 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.969721 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.971548 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.971882 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.972219 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.972554 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.972882 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.973224 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.973564 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.973914 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.974241 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.974552 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.974863 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.975245 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.975494 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.975643 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_db.sqlalchemy.engines [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:14:02.975833 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.976146 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.976455 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.976770 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.977081 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.977406 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.977691 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.978000 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.978322 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.978671 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.978948 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.979258 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.979606 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.979921 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.980228 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.980534 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.980839 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.981187 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.981494 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.981848 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.982172 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.982518 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.982809 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writer thread running {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:14:02.982917 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.983132 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.983457 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.983771 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.984155 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.984547 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.984919 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.985175 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.986094 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.987149 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.987502 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.987914 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.988241 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.988576 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.988958 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.989333 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.989658 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.990036 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.990358 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.990648 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.990999 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.991307 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.991636 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.991949 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.992301 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.992576 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.992908 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.993192 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.993540 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.993853 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.994163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.994471 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.994799 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.995112 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.995420 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.995792 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.996106 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.996412 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.996718 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.997028 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.997353 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.997675 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.998014 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.998329 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.998636 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.998943 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.999249 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.999581 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:02.999887 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.000191 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.000494 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.000798 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.001241 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.002283 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.002612 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.002934 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.003251 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.003587 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.003949 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.004262 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.004629 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.004944 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.005300 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.005630 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.005951 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.006269 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.006589 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.006899 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.007221 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.007559 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.007905 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.008219 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.008524 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.008850 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.009166 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.009480 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.009805 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.010129 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.010456 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.010805 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.011121 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.011472 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.011813 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.012125 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.012442 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.012756 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.013124 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.013382 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.013697 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.014010 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.014318 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.014635 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.014945 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.015252 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.015614 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.015926 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.016232 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.016543 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.018156 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.018480 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.018792 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.019240 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.019586 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.019905 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.020214 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.020528 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.020846 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.021169 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.021481 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.021788 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.022209 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.022523 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.022883 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.023152 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.023455 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.023784 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.024097 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.024428 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.024732 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.025037 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.025344 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.025669 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.025978 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.026303 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.026725 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.027037 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.027343 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.027794 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.028113 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.028424 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.028747 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.029073 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.029397 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.029711 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.030025 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.030336 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.030665 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.030988 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.031308 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.031647 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.031949 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.032395 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.033956 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.034295 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.034658 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.035077 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.035419 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.035755 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.036087 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.036410 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.036721 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.037031 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.037346 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.037659 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.037984 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.038285 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.038593 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.038903 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.039215 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.039862 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.039862 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.040145 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.040476 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.040780 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.041105 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.041413 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.041717 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.042039 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.042352 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.042677 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.042991 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.043301 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.043580 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.context [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ccbefd05-b701-4978-bc0c-e210af40d93d(cell1) {{(pid=103336) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 19:14:03.043687 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.043917 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.044264 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.044579 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.044904 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.045237 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.045569 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.045909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.046254 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.046588 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.046946 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.047269 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.047620 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.047774 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:03.047956 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.048270 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.049357 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.049453 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:03.049679 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.049996 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.050200 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:03.050310 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.050628 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.050937 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.051248 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.051577 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.051905 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.052215 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:03.052323 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.052536 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.052849 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.053157 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.053467 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.053775 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.054127 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.054231 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO dbcounter [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Registered counter for database nova_cell0 Jul 25 19:14:03.054435 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.054774 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.055097 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.055428 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.055788 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.056106 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.056431 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.056747 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.057063 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.057382 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.057700 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.058019 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.058342 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.058653 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.058968 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.059294 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.059617 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.059933 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.060328 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO dbcounter [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Registered counter for database nova_cell1 Jul 25 19:14:03.060504 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.060838 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.061159 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.061478 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.061796 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.062114 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.062437 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.062754 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.063067 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.063387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.063885 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.065048 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.065385 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.065722 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.066071 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.066404 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.066720 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.067042 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.067366 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.067760 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.068083 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.068215 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_db.sqlalchemy.engines [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:14:03.068625 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.068769 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.069043 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.069315 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.069630 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.069942 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.070258 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.070572 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.070884 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.071038 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_db.sqlalchemy.engines [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:14:03.071196 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.071527 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.071842 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.072169 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.072507 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.072832 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.073146 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.073467 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.073786 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.074354 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.074664 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.074998 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.075312 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.075687 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.076001 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.076204 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writer thread running {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:14:03.076396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.076636 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.076944 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.077263 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.077573 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.077883 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.078191 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.078498 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writer thread running {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:14:03.078644 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.078812 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.079101 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.080155 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.080591 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.081280 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.081635 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.081965 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.082294 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.082621 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.082943 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.083258 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.083609 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.083920 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.084227 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.084551 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.084862 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.085169 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.085469 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.085785 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.086101 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.086404 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.086714 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.087018 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.087349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.087683 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.087990 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.088294 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.088609 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.088913 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.089220 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.089526 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.089827 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.090139 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.090441 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.091019 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.091325 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.091663 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.091971 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.092279 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.092638 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.092975 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.093285 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.093602 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.093911 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.094219 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.094638 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.095565 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.096367 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.096746 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.097075 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.097673 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.098006 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.098339 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.098685 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.099021 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.099331 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.099668 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.099980 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.100311 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.100630 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.100948 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.101365 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.101683 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.101998 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.102309 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.102632 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.102945 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.103297 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.103592 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.103884 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.104195 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.104510 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.104897 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.105169 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.105497 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.105813 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.106136 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.106454 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.106767 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.107080 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.107395 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.107733 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.108054 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.108469 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.108786 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.109095 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.109529 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.109845 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.110169 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.110546 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.111078 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.111960 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.112287 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.112610 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.112928 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.113250 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.113590 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.113931 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.114267 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.114595 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.114906 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.115216 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.115541 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.115857 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.116179 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.116489 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.116877 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.117188 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.117498 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.117805 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.118237 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.118555 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.118863 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.119171 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.119476 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.119817 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.120124 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.120425 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.120732 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.121036 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.121373 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.121651 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.121960 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.122263 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.122588 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.122877 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.123258 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.123596 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.124004 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.124274 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.124542 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.124940 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.125254 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.125580 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.125918 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.126529 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.127361 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.127729 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.128050 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.128372 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.128687 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.129005 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.129320 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.129637 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.129974 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.130304 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.130614 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.130943 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.131265 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.131616 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.131937 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.132251 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.132667 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.132992 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.133297 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.133611 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.133928 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.134240 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.134567 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.134878 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.135210 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.135530 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.135849 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.136182 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.136512 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.136826 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.137156 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.137483 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.137834 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.138153 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.138506 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.138836 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.139152 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.139467 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.139909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:14:03.140157 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:14:03.244546 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO dbcounter [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Registered counter for database nova_cell0 Jul 25 19:14:03.253541 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_db.sqlalchemy.engines [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:14:03.258645 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writer thread running {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:14:03.305458 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Registered counter for database nova_api Jul 25 19:14:03.328900 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:14:03.337122 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:14:03.400606 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.context [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ccbefd05-b701-4978-bc0c-e210af40d93d(cell1) {{(pid=103337) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 19:14:03.404993 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:03.406665 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:03.408899 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:03.411116 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:03.413331 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Registered counter for database nova_cell0 Jul 25 19:14:03.419403 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Registered counter for database nova_cell1 Jul 25 19:14:03.433971 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:14:03.435059 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:14:03.445931 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:14:03.447771 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:14:03.606384 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Registered counter for database nova_cell0 Jul 25 19:14:03.616574 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:14:03.621771 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:14:03.628442 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: WARNING keystonemiddleware.auth_token [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:14:03.636335 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: WARNING keystonemiddleware.auth_token [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:14:03.989764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:14:03.997749 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:14:04.006268 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: WARNING keystonemiddleware.auth_token [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:14:04.012788 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: WARNING keystonemiddleware.auth_token [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:14:04.019369 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5646fb8e99c0 pid: 103336 (default app) Jul 25 19:14:04.021874 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:04.023371 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002209 Jul 25 19:14:04.023955 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Mon Jul 25 19:14:04 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:14:04.389062 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:14:04.395689 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-43e13af5-6ac8-4c17-bca3-dba566d350ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:14:04.402751 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5646fb8e99c0 pid: 103337 (default app) Jul 25 19:15:41.700363 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:41.702539 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002678 Jul 25 19:15:41.703402 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:41.720267 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:41.721723 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell0:SELECT=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:41.722699 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell1:SELECT=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:41.723548 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell0:SELECT=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:42.993076 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-a68fd93c-d86c-41d8-a94d-6e23a94f6690 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:43.029092 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-a68fd93c-d86c-41d8-a94d-6e23a94f6690 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.317301 Jul 25 19:15:43.030307 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Mon Jul 25 19:15:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:45.929705 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:45.930890 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-2ac5a77a-76c7-4708-ad59-9bef4105c569 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001763 Jul 25 19:15:45.931756 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:15:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:46.753097 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e58f18eb-09c8-4410-90a8-36991a17c2d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "disk": 1, "vcpus": 1}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:46.792594 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:15:46.792594 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: warnings.warn(msg) Jul 25 19:15:46.836477 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e58f18eb-09c8-4410-90a8-36991a17c2d2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.895802 Jul 25 19:15:46.843773 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Jul 25 19:15:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:15:46.856142 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_api:SELECT=3 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:46.858399 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_cell0:SELECT=3 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:46.859606 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_cell1:SELECT=3 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:46.860799 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:47.095498 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-dc55d91c-71df-4ba5-94a5-b16186953094 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:47.100358 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:15:47.100358 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: warnings.warn(msg) Jul 25 19:15:47.205688 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-dc55d91c-71df-4ba5-94a5-b16186953094 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.356218 Jul 25 19:15:47.206293 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Mon Jul 25 19:15:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:15:50.568130 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e58f18eb-09c8-4410-90a8-36991a17c2d2 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:50.569894 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e58f18eb-09c8-4410-90a8-36991a17c2d2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002294 Jul 25 19:15:50.570364 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:15:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:15:51.661321 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-cb795100-139d-47f6-92a4-0d439a70be96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M"}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:51.685946 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:15:51.685946 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: warnings.warn(msg) Jul 25 19:15:51.714531 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-cb795100-139d-47f6-92a4-0d439a70be96 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.135658 Jul 25 19:15:51.719912 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Jul 25 19:15:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:15:51.730131 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-a669475d-df66-46a5-924b-74bf51da8621 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:51.735548 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:15:51.735548 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: warnings.warn(msg) Jul 25 19:15:51.786968 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-a669475d-df66-46a5-924b-74bf51da8621 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060786 Jul 25 19:15:51.787958 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Mon Jul 25 19:15:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:54.473369 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-cb795100-139d-47f6-92a4-0d439a70be96 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:54.474509 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-cb795100-139d-47f6-92a4-0d439a70be96 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 25 19:15:54.474808 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:15:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:55.107831 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-86abf4e6-96c5-41a8-8f09-4c12598bbc48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "name": "ds1G"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:55.130510 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-86abf4e6-96c5-41a8-8f09-4c12598bbc48 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.648432 Jul 25 19:15:55.131078 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Jul 25 19:15:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:15:55.146004 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-46f23d39-a086-4ebd-9953-72aa0fa7fab9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:55.182266 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-46f23d39-a086-4ebd-9953-72aa0fa7fab9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041108 Jul 25 19:15:55.183003 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Mon Jul 25 19:15:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:58.247782 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-86abf4e6-96c5-41a8-8f09-4c12598bbc48 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:58.248971 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-86abf4e6-96c5-41a8-8f09-4c12598bbc48 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Jul 25 19:15:58.249437 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:15:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:15:59.005881 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-d8cd7488-c5ec-49dc-9388-9437f5d3388b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:59.046674 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-d8cd7488-c5ec-49dc-9388-9437f5d3388b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.786058 Jul 25 19:15:59.048924 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Jul 25 19:15:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:15:59.070963 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-08604df9-e3a0-48ed-aec6-ec586e9b44ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:59.128374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-08604df9-e3a0-48ed-aec6-ec586e9b44ec admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064091 Jul 25 19:15:59.130404 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Mon Jul 25 19:15:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:02.359745 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-d8cd7488-c5ec-49dc-9388-9437f5d3388b admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:02.362551 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-d8cd7488-c5ec-49dc-9388-9437f5d3388b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003536 Jul 25 19:16:02.363610 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:03.052204 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-6d2884ae-a435-4f32-9af8-551ff6e95839 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:03.077599 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-6d2884ae-a435-4f32-9af8-551ff6e95839 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.702541 Jul 25 19:16:03.078611 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Jul 25 19:16:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:16:03.096767 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-dfb4e59f-05f7-4c80-be80-8abc046b9ddb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:03.127583 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-dfb4e59f-05f7-4c80-be80-8abc046b9ddb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038862 Jul 25 19:16:03.128642 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Mon Jul 25 19:16:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:06.319887 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-6d2884ae-a435-4f32-9af8-551ff6e95839 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:06.321825 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-6d2884ae-a435-4f32-9af8-551ff6e95839 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002294 Jul 25 19:16:06.322450 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:16:07.040962 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-8251bfbb-4eb8-45e8-89ab-19bbf732001c admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:07.075679 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-8251bfbb-4eb8-45e8-89ab-19bbf732001c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.742781 Jul 25 19:16:07.076458 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Mon Jul 25 19:16:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:16:10.170679 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-6d2884ae-a435-4f32-9af8-551ff6e95839 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:10.172668 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-6d2884ae-a435-4f32-9af8-551ff6e95839 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003244 Jul 25 19:16:10.173429 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:16:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:16:10.938171 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-682e36a7-f2f7-4d69-a686-6f37d7b311c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "name": "m1.tiny", "ram": 512, "id": "1"}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:10.960887 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-682e36a7-f2f7-4d69-a686-6f37d7b311c0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.779425 Jul 25 19:16:10.961671 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Jul 25 19:16:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:16:10.977088 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-aecac9dc-a776-4e0d-a496-56bb1391ee7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:11.016425 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-aecac9dc-a776-4e0d-a496-56bb1391ee7f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043364 Jul 25 19:16:11.017071 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Mon Jul 25 19:16:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:13.985115 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-682e36a7-f2f7-4d69-a686-6f37d7b311c0 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:13.987854 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-682e36a7-f2f7-4d69-a686-6f37d7b311c0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003142 Jul 25 19:16:13.988538 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:16:13 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:14.624363 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-57162596-ab01-4fba-8b4d-a1a9cd496919 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:14.634483 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:14.655466 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-57162596-ab01-4fba-8b4d-a1a9cd496919 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.656788 Jul 25 19:16:14.656788 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Jul 25 19:16:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:16:14.673768 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-0349ee02-4ce5-4834-983f-7ceb8ec1d497 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:14.704553 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-0349ee02-4ce5-4834-983f-7ceb8ec1d497 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034462 Jul 25 19:16:14.705704 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Mon Jul 25 19:16:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:17.555260 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-57162596-ab01-4fba-8b4d-a1a9cd496919 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:17.556313 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-57162596-ab01-4fba-8b4d-a1a9cd496919 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 25 19:16:17.556939 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:16:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:18.295317 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-467f58a2-791e-4c08-94f3-28b8cc5165f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:18.312532 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:18.345632 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-467f58a2-791e-4c08-94f3-28b8cc5165f2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.780342 Jul 25 19:16:18.347066 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Jul 25 19:16:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:16:18.359944 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-0c92079d-9be8-4d45-b754-ffa0ff8dd2c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:18.392499 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-0c92079d-9be8-4d45-b754-ffa0ff8dd2c8 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037129 Jul 25 19:16:18.393788 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Mon Jul 25 19:16:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:21.723051 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-467f58a2-791e-4c08-94f3-28b8cc5165f2 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:21.723956 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-467f58a2-791e-4c08-94f3-28b8cc5165f2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002550 Jul 25 19:16:21.725665 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:16:22.543141 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-ba2587c0-a019-4919-89c3-ef0753ba1d4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:22.574230 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-ba2587c0-a019-4919-89c3-ef0753ba1d4d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.837512 Jul 25 19:16:22.581097 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Jul 25 19:16:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:16:22.590955 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-bc94a8c4-daaa-4704-a61c-df24f9997c57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:22.633438 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-bc94a8c4-daaa-4704-a61c-df24f9997c57 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047937 Jul 25 19:16:22.634242 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Mon Jul 25 19:16:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:26.069471 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-ba2587c0-a019-4919-89c3-ef0753ba1d4d admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:26.070525 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-ba2587c0-a019-4919-89c3-ef0753ba1d4d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Jul 25 19:16:26.070951 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:16:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:26.937438 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-12b56d4b-5732-48fd-81f0-2ad9d4b54a26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:26.969930 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-12b56d4b-5732-48fd-81f0-2ad9d4b54a26 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.890105 Jul 25 19:16:26.971569 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Jul 25 19:16:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:16:27.003856 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-43d9d18d-6897-4456-8c69-707695b008dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:27.055269 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-43d9d18d-6897-4456-8c69-707695b008dd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058800 Jul 25 19:16:27.057115 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Mon Jul 25 19:16:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:16:48.487085 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-12b56d4b-5732-48fd-81f0-2ad9d4b54a26 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:48.488210 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-12b56d4b-5732-48fd-81f0-2ad9d4b54a26 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Jul 25 19:16:48.488776 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:16:48.501410 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:49.045296 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-96baf115-d799-4802-9d69-194e8904f7d8 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:49.066079 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-96baf115-d799-4802-9d69-194e8904f7d8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.569235 Jul 25 19:16:49.066664 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Mon Jul 25 19:16:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:16:50.387613 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-12b56d4b-5732-48fd-81f0-2ad9d4b54a26 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:50.389194 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-12b56d4b-5732-48fd-81f0-2ad9d4b54a26 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002302 Jul 25 19:16:50.389734 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:16:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:51.069374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-3e597133-6ae1-46d5-9510-34cd6b2abd7f admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:51.079125 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.wsgi [None req-3e597133-6ae1-46d5-9510-34cd6b2abd7f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-3e597133-6ae1-46d5-9510-34cd6b2abd7f admin admin] Request method failure captured: Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Accept: application/json Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Accept-Encoding: gzip, deflate Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Connection: keep-alive Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Content-Length: 0 Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Host: 10.222.0.18 Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Openstack-Api-Version: compute 2.90 Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Openstack-System-Scope: None Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: User-Agent: python-novaclient Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Auth-Token: gAAAAABi3uwidhwbPPDNleiezPuobXU5Z6S4GQAoTz7EFlfJRBZQmRoQSSotit-h1HVqLRL131YU9AuJfaYVWgNCSkE8rXgHBejgHCHkH1G8cKCcdP6vPe9eToK-LeVxskhhSJbEcJ4UIvJzyXoWWZLwNc4YJmdg8UBOQlMF5doVBxPNjzrwxGQ Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Domain-Id: None Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Domain-Name: None Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Identity-Status: Confirmed Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Is-Admin-Project: True Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Id: default Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Name: Default Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Name: admin Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Role: admin,member,reader Jul 25 19:16:51.084764 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Roles: admin,member,reader Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9565eeec7ac7457abc5ee445dbf84c18", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Tenant: admin Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Tenant-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Tenant-Name: admin Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User: admin Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Id: default Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Name: Default Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Id: 35d700f1abf943789efbf8a08bd9b587 Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Name: admin Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: method: > Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: exception: Flavor 42 could not be found. Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: action_args: {'id': '42'} Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:16:51.087355 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:51.090208 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:51.093396 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-3e597133-6ae1-46d5-9510-34cd6b2abd7f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:16:51.095721 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-3e597133-6ae1-46d5-9510-34cd6b2abd7f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.553591 Jul 25 19:16:51.095721 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Jul 25 19:16:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 555 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:51.102827 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-5b4f2b84-133a-4c10-ab7b-da61427d7e16 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:51.109127 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:51.142514 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-5b4f2b84-133a-4c10-ab7b-da61427d7e16 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.044398 Jul 25 19:16:51.143556 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Jul 25 19:16:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:16:51.154962 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-44923bc2-d75d-42c7-be24-5c38405f2e3b admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:51.187325 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-44923bc2-d75d-42c7-be24-5c38405f2e3b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.036821 Jul 25 19:16:51.187970 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Jul 25 19:16:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:16:51.202698 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-026aa640-16a9-47e3-8653-7fbbdab9ac14 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:51.211600 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.wsgi [None req-026aa640-16a9-47e3-8653-7fbbdab9ac14 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-026aa640-16a9-47e3-8653-7fbbdab9ac14 admin admin] Request method failure captured: Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Accept: application/json Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Accept-Encoding: gzip, deflate Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Connection: keep-alive Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Content-Length: 0 Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Host: 10.222.0.18 Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Openstack-Api-Version: compute 2.90 Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Openstack-System-Scope: None Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: User-Agent: python-novaclient Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Auth-Token: gAAAAABi3uwidhwbPPDNleiezPuobXU5Z6S4GQAoTz7EFlfJRBZQmRoQSSotit-h1HVqLRL131YU9AuJfaYVWgNCSkE8rXgHBejgHCHkH1G8cKCcdP6vPe9eToK-LeVxskhhSJbEcJ4UIvJzyXoWWZLwNc4YJmdg8UBOQlMF5doVBxPNjzrwxGQ Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Domain-Id: None Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Domain-Name: None Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Identity-Status: Confirmed Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Is-Admin-Project: True Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Domain-Id: default Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Domain-Name: Default Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Name: admin Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Role: admin,member,reader Jul 25 19:16:51.216445 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Roles: admin,member,reader Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9565eeec7ac7457abc5ee445dbf84c18", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Tenant: admin Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Tenant-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Tenant-Name: admin Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User: admin Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Domain-Id: default Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Domain-Name: Default Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Id: 35d700f1abf943789efbf8a08bd9b587 Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Name: admin Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: method: > Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: exception: Flavor 42 could not be found. Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: action_args: {'id': '42'} Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:16:51.218936 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:51.220147 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:51.221454 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-026aa640-16a9-47e3-8653-7fbbdab9ac14 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:16:51.222900 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-026aa640-16a9-47e3-8653-7fbbdab9ac14 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.023478 Jul 25 19:16:51.222900 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Jul 25 19:16:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:52.429852 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-44923bc2-d75d-42c7-be24-5c38405f2e3b admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:52.430955 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-44923bc2-d75d-42c7-be24-5c38405f2e3b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jul 25 19:16:52.431368 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:16:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:16:53.148701 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-a1bec06f-cb02-4432-a817-828806c9449d admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:53.156239 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.wsgi [None req-a1bec06f-cb02-4432-a817-828806c9449d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-a1bec06f-cb02-4432-a817-828806c9449d admin admin] Request method failure captured: Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Accept: application/json Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Accept-Encoding: gzip, deflate Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Connection: keep-alive Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Content-Length: 0 Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Host: 10.222.0.18 Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Openstack-Api-Version: compute 2.90 Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Openstack-System-Scope: None Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: User-Agent: python-novaclient Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Auth-Token: gAAAAABi3uwk4ArkkiTx02KnaBJdF37TtAQEREgN3u_m37j2jVpciJsUAb1Yq9C9LTepkT_xtKvfVKiXQKPdy5KE72GLTHJE7Q5QZVvU712kwkonyPJ9ByNyJWYDtcAhDHdnEL9DP7-FCxucx6zoekMNL2bUQLxbRbcsIYAj0mO-nt_IfCM1tWo Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Domain-Id: None Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Domain-Name: None Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Identity-Status: Confirmed Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Is-Admin-Project: True Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Domain-Id: default Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Domain-Name: Default Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Name: admin Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Role: admin,member,reader Jul 25 19:16:53.157994 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Roles: admin,member,reader Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9565eeec7ac7457abc5ee445dbf84c18", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Tenant: admin Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Tenant-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Tenant-Name: admin Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User: admin Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Domain-Id: default Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Domain-Name: Default Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Id: 35d700f1abf943789efbf8a08bd9b587 Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Name: admin Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: method: > Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: exception: Flavor 84 could not be found. Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: action_args: {'id': '84'} Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:16:53.160349 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:53.161710 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:53.163251 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-a1bec06f-cb02-4432-a817-828806c9449d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:16:53.164692 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-a1bec06f-cb02-4432-a817-828806c9449d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.580183 Jul 25 19:16:53.164692 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Jul 25 19:16:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 582 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:53.176064 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-839c0ceb-3367-4dc8-b7ee-64a22616e08e admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:53.206692 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-839c0ceb-3367-4dc8-b7ee-64a22616e08e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.038824 Jul 25 19:16:53.207739 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Jul 25 19:16:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:16:53.222951 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-8c4cd262-e245-4af9-8723-7af245be0927 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:53.242043 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-8c4cd262-e245-4af9-8723-7af245be0927 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023565 Jul 25 19:16:53.242634 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Jul 25 19:16:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:16:53.254068 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-527f5cd1-c93f-4687-b21b-6469e47f3981 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:53.261254 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.wsgi [None req-527f5cd1-c93f-4687-b21b-6469e47f3981 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-527f5cd1-c93f-4687-b21b-6469e47f3981 admin admin] Request method failure captured: Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Accept: application/json Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Accept-Encoding: gzip, deflate Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Connection: keep-alive Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Content-Length: 0 Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Host: 10.222.0.18 Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Openstack-Api-Version: compute 2.90 Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Openstack-System-Scope: None Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: User-Agent: python-novaclient Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Auth-Token: gAAAAABi3uwk4ArkkiTx02KnaBJdF37TtAQEREgN3u_m37j2jVpciJsUAb1Yq9C9LTepkT_xtKvfVKiXQKPdy5KE72GLTHJE7Q5QZVvU712kwkonyPJ9ByNyJWYDtcAhDHdnEL9DP7-FCxucx6zoekMNL2bUQLxbRbcsIYAj0mO-nt_IfCM1tWo Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Domain-Id: None Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Domain-Name: None Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Identity-Status: Confirmed Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Is-Admin-Project: True Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Id: default Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Name: Default Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Name: admin Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Role: admin,member,reader Jul 25 19:16:53.263411 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Roles: admin,member,reader Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9565eeec7ac7457abc5ee445dbf84c18", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Tenant: admin Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Tenant-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Tenant-Name: admin Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User: admin Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Id: default Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Name: Default Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Id: 35d700f1abf943789efbf8a08bd9b587 Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Name: admin Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: method: > Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: exception: Flavor 84 could not be found. Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: action_args: {'id': '84'} Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:16:53.266163 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:53.267843 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:53.270374 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-527f5cd1-c93f-4687-b21b-6469e47f3981 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:16:53.272626 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-527f5cd1-c93f-4687-b21b-6469e47f3981 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015859 Jul 25 19:16:53.272626 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Jul 25 19:16:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:54.492190 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-8c4cd262-e245-4af9-8723-7af245be0927 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:54.493230 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-8c4cd262-e245-4af9-8723-7af245be0927 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Jul 25 19:16:54.493643 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:55.309847 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-b74ce244-53d0-4166-bdc2-35f110a41de4 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:55.316770 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.wsgi [None req-b74ce244-53d0-4166-bdc2-35f110a41de4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-b74ce244-53d0-4166-bdc2-35f110a41de4 admin admin] Request method failure captured: Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Accept: application/json Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Accept-Encoding: gzip, deflate Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Connection: keep-alive Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Content-Length: 0 Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Host: 10.222.0.18 Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Openstack-Api-Version: compute 2.90 Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Openstack-System-Scope: None Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: User-Agent: python-novaclient Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Auth-Token: gAAAAABi3uwmgvUVrl0vxIpsG7oskVYFkzDinGBj7-eRwZB7Q9T0Wtp-M1Np7ofHtGWl5B--k1brqFXgy-RcfLVMGEXnvmOPxw4LbVS7efP_ZU2y7tXPNJHiIjYEmX3DJY-WSwUbMewDCFdIzqmBD73LcYtAL28AY9ph1VtrrzxhCTYrntifcQQ Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Domain-Id: None Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Domain-Name: None Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Identity-Status: Confirmed Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Is-Admin-Project: True Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Id: default Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Name: Default Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Project-Name: admin Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Role: admin,member,reader Jul 25 19:16:55.318349 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Roles: admin,member,reader Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9565eeec7ac7457abc5ee445dbf84c18", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Tenant: admin Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Tenant-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-Tenant-Name: admin Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User: admin Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Id: default Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Name: Default Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Id: 35d700f1abf943789efbf8a08bd9b587 Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: X-User-Name: admin Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: method: > Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: exception: Flavor 451 could not be found. Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: action_args: {'id': '451'} Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:16:55.320909 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:55.322387 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 25 19:16:55.325027 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-b74ce244-53d0-4166-bdc2-35f110a41de4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:16:55.327042 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-b74ce244-53d0-4166-bdc2-35f110a41de4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.672682 Jul 25 19:16:55.327042 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Jul 25 19:16:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 674 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:55.330856 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-40e3b4db-60f6-4c20-8301-157ec32e257b admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:55.348699 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-40e3b4db-60f6-4c20-8301-157ec32e257b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021223 Jul 25 19:16:55.349474 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Jul 25 19:16:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:16:55.360427 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:55.377860 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020832 Jul 25 19:16:55.378581 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Jul 25 19:16:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:16:55.393548 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-fea5b0e8-157c-4b86-b847-4b621ccd6d4e admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:55.404272 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.wsgi [None req-fea5b0e8-157c-4b86-b847-4b621ccd6d4e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-fea5b0e8-157c-4b86-b847-4b621ccd6d4e admin admin] Request method failure captured: Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Accept: application/json Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Accept-Encoding: gzip, deflate Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Connection: keep-alive Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Content-Length: 0 Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Host: 10.222.0.18 Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Openstack-Api-Version: compute 2.90 Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Openstack-System-Scope: None Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: User-Agent: python-novaclient Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Auth-Token: gAAAAABi3uwmgvUVrl0vxIpsG7oskVYFkzDinGBj7-eRwZB7Q9T0Wtp-M1Np7ofHtGWl5B--k1brqFXgy-RcfLVMGEXnvmOPxw4LbVS7efP_ZU2y7tXPNJHiIjYEmX3DJY-WSwUbMewDCFdIzqmBD73LcYtAL28AY9ph1VtrrzxhCTYrntifcQQ Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Domain-Id: None Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Domain-Name: None Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Identity-Status: Confirmed Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Is-Admin-Project: True Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Domain-Id: default Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Domain-Name: Default Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Project-Name: admin Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Role: admin,member,reader Jul 25 19:16:55.407299 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Roles: admin,member,reader Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9565eeec7ac7457abc5ee445dbf84c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9565eeec7ac7457abc5ee445dbf84c18", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Tenant: admin Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Tenant-Id: 9565eeec7ac7457abc5ee445dbf84c18 Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-Tenant-Name: admin Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User: admin Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Domain-Id: default Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Domain-Name: Default Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Id: 35d700f1abf943789efbf8a08bd9b587 Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: X-User-Name: admin Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: method: > Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: exception: Flavor 451 could not be found. Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: action_args: {'id': '451'} Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:16:55.409434 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:55.410421 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: ERROR nova.api.openstack.wsgi Jul 25 19:16:55.412010 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-fea5b0e8-157c-4b86-b847-4b621ccd6d4e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:16:55.414021 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-fea5b0e8-157c-4b86-b847-4b621ccd6d4e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.024205 Jul 25 19:16:55.414021 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Jul 25 19:16:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 19:16:56.538206 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:56.540267 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002750 Jul 25 19:16:56.541251 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:57.201744 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-120d0edb-647b-480b-8e21-4ebf7e0710b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:57.226096 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-120d0edb-647b-480b-8e21-4ebf7e0710b9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.534649 Jul 25 19:16:57.226668 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Jul 25 19:16:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:16:58.434032 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:58.435157 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002141 Jul 25 19:16:58.435611 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:16:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:59.169322 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-71ca0bba-a957-4438-a9ce-f224ccf9629a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:59.192945 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-71ca0bba-a957-4438-a9ce-f224ccf9629a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.610309 Jul 25 19:16:59.193505 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Jul 25 19:16:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:17:00.305830 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:00.306884 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002310 Jul 25 19:17:00.307301 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:17:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:17:01.013605 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-13caf715-b129-45c0-9cf3-692b3ea3d75b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:17:01.036527 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-13caf715-b129-45c0-9cf3-692b3ea3d75b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.566289 Jul 25 19:17:01.037213 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Jul 25 19:17:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:17:02.213747 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:02.214940 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Jul 25 19:17:02.215766 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:17:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:17:02.870808 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-a2b8f437-a49c-4bc6-89b1-1236b3415c9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:17:02.892861 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-a2b8f437-a49c-4bc6-89b1-1236b3415c9d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.519538 Jul 25 19:17:02.893431 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Jul 25 19:17:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:17:04.051417 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:04.052555 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Jul 25 19:17:04.053101 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:17:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:17:04.805815 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-c7ebdf07-1de4-41a6-a28a-5784191bb990 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:04.830589 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-c7ebdf07-1de4-41a6-a28a-5784191bb990 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.602498 Jul 25 19:17:04.831179 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Mon Jul 25 19:17:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:18:07.233524 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:07.235253 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1caa303e-9728-4be5-b005-7b5bd7a102e2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002412 Jul 25 19:18:07.236045 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Mon Jul 25 19:18:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:18:07.250509 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:07.812681 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-84e3256d-1549-47c4-9d0c-5ab4b1fc8285 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:07.841132 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-84e3256d-1549-47c4-9d0c-5ab4b1fc8285 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.593360 Jul 25 19:18:07.841809 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Mon Jul 25 19:18:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:07.864495 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=14 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:07.868662 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-4f85c979-fc09-4f26-9a6e-9f025bee720e admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:07.877519 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-4f85c979-fc09-4f26-9a6e-9f025bee720e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014503 Jul 25 19:18:07.878101 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Mon Jul 25 19:18:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:18:07.892589 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-d018ab36-dc35-4253-9cd7-1ba9a379ea62 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:07.904015 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-d018ab36-dc35-4253-9cd7-1ba9a379ea62 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015870 Jul 25 19:18:07.904597 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Mon Jul 25 19:18:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:18:07.919888 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e080e56f-9b64-4770-93a3-fdd8c20d41e6 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:07.928597 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e080e56f-9b64-4770-93a3-fdd8c20d41e6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014439 Jul 25 19:18:07.929173 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Mon Jul 25 19:18:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:18:07.948610 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-646ea02a-79e5-43b5-b10b-92c8aff904b2 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:07.957255 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-646ea02a-79e5-43b5-b10b-92c8aff904b2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013310 Jul 25 19:18:07.957825 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Mon Jul 25 19:18:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:22:04.852103 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e080e56f-9b64-4770-93a3-fdd8c20d41e6 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:22:04.853112 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e080e56f-9b64-4770-93a3-fdd8c20d41e6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 25 19:22:04.853503 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:22:04.997724 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_api:SELECT=6 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:05.162057 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-766a4630-19ce-4dc9-b044-18cd8b8ed2da admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:22:05.164820 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:22:05.164820 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: warnings.warn(msg) Jul 25 19:22:05.166197 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-766a4630-19ce-4dc9-b044-18cd8b8ed2da admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:22:05.166654 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-766a4630-19ce-4dc9-b044-18cd8b8ed2da admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:22:05.167488 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-766a4630-19ce-4dc9-b044-18cd8b8ed2da admin admin] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:22:05.168008 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-766a4630-19ce-4dc9-b044-18cd8b8ed2da admin admin] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:22:05.205009 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-766a4630-19ce-4dc9-b044-18cd8b8ed2da admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208704 Jul 25 19:22:05.205598 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Jul 25 19:22:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:22:06.080033 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e080e56f-9b64-4770-93a3-fdd8c20d41e6 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:22:06.081873 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e080e56f-9b64-4770-93a3-fdd8c20d41e6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003337 Jul 25 19:22:06.082839 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:22:06.331152 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-32101f15-08db-49ad-a7f1-a7b48015426a admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:22:06.333614 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:22:06.333614 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: warnings.warn(msg) Jul 25 19:22:06.334921 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-32101f15-08db-49ad-a7f1-a7b48015426a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:22:06.335372 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-32101f15-08db-49ad-a7f1-a7b48015426a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:22:06.336198 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-32101f15-08db-49ad-a7f1-a7b48015426a admin admin] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:22:06.336634 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-32101f15-08db-49ad-a7f1-a7b48015426a admin admin] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:22:06.357341 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-32101f15-08db-49ad-a7f1-a7b48015426a admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082818 Jul 25 19:22:06.357940 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Jul 25 19:22:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:22:17.725695 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e080e56f-9b64-4770-93a3-fdd8c20d41e6 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:22:17.726923 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e080e56f-9b64-4770-93a3-fdd8c20d41e6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001693 Jul 25 19:22:17.727463 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:22:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:22:17.874631 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_cell0:SELECT=4 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:17.876008 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_cell1:SELECT=4 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:17.876934 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG dbcounter [-] [103336] Writing DB stats nova_api:SELECT=8 {{(pid=103336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:17.931183 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-69dc0fd3-031a-400b-8d5c-25684e194d98 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:22:17.933988 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:22:17.933988 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: warnings.warn(msg) Jul 25 19:22:17.935339 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-69dc0fd3-031a-400b-8d5c-25684e194d98 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:22:17.935818 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-69dc0fd3-031a-400b-8d5c-25684e194d98 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:22:17.936666 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-69dc0fd3-031a-400b-8d5c-25684e194d98 admin admin] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:22:17.937095 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-69dc0fd3-031a-400b-8d5c-25684e194d98 admin admin] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:22:17.965387 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-69dc0fd3-031a-400b-8d5c-25684e194d98 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095331 Jul 25 19:22:17.965983 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Jul 25 19:22:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:22:18.901642 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e080e56f-9b64-4770-93a3-fdd8c20d41e6 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:22:18.902644 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e080e56f-9b64-4770-93a3-fdd8c20d41e6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 25 19:22:18.903055 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Jul 25 19:22:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:22:19.103858 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG nova.api.openstack.wsgi [None req-a25684d0-cb5b-48a5-ac36-8bb02010b3f9 admin admin] Calling method '>' {{(pid=103336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:22:19.106359 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:22:19.106359 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: warnings.warn(msg) Jul 25 19:22:19.107651 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-a25684d0-cb5b-48a5-ac36-8bb02010b3f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:22:19.108085 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-a25684d0-cb5b-48a5-ac36-8bb02010b3f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:22:19.108871 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-a25684d0-cb5b-48a5-ac36-8bb02010b3f9 admin admin] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:22:19.109285 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: DEBUG oslo_concurrency.lockutils [None req-a25684d0-cb5b-48a5-ac36-8bb02010b3f9 admin admin] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:22:19.133018 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: INFO nova.api.openstack.requestlog [None req-a25684d0-cb5b-48a5-ac36-8bb02010b3f9 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087544 Jul 25 19:22:19.133591 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: [pid: 103336|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Jul 25 19:22:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:23:26.750841 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: Mon Jul 25 19:23:26 2022 - graceful shutdown triggered... Jul 25 19:23:26.751673 dv-cinder-850939-1-iscsi devstack@n-api.service[103336]: Gracefully killing worker 1 (pid: 103336)... Jul 25 19:23:26.751139 dv-cinder-850939-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 19:23:26.752885 dv-cinder-850939-1-iscsi devstack@n-api.service[103337]: Gracefully killing worker 2 (pid: 103337)... Jul 25 19:23:27.751948 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: worker 1 buried after 1 seconds Jul 25 19:23:27.752705 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: worker 2 buried after 1 seconds Jul 25 19:23:27.752705 dv-cinder-850939-1-iscsi devstack@n-api.service[103335]: goodbye to uWSGI. Jul 25 19:23:27.754007 dv-cinder-850939-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 25 19:23:27.754815 dv-cinder-850939-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 19:23:27.758801 dv-cinder-850939-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 19:23:27.775602 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 19:23:27.778926 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 19:23:27 2022] *** Jul 25 19:23:27.778926 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 19:23:27.778926 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 19:23:27.778926 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: nodename: dv-cinder-850939-1-iscsi Jul 25 19:23:27.778926 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: machine: x86_64 Jul 25 19:23:27.778926 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: clock source: unix Jul 25 19:23:27.778926 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: pcre jit disabled Jul 25 19:23:27.778926 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: detected number of CPU cores: 4 Jul 25 19:23:27.778926 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: current working directory: / Jul 25 19:23:27.778926 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: detected binary path: /usr/bin/uwsgi-core Jul 25 19:23:27.780717 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: your processes number limit is 47680 Jul 25 19:23:27.780717 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: your memory page size is 4096 bytes Jul 25 19:23:27.780717 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: detected max file descriptor number: 2048 Jul 25 19:23:27.780717 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: lock engine: pthread robust mutexes Jul 25 19:23:27.780717 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: thunder lock: enabled Jul 25 19:23:27.780717 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 19:23:27.780717 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 19:23:27.831571 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: Python main interpreter initialized at 0x5571696069c0 Jul 25 19:23:27.831571 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: python threads support enabled Jul 25 19:23:27.831571 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: your server socket listen backlog is limited to 100 connections Jul 25 19:23:27.831571 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: your mercy for graceful operations on workers is 90 seconds Jul 25 19:23:27.832105 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 19:23:27.832105 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: *** Operational MODE: preforking *** Jul 25 19:23:27.832599 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: *** uWSGI is running in multiple interpreter mode *** Jul 25 19:23:27.832599 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: spawned uWSGI master process (pid: 117933) Jul 25 19:23:27.832608 dv-cinder-850939-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 19:23:27.834992 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: spawned uWSGI worker 1 (pid: 117951, cores: 1) Jul 25 19:23:27.834992 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: spawned uWSGI worker 2 (pid: 117952, cores: 1) Jul 25 19:23:27.834992 dv-cinder-850939-1-iscsi devstack@n-api.service[117933]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 19:23:28.742705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 19:23:28.965979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 19:23:30.094953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:23:30.094953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: from cryptography.utils import int_from_bytes Jul 25 19:23:30.096061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:23:30.096061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: from cryptography.utils import int_from_bytes Jul 25 19:23:30.309043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:23:30.309043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: from cryptography.utils import int_from_bytes Jul 25 19:23:30.309990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:23:30.309990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: from cryptography.utils import int_from_bytes Jul 25 19:23:33.032750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:23:33.033470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:23:33.033597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:23:33.034020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:23:33.034272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:23:33.034664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.035135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.035496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.035851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.036222 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.036520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.037011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.037433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.037707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.037981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.038309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.038645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-1-iscsi {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.038977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.039485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.039848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.040189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.040505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.040870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.041179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.041710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.043422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.044028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.044407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.044794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.045130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.045457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.045799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.046111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.046456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.046773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.047193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-1-iscsi {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.047556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.047900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.048178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.048635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.048987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.049290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.049601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.049915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.050156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.050483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.050814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.051137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.051465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.051805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.052118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.052434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.052758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.053243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.053736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.053997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.054313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.054650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.054979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.055312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.055649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.055865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.056157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.056487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.056804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.057120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.057434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.057748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.058062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.058377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.058696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.059088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.059359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.059751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.060170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.060802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.061394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.061748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.062194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.062642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.063143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.063543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.063945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.064282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.064619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.064939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.065442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.065761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.066094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.066442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.066790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.067020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.067333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.067674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.068003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.068318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.068632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.068945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.069252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.069565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.069881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.070193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.071000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.071000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.071329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.071469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.071739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.072188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.072723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.072890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.073153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.073712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.074079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.074374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.074708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.075027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.075340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.076284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.077415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.077415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.077762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.078023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.078293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.079191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.079191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.079630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.079630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.079944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.080229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.080544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.081108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.081465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.081774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.082098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.082536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.082870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.083576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.083904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.084232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.084556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.084896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.085234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.085715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.086061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.086458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.086796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.087241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.087639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.088106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.088462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.088758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.089141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.089709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.090042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.090482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.090860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.091254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.092287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.092680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.093233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.093563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.093994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.094463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.094654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.095012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.095337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.095847 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.096211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.096540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.096940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.097233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.097555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.097874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.098197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.098535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.098879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.099202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.100076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.100076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.100986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.100986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.100986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.101462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.101651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.101983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.102310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.102632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.102965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.103387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.104048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.104048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.104351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.104866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.104866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.105171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.105448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.105792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.106129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.106442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.107386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.107719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.107987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.108307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.108644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.108935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.109262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.109635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.109949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.110288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.110611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.110927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.111263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.111618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.111933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.112260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.112582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.112902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.113259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.113540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.113867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.114210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.114500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.115141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.115437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.115809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.116296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.116472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.116793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.117102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.117420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.117733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.118043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.118346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.118661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.118968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.119279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.119713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.119930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.120238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.120572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.120888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.121199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.121512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.121822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.122173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.123080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.123385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.123773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.124283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.124626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.125310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.125310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.125608 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.125916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.126186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.126526 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.126832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.127152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.128012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.128012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.128326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.128639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.128806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.129137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.129476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.129861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.130540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.130835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.131166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.131486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.131856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.132174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.132494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.133012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.133477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.133839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.134080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.134408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.134730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.135368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.135368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.135722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.136042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.136363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.136720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.137802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.137802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.137802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.138332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.138332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.138789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.139275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.139668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.140001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.140323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.140651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.140972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.141291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.141606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.141930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.142244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.142557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.142867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.143188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.143640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.143992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.144194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.144522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.149756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.149756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.149756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.149756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.149756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.149756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.149756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.149756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.153064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.153064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.153064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.153064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.153064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.153064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.153064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.153064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.154538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.154538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.154538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.154538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.154538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.154538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.154538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.154538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.155712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.155712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.155712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.155712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.155712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.155712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.155712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.155712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.156797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.156797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.156797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.156797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.157339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.157666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.158024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.158344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.158665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.159032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.162351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.162351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.162351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.162351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.162351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.162351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.162351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.162351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.169198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.169198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.169198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.169198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.169198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.169198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.169198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.169198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.171103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.171103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.171103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.171103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.171103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.171103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.171103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.171103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.174176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.174176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.174176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.174176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.174176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.174176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.174176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.174176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.176133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.176133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.181016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.181378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.181697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.182770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.182770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.183857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.184049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.184454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.185035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.186113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.186666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.187202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.187772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.188590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.189327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.190092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.190839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.191599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.192306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.193064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.193821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.194569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.196246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.196792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.197357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.197854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.198397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.198943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.199501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.200093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.201447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.201447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.201928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.202246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.202790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.203319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.204105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.204851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.205667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.206558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.207348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.208158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.208984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.209624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.209977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.210487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.211007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.211869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.212384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.212995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.213469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.213972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.214744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.215279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.215844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.216861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.217409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.217929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.218465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.219016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.219578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.220160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.220716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.221260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.221800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.222363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.222899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.223468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.224033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.224575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.225122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.225673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.226220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.226763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.227307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.227893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.228447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.228995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.229573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.230081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.230632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.231175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.231747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.232875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.233379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.233901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.234450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.235048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.235502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.236239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.236851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.237390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.237940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.238474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.239070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.239591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.240182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.240698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.241242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.241983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.242747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.243307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.244680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.244680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.245055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.245615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.246022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.246555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.247094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.248356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.248937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.249482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.250038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.250783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.251324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.251889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.252633 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.253177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.253719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.254283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.254850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.255550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.256161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.256675 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.257053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.257627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.258188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.258767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.259294 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.259863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.260420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.260978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.261526 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.262382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.262849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.263417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.263999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.264793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.265356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.265901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.266501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.266969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.267564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.268096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.268650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.269184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.269752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.270299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.270843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.271465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.272033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.272601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.273139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.273708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.274258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.274797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.275363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.275923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.276489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.277041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.277565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.278109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.278641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.279947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.280498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.281072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.281654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.282232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.282833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.283355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.283955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.284496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.285039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.285582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.286110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.286601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.287149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.287721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.288255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.288790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.289340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.289874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.290416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.290932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.291476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.292003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.292547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.293083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.293601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.294138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.295199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.295845 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.296621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.297446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.298217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.298774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.299493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.301305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.301305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.301305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.301696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.302084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.302631 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.303179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.303759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.304310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.304836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.305313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.305779 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.306398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.307366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.307943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.308489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.309031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.309556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.310654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.311204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.312027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.312581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.313124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.313642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.314193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.314742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.315303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.315919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.316487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.317048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.317609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.318162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.319745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.319745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.320009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.320452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.320992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.321532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.322105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.322651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.323217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.323818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.324339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.324877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.325439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.326682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.327261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.327899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.328453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.329003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.329562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.330117 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.331073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.333838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.333838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.333838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.333838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.333838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.334353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.334930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.335471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.336030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.336557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.337097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.337622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.338223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.338769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.339310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.340165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.340723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.342165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.342766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.343324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.343922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.344488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.345042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.345573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.346123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.346669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.347204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.347788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.348331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.348861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.349384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.349926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.350496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.351029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.351632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.352138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.352706 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.353246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.353781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.354308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.354855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.355393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.355954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.356485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.357569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.358205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.358751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.359223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.359716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.360258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.360806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.361349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.361962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.362542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.363087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.363659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.364201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.364898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.365455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.365995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.366527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.367128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.367699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.368691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.369260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.369809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.370384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.370950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.371474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.372034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.373135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.374256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.374256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.374741 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.375272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.375839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.376371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.376903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.377475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.378007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.378543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.379076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.380013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.381164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.381164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.381571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.381772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.382416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.383214 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.383893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.384099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.384645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.385188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.385737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.386283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.386843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.387564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.388666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.388968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.389491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.390539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.390895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.391377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.392147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.392621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.393275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.393833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.394399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.395102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.395800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.396299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.396907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.397471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.398069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.398596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.399120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.399693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.400249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.400865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.401394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.401915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.402459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.402980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.403545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.404593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.405122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.405680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.406206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.406711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.407230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.407787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.408308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.408830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.409435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.409964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.410495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.411030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.411598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.412128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.412718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.413297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.413840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.414391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.414943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.415502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.416071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.416641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.417205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.417772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.418323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.418923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.419577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.420190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.420705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.421251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.422154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.422501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.423082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.423698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.424240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.424813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.425371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.425938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.426501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.427055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.427664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.428220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.428762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.429315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.429865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.430415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.430976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.431551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.432115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.432648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.433205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.433786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.434361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.434910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.436052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.436689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.437307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.437802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.438408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.438976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.439570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.440127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.440670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.441099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:23:33.519033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:23:33.519943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:23:33.521316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:23:33.521316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:23:33.521763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:23:33.522377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.522705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.523273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.523861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.524420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.524955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.525534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.526063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.526625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.527062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.527630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.528192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-1-iscsi {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.529293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.529952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.530491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.531094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.531475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.531972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.532468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.533389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.533875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.534408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.534944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.535547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.536074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.536601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.537144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.537669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.538218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.538744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.539418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-1-iscsi {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.540014 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.540552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.541085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.541798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.542331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.542864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.543419 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.544020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.544785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.545198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.545755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.546308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.546867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.547404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.548004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.548563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.549097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.549619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.550157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.550600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.551143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.551746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.552311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.552883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.553324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.553767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.554322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.554884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.555438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.556017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.556564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.557106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.557579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.558046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.558543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.559042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.559568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.560629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.561510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.561701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.562229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.562559 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO dbcounter [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Registered counter for database nova_api Jul 25 19:23:33.562905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.563329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.563913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.564505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.565060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.565601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.566158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.566698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.567211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.567750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.569716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.569716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.569716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.570169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.570302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.570843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.571362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.571931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.572474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.573012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.573553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.574072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.574609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.575123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.576260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.576784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.577313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.577862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.578385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.578902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.579429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.580005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.580542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.581056 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.581574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.582081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.582619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.583190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.583741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.584257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.584810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.585334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.585868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.586405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.586938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.587463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.588049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.588566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.589096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.589902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.590421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.590943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.591882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.592779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.592779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.593182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.593701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.594247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.594778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.595314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.595864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.596346 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.596836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.597294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.598341 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:23:33.598568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.599053 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.599672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.600198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.600736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.601283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.601447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_db.sqlalchemy.engines [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:23:33.601824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.602353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.602913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.603456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.604020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.604562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.605107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.605669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.606256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.606909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.608053 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.608277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.608678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.609267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.609792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.610364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.610909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.611435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.612036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.613527 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.613527 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.614091 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.614325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.614556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writer thread running {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:23:33.614803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.615186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.615772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.616331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.617050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.617398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.617932 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.618437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.619034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.619714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.620175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.620552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.620975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.621384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.621781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.622190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.623134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.623976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.623976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.624388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.624769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.625150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.625531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.625918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.626361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.626798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.627241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.627774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.628830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.628830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.629098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.629584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.630093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.630552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.631005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.631452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.631955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.632433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.632880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.633334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.633802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.634248 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.634687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.635145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.635696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.636173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.636684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.637152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.637620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.638718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.639728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.639866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.640373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.640757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.641160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.641560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.641951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.642328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.642736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.643119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.643500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.643916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.644298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.644672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.645059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.645437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.645896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.646292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.646764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.647274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.647806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.648356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.648817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.649285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.649784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.650263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.650825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.651291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.651829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.652258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.652690 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.653119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.653543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.654058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.654528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.654985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.655411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.655865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.656365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.656937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.657329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.657886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.658379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.658868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.659275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.659702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.660206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.660588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.661125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.661584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.662041 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.662495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.662968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.663422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.663906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.664352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.664821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.665271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.665818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.666272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.666713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.667182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.667627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.668097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.668585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.669030 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.669525 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.670055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.670523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.670984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.671527 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.671971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.672393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.672827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.673259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.673686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.674112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.674535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.674964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.675438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.675898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.676313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.676812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.677331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.677829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.678550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.679379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.679580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.680094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.680614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.681096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.681709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.682097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.682520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.683026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.683450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.683914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.684345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.684783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.685746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.686187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.686635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.687111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.687609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.688125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.688550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.688984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.689414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.689844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.690267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.690710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.691196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.691737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.692125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.692488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.692861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.693240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.693969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.694415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.694808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.695241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.695683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.696119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.696484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.696887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.697358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.697739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.698185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.698575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.698973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.699371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.699773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.700154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.700532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.701677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.702209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.702450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.702837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.703217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.703654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.704038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.704431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.704817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.705219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.705605 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.705982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.706362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.706738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.707180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.707651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.708725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.708981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.709382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.709826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.710250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.710686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.711103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.711584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.712036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.712484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.712832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.713404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.713854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.714286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.714978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.715425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.715930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.716896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.717484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.718137 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.718535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.718972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.719465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.719964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.720399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.720869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.721315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.721759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.722144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.722637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.722967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.723232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.context [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ccbefd05-b701-4978-bc0c-e210af40d93d(cell1) {{(pid=117952) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 19:23:33.723488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.723950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.724371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.724790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.725235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.725659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.726078 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.726491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.726917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.727364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.727689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:33.727880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.728210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.728543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.728973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.729355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:33.729780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.730007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.730238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:33.730489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.730942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.731389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.732791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.733135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.733595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.733822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:33.734115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.734532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.734963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.735398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.735797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO dbcounter [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Registered counter for database nova_cell0 Jul 25 19:23:33.735971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.736341 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.736759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.737180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.737640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.738094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.738486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.738813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.739261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.739870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.740303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.740585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO dbcounter [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Registered counter for database nova_cell1 Jul 25 19:23:33.740859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.741295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.741716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.742142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.742564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.743705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.744363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.744841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.745194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.745649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.746074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.746584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.747075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.747689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.748112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.748559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.748984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.749419 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.749848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.750312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.750759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.751210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.751453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_db.sqlalchemy.engines [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:23:33.751795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.752238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.752660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.753169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.753597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.754020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.754466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.754967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.755337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_db.sqlalchemy.engines [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:23:33.755630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.755972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.756421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.756849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.757297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.757746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.758327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.758775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.759205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.759668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.760132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.760517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.760947 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.761374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.761795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.762347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.762778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.762949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writer thread running {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:23:33.764634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.764634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.765172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.765791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.766394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.766938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writer thread running {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:23:33.767040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.767479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.768068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.768614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.769171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.769704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.770370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.770994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.771568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.772116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.772826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.773364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.773927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.774625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.775057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.775776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.776303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.777026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.777608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.778180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.778719 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.780010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.780457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.781008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.781574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.782136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.782699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.783271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.784135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.784646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.785201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.785783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.786365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.786912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.787495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.788076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.788796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.789349 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.789914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.790458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.791019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.791608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.792171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.792724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.793269 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.793837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.794930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.795626 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.796189 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.796705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.797263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.797803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.798380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.798937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.799485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.800069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.800616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.801227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.801781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.802359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.802940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.803555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.804102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.804700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.805276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.805843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.806413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.806984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.807606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.808381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.808912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.809429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.810018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.811102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.811670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.812216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.812747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.813289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.813870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.814410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.814987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.815558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.816106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.816664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.817208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.817823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.818382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.818976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.819589 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.820162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.820745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.821302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.821875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.822441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.823003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.823586 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.824139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.824695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.825262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.826360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.826903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.827465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.828095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.828638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.829582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.830158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.830715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.831273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.831873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.832532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.832995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.833548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.834107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.834776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.835213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.835824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.836398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.836970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.837551 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.838130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.838698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.839253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.840178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.840799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.842000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.842469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.843042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.843659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.844230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.844786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.845345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.845908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.846473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.847031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.847605 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.848177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.848742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.849325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.849918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.850489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.851055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.851649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.852201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.853153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.853703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.854287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.854859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.855430 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.856019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.856592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.857236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.857832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.858364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.858920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.859470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.860039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.860614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.861173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.861716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.862289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.862822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.863837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.864435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.864994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.865572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.866145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.866732 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.867307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.867897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.868425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.868962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.869494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.870034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.870584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.871124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.871791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.872471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.872916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.873479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.874017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.874596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.876271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.876822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.877351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.877910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.878454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.878995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.879561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.880104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.880671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.881216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.881766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.882319 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.882874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.883419 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.884052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.884821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.885407 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.885937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.886501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.887211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.887798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.888926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.890344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.890575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.891183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.891783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.892800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.893368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.893942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.894589 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.895182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.895764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.896311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.896856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.897431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.897989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.898535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.899088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.899680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.900239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.900806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.901352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.901908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.902471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.903038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.903644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.904785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.905320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.905864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.906465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.907028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.907608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.908170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.908738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.909295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.909834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.910420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.910975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.911790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.912381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.912931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.913467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.914219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.914777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.915344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.915947 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.916496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.917084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.917656 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.918251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.918975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.919636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.920244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.921016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.921613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.922190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.922726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.923452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.924022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.924582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.925160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.925709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.926251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.926782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.927321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.927915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.928472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.929017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.929554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.930106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.930655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.931200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.931781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.932321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.932894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.933510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.934104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.934680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.935275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.935846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.936389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.936931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.937535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.938122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.938675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.939263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.939896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.940442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.941130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.941542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.942117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.942688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.943237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.943893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.944491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.945088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.945693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.946305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.946886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.947426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.948046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.948658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.949245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.949869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.950488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.951635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.952211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.952744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.953337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.953871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.954556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.954979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.955553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.956118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.956701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.957258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.957819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.958416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.959021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.959635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.960000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.960334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.960679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.961027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.961396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.961728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.962095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.962439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.962770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.963268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.963427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:23:33.963668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:23:34.090203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO dbcounter [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Registered counter for database nova_cell0 Jul 25 19:23:34.102457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_db.sqlalchemy.engines [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:23:34.112362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writer thread running {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:23:34.128858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Registered counter for database nova_api Jul 25 19:23:34.151642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:23:34.160680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:23:34.225402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.context [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ccbefd05-b701-4978-bc0c-e210af40d93d(cell1) {{(pid=117951) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 19:23:34.229641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:34.231350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:34.232765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:34.235404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:34.237552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Registered counter for database nova_cell0 Jul 25 19:23:34.242365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Registered counter for database nova_cell1 Jul 25 19:23:34.260156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:23:34.263177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:23:34.272016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:23:34.273816 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:23:34.558058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: WARNING keystonemiddleware.auth_token [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:23:34.566915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: WARNING keystonemiddleware.auth_token [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:23:34.567777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Registered counter for database nova_cell0 Jul 25 19:23:34.579776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:23:34.587907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:23:34.985248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: WARNING keystonemiddleware.auth_token [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:23:34.992611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: WARNING keystonemiddleware.auth_token [None req-12fafb2b-5ea4-4d2f-afcf-7efab129d8f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:23:35.000307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5571696069c0 pid: 117952 (default app) Jul 25 19:23:35.018250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:23:35.031276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:23:35.548911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:23:35.555179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-0cb223e5-9346-4367-bfe0-d4634f7f6950 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:23:35.561909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x5571696069c0 pid: 117951 (default app) Jul 25 19:24:28.712188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=3 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:28.714593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=3 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:28.716231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=3 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:28.717708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=3 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:31.139671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-717d3e0f-c964-4226-9c17-30ea5d5ef44a tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] Action: 'create', calling method: .version_select at 0x7feb09c414c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1502391564", "metadata": {"Type": "work"}}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:24:32.388411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a628f41c-e2ea-42a4-9436-5331d2cb88b5 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09ca5f70>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:32.454543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:32.456715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:32.459358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:32.462088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:33.770957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a628f41c-e2ea-42a4-9436-5331d2cb88b5 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c863a0f1-8956-424a-9279-c28a5ba64ed3" status: 200 len: 351 microversion: 2.1 time: 2.134216 Jul 25 19:24:33.781196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1/1] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 19:24:31 2022] GET /compute/v2.1/os-volumes/c863a0f1-8956-424a-9279-c28a5ba64ed3 => generated 351 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:33.867866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-717d3e0f-c964-4226-9c17-30ea5d5ef44a tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 5.169562 Jul 25 19:24:33.868625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1/2] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Jul 25 19:24:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 5172 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 19:24:33.898889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-465a51c4-7337-4f49-a577-6788a7d0869e tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] Calling method '.version_select at 0x7feb09aa5310>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:34.511490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-465a51c4-7337-4f49-a577-6788a7d0869e tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1" status: 200 len: 354 microversion: 2.1 time: 0.619830 Jul 25 19:24:34.524186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 19:24:33 2022] GET /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1 => generated 354 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:34.552860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b5075698-345e-4814-9888-ca5cea5d305e tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] Calling method '.version_select at 0x7feb09a953a0>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:34.837290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b5075698-345e-4814-9888-ca5cea5d305e tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1" status: 200 len: 354 microversion: 2.1 time: 0.294750 Jul 25 19:24:34.854456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 19:24:34 2022] GET /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1 => generated 354 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:34.881516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7ec77a30-2ae7-4336-acdc-6a43d1d4af06 tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] Calling method '.version_select at 0x7feb09aa5550>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:35.166873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7ec77a30-2ae7-4336-acdc-6a43d1d4af06 tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1" status: 202 len: 0 microversion: 2.1 time: 0.301763 Jul 25 19:24:35.176627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Jul 25 19:24:34 2022] DELETE /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:24:35.183600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b38ee6cc-6e5b-4752-877b-a95592afbf9e tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] Calling method '.version_select at 0x7feb09a95a60>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:35.632890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b38ee6cc-6e5b-4752-877b-a95592afbf9e tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1" status: 200 len: 353 microversion: 2.1 time: 0.456700 Jul 25 19:24:35.634748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 3/6] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 19:24:35 2022] GET /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1 => generated 353 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:35.922295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-47ddecdb-e855-4f02-8c33-ce807042b604 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09aa5af0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:36.075815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-47ddecdb-e855-4f02-8c33-ce807042b604 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5215e777-027b-4d6a-b118-25ea2ac1485a" status: 200 len: 351 microversion: 2.1 time: 0.161590 Jul 25 19:24:36.094069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 19:24:35 2022] GET /compute/v2.1/os-volumes/5215e777-027b-4d6a-b118-25ea2ac1485a => generated 351 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:36.661761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf76d5da-c0bf-485b-8c99-9fa21c742b67 tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] Calling method '.version_select at 0x7feb09aac160>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:36.782215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-cf76d5da-c0bf-485b-8c99-9fa21c742b67 tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] HTTP exception thrown: Volume 49c28d56-603a-45ed-bc6d-3d969a8171e1 could not be found. Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf76d5da-c0bf-485b-8c99-9fa21c742b67 tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] Request method failure captured: Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1 HTTP/1.1 Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u3si6oOWu2MiB1OpdIo3uSw5zEhSbiLW5-8zPjcOJNtd5EfjE3jGdV8eIwSxm_OK6qCjPaDF-eWDXVx6HC9IXUJewxxDKD6U8ixfXPcB571-kYWjD6y5FUlZA0Lm2Su2mEyNDh5MKxI6ftT-pSThcXe56g8sr_n0Y_Fw7ypKt0oPzk Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 2c772444cd3a43aba3efd52a54979d39 Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-VolumesGetTestJSON-1200099292 Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 19:24:36.789649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c772444cd3a43aba3efd52a54979d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c772444cd3a43aba3efd52a54979d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c772444cd3a43aba3efd52a54979d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c772444cd3a43aba3efd52a54979d39", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-VolumesGetTestJSON-1200099292 Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 2c772444cd3a43aba3efd52a54979d39 Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-VolumesGetTestJSON-1200099292 Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-VolumesGetTestJSON-1200099292-project Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 2e1f8b7984434ea1a0883feccec20d18 Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-VolumesGetTestJSON-1200099292-project Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Volume 49c28d56-603a-45ed-bc6d-3d969a8171e1 could not be found. Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '49c28d56-603a-45ed-bc6d-3d969a8171e1'} Jul 25 19:24:36.792373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49c28d56-603a-45ed-bc6d-3d969a8171e1 could not be found. (HTTP 404) (Request-ID: req-333cf8da-3486-4be6-85d2-09ac7af951aa) Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:36.793636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:24:36.795573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49c28d56-603a-45ed-bc6d-3d969a8171e1 could not be found. Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 19:24:36.800266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49c28d56-603a-45ed-bc6d-3d969a8171e1 could not be found. Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49c28d56-603a-45ed-bc6d-3d969a8171e1 could not be found. Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf76d5da-c0bf-485b-8c99-9fa21c742b67 tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] Returning 404 to user: Volume 49c28d56-603a-45ed-bc6d-3d969a8171e1 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cf76d5da-c0bf-485b-8c99-9fa21c742b67 tempest-VolumesGetTestJSON-1200099292 tempest-VolumesGetTestJSON-1200099292-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1" status: 404 len: 109 microversion: 2.1 time: 0.138142 Jul 25 19:24:36.805605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 19:24:36 2022] GET /compute/v2.1/os-volumes/49c28d56-603a-45ed-bc6d-3d969a8171e1 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 19:24:38.645052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5d40324a-a0e1-4396-91c8-eb84888acd21 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09ac3160>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:38.820613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5d40324a-a0e1-4396-91c8-eb84888acd21 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/9d50a646-fba8-49cd-81e9-6ce2b5dcf891" status: 200 len: 350 microversion: 2.1 time: 0.187059 Jul 25 19:24:38.822437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 5/9] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 19:24:38 2022] GET /compute/v2.1/os-volumes/9d50a646-fba8-49cd-81e9-6ce2b5dcf891 => generated 350 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:38.852065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-80be3e13-2467-44d5-8047-2e5c09be7b2c tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09aaca60>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:39.199905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-80be3e13-2467-44d5-8047-2e5c09be7b2c tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.358202 Jul 25 19:24:39.200927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 5/10] 10.222.0.18 () {58 vars in 1134 bytes} [Mon Jul 25 19:24:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:39.226725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc2ee313-079a-4948-a0ad-08a9679e5d2f tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09aa5e50>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:39.509362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc2ee313-079a-4948-a0ad-08a9679e5d2f tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.294825 Jul 25 19:24:39.512398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 6/11] 10.222.0.18 () {58 vars in 1149 bytes} [Mon Jul 25 19:24:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:39.536598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cdfe43fb-ad83-40bb-8e18-7aea1bf9dc59 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09aac5e0>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:39.894963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cdfe43fb-ad83-40bb-8e18-7aea1bf9dc59 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.364964 Jul 25 19:24:39.896529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1134 bytes} [Mon Jul 25 19:24:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:39.923869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ab24278-2265-468e-bc77-152d1bd6c24d tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09aa5940>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:40.190544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ab24278-2265-468e-bc77-152d1bd6c24d tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.275673 Jul 25 19:24:40.191284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1167 bytes} [Mon Jul 25 19:24:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:40.217276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b62d7847-cc3f-464f-9e38-dd6dd50351cf tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09a164c0>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:40.479026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b62d7847-cc3f-464f-9e38-dd6dd50351cf tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.269677 Jul 25 19:24:40.479918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 7/14] 10.222.0.18 () {58 vars in 1170 bytes} [Mon Jul 25 19:24:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:40.502391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0eb96571-156e-48ac-9c69-ebb381eb0af5 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09ac3700>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:40.965944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0eb96571-156e-48ac-9c69-ebb381eb0af5 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.463033 Jul 25 19:24:40.968084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 8/15] 10.222.0.18 () {58 vars in 1155 bytes} [Mon Jul 25 19:24:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:24:40.987749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-395c7fbe-82d9-42de-9399-f87186195ead tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09aaf8b0>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:41.221771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-395c7fbe-82d9-42de-9399-f87186195ead tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.239527 Jul 25 19:24:41.225183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1188 bytes} [Mon Jul 25 19:24:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:41.244289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd3eaf0f-cd02-44ac-8367-fc4c4215f5f4 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] Calling method '.version_select at 0x7feb09a5e940>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:41.666147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd3eaf0f-cd02-44ac-8367-fc4c4215f5f4 tempest-VolumesTestJSON-718747441 tempest-VolumesTestJSON-718747441-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.428328 Jul 25 19:24:41.686214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 9/17] 10.222.0.18 () {58 vars in 1155 bytes} [Mon Jul 25 19:24:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:45.075828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-755011c2-2f80-4952-9ded-8328880f89e8 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Action: 'create', calling method: .version_select at 0x7feb0a426550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1810762973", "metadata": {"Type": "work"}}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-755011c2-2f80-4952-9ded-8328880f89e8 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Request method failure captured: Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 122 Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u38pBvBtsaG-mGNyID5vuggbzQasO8MXfYlKIpuGVuQ58U_X4BKDNX2dX657sZQjsTRkJXtcf2HJgRrXc40LcQkFAVcHs1joQRp5epBQiLYREhJYWxqjgOQSKckU368QZlBTO5wZZYonsGz4BpsAjhfeG6dZiYuY3nXG4Nhox4Wk9A Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:24:45.110439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2e292f6f95e44b078843645b4c30ce4d", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: ac0fc5a408c74751b9db2ec078647b4d Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1810762973", "metadata": {"Type": "work"}}} Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: Jul 25 19:24:45.111674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1810762973', 'metadata': {'Type': 'work'}}}} Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise error Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:24:45.112457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 19:24:45.113647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 19:24:45.116762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 19:24:45.116762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.116762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-755011c2-2f80-4952-9ded-8328880f89e8 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:24:45.125260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-755011c2-2f80-4952-9ded-8328880f89e8 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.249457 Jul 25 19:24:45.129772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 10/18] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Jul 25 19:24:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:24:45.166133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-861a6b2c-6e7e-4dd1-9b39-f47a2dc6f76b tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Action: 'create', calling method: .version_select at 0x7feb09aa5ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-49351481", "metadata": {"Type": "work"}}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-861a6b2c-6e7e-4dd1-9b39-f47a2dc6f76b tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Request method failure captured: Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 118 Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u38pBvBtsaG-mGNyID5vuggbzQasO8MXfYlKIpuGVuQ58U_X4BKDNX2dX657sZQjsTRkJXtcf2HJgRrXc40LcQkFAVcHs1joQRp5epBQiLYREhJYWxqjgOQSKckU368QZlBTO5wZZYonsGz4BpsAjhfeG6dZiYuY3nXG4Nhox4Wk9A Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:24:45.193171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2e292f6f95e44b078843645b4c30ce4d", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: ac0fc5a408c74751b9db2ec078647b4d Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-49351481", "metadata": {"Type": "work"}}} Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: Jul 25 19:24:45.195450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-49351481', 'metadata': {'Type': 'work'}}}} Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise error Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi '0' Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:24:45.196702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 19:24:45.202738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 19:24:45.207567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 19:24:45.207567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.207567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-861a6b2c-6e7e-4dd1-9b39-f47a2dc6f76b tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:24:45.207567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-861a6b2c-6e7e-4dd1-9b39-f47a2dc6f76b tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.060871 Jul 25 19:24:45.207567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 11/19] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Jul 25 19:24:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:24:45.231847 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8cc251ad-1cd0-4256-a1dd-9f33d66ca237 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Action: 'create', calling method: .version_select at 0x7feb09ac3790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-84337621", "metadata": {"Type": "work"}}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8cc251ad-1cd0-4256-a1dd-9f33d66ca237 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Request method failure captured: Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 117 Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u38pBvBtsaG-mGNyID5vuggbzQasO8MXfYlKIpuGVuQ58U_X4BKDNX2dX657sZQjsTRkJXtcf2HJgRrXc40LcQkFAVcHs1joQRp5epBQiLYREhJYWxqjgOQSKckU368QZlBTO5wZZYonsGz4BpsAjhfeG6dZiYuY3nXG4Nhox4Wk9A Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:24:45.253503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2e292f6f95e44b078843645b4c30ce4d", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: ac0fc5a408c74751b9db2ec078647b4d Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-84337621", "metadata": {"Type": "work"}}} Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: Jul 25 19:24:45.255432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-84337621', 'metadata': {'Type': 'work'}}}} Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise error Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi '' Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:24:45.258273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 19:24:45.269097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 19:24:45.277696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 19:24:45.277696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.277696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8cc251ad-1cd0-4256-a1dd-9f33d66ca237 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:24:45.277696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8cc251ad-1cd0-4256-a1dd-9f33d66ca237 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.038773 Jul 25 19:24:45.277696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 12/20] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Jul 25 19:24:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:24:45.283795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-625e8963-4563-4c07-8346-94b1955405fe tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Calling method '.version_select at 0x7feb09ac30d0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:45.291137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6295f1c6-f731-43e5-8eb2-a8b329accf0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Action: 'create', calling method: .version_select at 0x7feb09c41550>, body: {"keypair": {"name": "tempest-keypair-1287126177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDNVy8iosxGFhYtO9iuwARmwqxPzOpmNTaRq0tAXxl4/zi+eptA998XTdVR10IAVTvZR1zW164mRDvZpqiUIFubtjmply1kByB2pM8pPEUCD8Rm7yoOfWGSLB1Bb+iK3g=="}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:24:45.394679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-625e8963-4563-4c07-8346-94b1955405fe tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] HTTP exception thrown: Volume tempest-invalid-1647258603 could not be found. Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-625e8963-4563-4c07-8346-94b1955405fe tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Request method failure captured: Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1647258603 HTTP/1.1 Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u38pBvBtsaG-mGNyID5vuggbzQasO8MXfYlKIpuGVuQ58U_X4BKDNX2dX657sZQjsTRkJXtcf2HJgRrXc40LcQkFAVcHs1joQRp5epBQiLYREhJYWxqjgOQSKckU368QZlBTO5wZZYonsGz4BpsAjhfeG6dZiYuY3nXG4Nhox4Wk9A Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:24:45.407025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2e292f6f95e44b078843645b4c30ce4d", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: ac0fc5a408c74751b9db2ec078647b4d Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Volume tempest-invalid-1647258603 could not be found. Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'tempest-invalid-1647258603'} Jul 25 19:24:45.409608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1647258603 could not be found. (HTTP 404) (Request-ID: req-d6df6dcb-82f7-4f5e-882c-3884412bf7f6) Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.412645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 19:24:45.416138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1647258603 could not be found. Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:24:45.422709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1647258603 could not be found. Jul 25 19:24:45.426224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.426224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.426224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.426224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.426224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.426224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.426224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:24:45.426224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:24:45.426224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1647258603 could not be found. Jul 25 19:24:45.426224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.429869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-6295f1c6-f731-43e5-8eb2-a8b329accf0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Getting quotas for project 5ef063ca1eb846d78ff8901d2a3fc0a3. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:24:45.432112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-625e8963-4563-4c07-8346-94b1955405fe tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Returning 404 to user: Volume tempest-invalid-1647258603 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:24:45.435563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-625e8963-4563-4c07-8346-94b1955405fe tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1647258603" status: 404 len: 99 microversion: 2.1 time: 0.165540 Jul 25 19:24:45.439411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 13/21] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Jul 25 19:24:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1647258603 => generated 99 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 19:24:45.449221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-6295f1c6-f731-43e5-8eb2-a8b329accf0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Getting quotas for user ac2e584f88cd46f280b7fe04aa1382fd and project 5ef063ca1eb846d78ff8901d2a3fc0a3. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:24:45.477589 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee9c63db-41d6-4a35-8137-531334926d5b tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.026093 Jul 25 19:24:45.480546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 14/22] 10.222.0.18 () {58 vars in 1140 bytes} [Mon Jul 25 19:24:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 19:24:45.508202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ce360ae4-4fa9-4749-9a74-646f1c7bb258 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019619 Jul 25 19:24:45.512533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 15/23] 10.222.0.18 () {58 vars in 1137 bytes} [Mon Jul 25 19:24:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 19:24:45.550801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-79e0346a-60aa-4e5c-b4c3-545d7ec8c1ac tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Calling method '.version_select at 0x7feb09a25b80>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:45.565031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6295f1c6-f731-43e5-8eb2-a8b329accf0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.126916 Jul 25 19:24:45.575151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 9/24] 10.222.0.18 () {62 vars in 1200 bytes} [Mon Jul 25 19:24:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 19:24:45.637896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-79e0346a-60aa-4e5c-b4c3-545d7ec8c1ac tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] HTTP exception thrown: Volume b951fbdb-2a1a-44bc-a2c5-167df0a52467 could not be found. Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-79e0346a-60aa-4e5c-b4c3-545d7ec8c1ac tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Request method failure captured: Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/os-volumes/b951fbdb-2a1a-44bc-a2c5-167df0a52467 HTTP/1.1 Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u38pBvBtsaG-mGNyID5vuggbzQasO8MXfYlKIpuGVuQ58U_X4BKDNX2dX657sZQjsTRkJXtcf2HJgRrXc40LcQkFAVcHs1joQRp5epBQiLYREhJYWxqjgOQSKckU368QZlBTO5wZZYonsGz4BpsAjhfeG6dZiYuY3nXG4Nhox4Wk9A Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:24:45.640648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2e292f6f95e44b078843645b4c30ce4d", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: ac0fc5a408c74751b9db2ec078647b4d Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Volume b951fbdb-2a1a-44bc-a2c5-167df0a52467 could not be found. Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'b951fbdb-2a1a-44bc-a2c5-167df0a52467'} Jul 25 19:24:45.641848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b951fbdb-2a1a-44bc-a2c5-167df0a52467 could not be found. (HTTP 404) (Request-ID: req-20deda95-b8c7-4dee-a7fc-53e45e6f595d) Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 19:24:45.643458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b951fbdb-2a1a-44bc-a2c5-167df0a52467 could not be found. Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 19:24:45.646563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b951fbdb-2a1a-44bc-a2c5-167df0a52467 could not be found. Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b951fbdb-2a1a-44bc-a2c5-167df0a52467 could not be found. Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-79e0346a-60aa-4e5c-b4c3-545d7ec8c1ac tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Returning 404 to user: Volume b951fbdb-2a1a-44bc-a2c5-167df0a52467 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:24:45.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-79e0346a-60aa-4e5c-b4c3-545d7ec8c1ac tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/b951fbdb-2a1a-44bc-a2c5-167df0a52467" status: 404 len: 109 microversion: 2.1 time: 0.122560 Jul 25 19:24:45.655923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9831282b-009f-4fdd-885d-2ccab8d57bd3 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Calling method '.version_select at 0x7feb099f5790>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:45.658259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 16/25] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Jul 25 19:24:45 2022] DELETE /compute/v2.1/os-volumes/b951fbdb-2a1a-44bc-a2c5-167df0a52467 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:24:45.758828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-9831282b-009f-4fdd-885d-2ccab8d57bd3 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] HTTP exception thrown: Volume 8109869c-09fe-43ea-a2be-91c8030996b2 could not be found. Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9831282b-009f-4fdd-885d-2ccab8d57bd3 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Request method failure captured: Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/os-volumes/8109869c-09fe-43ea-a2be-91c8030996b2 HTTP/1.1 Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u38pBvBtsaG-mGNyID5vuggbzQasO8MXfYlKIpuGVuQ58U_X4BKDNX2dX657sZQjsTRkJXtcf2HJgRrXc40LcQkFAVcHs1joQRp5epBQiLYREhJYWxqjgOQSKckU368QZlBTO5wZZYonsGz4BpsAjhfeG6dZiYuY3nXG4Nhox4Wk9A Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 19:24:45.761349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2e292f6f95e44b078843645b4c30ce4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2e292f6f95e44b078843645b4c30ce4d", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 2e292f6f95e44b078843645b4c30ce4d Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-VolumesNegativeTest-2069097487 Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: ac0fc5a408c74751b9db2ec078647b4d Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-VolumesNegativeTest-2069097487-project Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Volume 8109869c-09fe-43ea-a2be-91c8030996b2 could not be found. Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '8109869c-09fe-43ea-a2be-91c8030996b2'} Jul 25 19:24:45.763068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8109869c-09fe-43ea-a2be-91c8030996b2 could not be found. (HTTP 404) (Request-ID: req-30693d8a-2f4b-43f8-a842-61bf86f645e8) Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.764116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:24:45.765139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8109869c-09fe-43ea-a2be-91c8030996b2 could not be found. Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 19:24:45.766150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8109869c-09fe-43ea-a2be-91c8030996b2 could not be found. Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8109869c-09fe-43ea-a2be-91c8030996b2 could not be found. Jul 25 19:24:45.767156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:24:45.770218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9831282b-009f-4fdd-885d-2ccab8d57bd3 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] Returning 404 to user: Volume 8109869c-09fe-43ea-a2be-91c8030996b2 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:24:45.772979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9831282b-009f-4fdd-885d-2ccab8d57bd3 tempest-VolumesNegativeTest-2069097487 tempest-VolumesNegativeTest-2069097487-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8109869c-09fe-43ea-a2be-91c8030996b2" status: 404 len: 109 microversion: 2.1 time: 0.123313 Jul 25 19:24:45.774780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 10/26] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 19:24:45 2022] GET /compute/v2.1/os-volumes/8109869c-09fe-43ea-a2be-91c8030996b2 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:24:54.146805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2034967689", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37f737e5-0e29-4d81-b926-6469f3832816"}], "security_groups": [{"name": "tempest-securitygroup--674591206"}], "key_name": "tempest-keypair-1287126177", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:24:54.876208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] validate_networks() for [('37f737e5-0e29-4d81-b926-6469f3832816', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:24:58.239504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:24:58.241182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:24:58.242037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:24:58.242604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:24:58.243254 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:24:58.283082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:58.284059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:58.285600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:58.286356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:58.378030 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Getting quotas for project 5ef063ca1eb846d78ff8901d2a3fc0a3. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:24:58.409022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Getting quotas for user ac2e584f88cd46f280b7fe04aa1382fd and project 5ef063ca1eb846d78ff8901d2a3fc0a3. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:24:58.451209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:24:58.456494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:24:58.904232 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-09b6ad73-c781-4b1b-bf9d-4f81e3594550 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.753434 Jul 25 19:24:58.914267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 17/27] 10.222.0.18 () {62 vars in 1188 bytes} [Mon Jul 25 19:24:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 4775 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 19:24:58.936980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3a56a2a1-0260-466b-a1fd-668bdbdcb2f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:58.950073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3a56a2a1-0260-466b-a1fd-668bdbdcb2f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:59.018643 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:59.019971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:59.425493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3a56a2a1-0260-466b-a1fd-668bdbdcb2f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:59.481447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3a56a2a1-0260-466b-a1fd-668bdbdcb2f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:59.483494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3a56a2a1-0260-466b-a1fd-668bdbdcb2f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:59.495425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3a56a2a1-0260-466b-a1fd-668bdbdcb2f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1282 microversion: 2.20 time: 0.571085 Jul 25 19:24:59.516593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 11/28] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:24:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1282 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:00.543280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-161d54d5-5914-4912-a8ea-830613fa397d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:00.548160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-161d54d5-5914-4912-a8ea-830613fa397d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:00.839044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-161d54d5-5914-4912-a8ea-830613fa397d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:00.915334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-161d54d5-5914-4912-a8ea-830613fa397d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:00.925078 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-161d54d5-5914-4912-a8ea-830613fa397d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:00.929707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-161d54d5-5914-4912-a8ea-830613fa397d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1282 microversion: 2.20 time: 0.394576 Jul 25 19:25:00.942194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 18/29] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1282 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:01.981311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e6879545-ca49-49b0-9c8b-b603c0ebb4bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:01.982185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e6879545-ca49-49b0-9c8b-b603c0ebb4bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:02.356824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e6879545-ca49-49b0-9c8b-b603c0ebb4bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:02.399596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e6879545-ca49-49b0-9c8b-b603c0ebb4bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:02.425092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e6879545-ca49-49b0-9c8b-b603c0ebb4bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:02.440270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e6879545-ca49-49b0-9c8b-b603c0ebb4bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1282 microversion: 2.20 time: 0.456366 Jul 25 19:25:02.442366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 19/30] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:01 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1282 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:02.731123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f072f5db-60ca-426c-854f-2fca21ad51cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: .version_select at 0x7feb0915cee0>, body: {"keypair": {"name": "tempest-keypair-899432830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLppUqs0Xr5SBSeH+KCx7qCu+Qcs1T6oh65hgfzNgl7isLKv1dA/OO533ze6oJvZZdTYzsLHtfF+7XCFRXY7H65EFPIRkFgqfNTZ+TGuagmXkowx97lHys8XQT1bQu1jEQ=="}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:02.801027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-f072f5db-60ca-426c-854f-2fca21ad51cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:25:02.820396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-f072f5db-60ca-426c-854f-2fca21ad51cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for user 6ecf34ceee294b53b5be7c1723b42950 and project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:25:02.921007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f072f5db-60ca-426c-854f-2fca21ad51cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.607984 Jul 25 19:25:02.922233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 12/31] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Jul 25 19:25:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:25:03.527801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5ab11450-afb4-41ab-b9f5-134db5eee8c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:03.532311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5ab11450-afb4-41ab-b9f5-134db5eee8c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:03.580178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ab11450-afb4-41ab-b9f5-134db5eee8c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:03.583977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ab11450-afb4-41ab-b9f5-134db5eee8c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:03.588969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ab11450-afb4-41ab-b9f5-134db5eee8c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:03.591337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ab11450-afb4-41ab-b9f5-134db5eee8c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:04.168945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5ab11450-afb4-41ab-b9f5-134db5eee8c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:04.218538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5ab11450-afb4-41ab-b9f5-134db5eee8c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:04.223400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5ab11450-afb4-41ab-b9f5-134db5eee8c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:04.251422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5ab11450-afb4-41ab-b9f5-134db5eee8c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1278 microversion: 2.20 time: 0.766813 Jul 25 19:25:04.256999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 20/32] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1278 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:05.335321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eca6a4cc-cc6c-40c2-a52f-0ecdb0afe3f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:05.336444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eca6a4cc-cc6c-40c2-a52f-0ecdb0afe3f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:05.349038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eca6a4cc-cc6c-40c2-a52f-0ecdb0afe3f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:05.349831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eca6a4cc-cc6c-40c2-a52f-0ecdb0afe3f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:05.350851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eca6a4cc-cc6c-40c2-a52f-0ecdb0afe3f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:05.351485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eca6a4cc-cc6c-40c2-a52f-0ecdb0afe3f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:05.853613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eca6a4cc-cc6c-40c2-a52f-0ecdb0afe3f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:05.894502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eca6a4cc-cc6c-40c2-a52f-0ecdb0afe3f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:05.915228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eca6a4cc-cc6c-40c2-a52f-0ecdb0afe3f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:05.924272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eca6a4cc-cc6c-40c2-a52f-0ecdb0afe3f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1342 microversion: 2.20 time: 0.609194 Jul 25 19:25:05.927955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 13/33] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1342 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:06.381674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-131646549", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:06.627599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] validate_networks() for [('2e5d12de-dfa3-4a0c-81d4-ecb6cbcb6f1d', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:25:07.006301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-606e94b5-26a4-43fa-a2f7-9cfd71fc1728 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:07.009636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-606e94b5-26a4-43fa-a2f7-9cfd71fc1728 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:07.069958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-606e94b5-26a4-43fa-a2f7-9cfd71fc1728 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:07.071245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-606e94b5-26a4-43fa-a2f7-9cfd71fc1728 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:07.074444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-606e94b5-26a4-43fa-a2f7-9cfd71fc1728 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:07.075700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-606e94b5-26a4-43fa-a2f7-9cfd71fc1728 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:07.508453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-606e94b5-26a4-43fa-a2f7-9cfd71fc1728 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:07.526855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-606e94b5-26a4-43fa-a2f7-9cfd71fc1728 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:07.544953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-606e94b5-26a4-43fa-a2f7-9cfd71fc1728 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:07.547421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-606e94b5-26a4-43fa-a2f7-9cfd71fc1728 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1340 microversion: 2.20 time: 0.566554 Jul 25 19:25:07.551737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 14/34] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1340 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:08.316048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:08.598062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-21ed9122-a1f0-4690-8740-ffdcd076735a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:08.599081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-21ed9122-a1f0-4690-8740-ffdcd076735a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:08.642164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21ed9122-a1f0-4690-8740-ffdcd076735a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:08.644908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21ed9122-a1f0-4690-8740-ffdcd076735a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:08.655045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21ed9122-a1f0-4690-8740-ffdcd076735a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:08.661464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21ed9122-a1f0-4690-8740-ffdcd076735a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:09.299454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-21ed9122-a1f0-4690-8740-ffdcd076735a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:09.359032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-21ed9122-a1f0-4690-8740-ffdcd076735a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:09.362764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-21ed9122-a1f0-4690-8740-ffdcd076735a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:09.381981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-21ed9122-a1f0-4690-8740-ffdcd076735a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1340 microversion: 2.20 time: 0.794935 Jul 25 19:25:09.404142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 15/35] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1340 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:25:10.088380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:25:10.089563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:25:10.090075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:25:10.092781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:25:10.092781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:25:10.132484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:10.133104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:10.134640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:10.139677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:10.217357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Getting quotas for project 1df108d610134859919e6bf8903f6190. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:25:10.233239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Getting quotas for user 0ed3ed6183d34c73ba40d13af037f838 and project 1df108d610134859919e6bf8903f6190. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:25:10.301594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:25:10.315502 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:25:10.612502 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-216658cc-e010-4378-add6-1b593f1d5f1a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.716656 Jul 25 19:25:10.615251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 21/36] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:25:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 4726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:25:10.642804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1fbaa116-bc98-4812-a227-3f62d3e191b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:10.651940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1fbaa116-bc98-4812-a227-3f62d3e191b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:10.703882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fbaa116-bc98-4812-a227-3f62d3e191b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:10.704470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fbaa116-bc98-4812-a227-3f62d3e191b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:10.705441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fbaa116-bc98-4812-a227-3f62d3e191b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:10.706152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fbaa116-bc98-4812-a227-3f62d3e191b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:11.345468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1fbaa116-bc98-4812-a227-3f62d3e191b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:11.377699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1fbaa116-bc98-4812-a227-3f62d3e191b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:11.381251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1fbaa116-bc98-4812-a227-3f62d3e191b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:11.383479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1fbaa116-bc98-4812-a227-3f62d3e191b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1340 microversion: 2.20 time: 0.761854 Jul 25 19:25:11.386406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 22/37] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1340 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:11.396152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d92511b7-85c1-440e-afcf-eff6a88da979 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:11.397615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d92511b7-85c1-440e-afcf-eff6a88da979 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:11.672459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1402486130", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "networks": [{"uuid": "28fc3a60-4894-41c4-9de5-2a14cb3e2c8b"}]}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:11.848190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d92511b7-85c1-440e-afcf-eff6a88da979 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:11.907414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d92511b7-85c1-440e-afcf-eff6a88da979 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1221 microversion: 2.1 time: 0.517567 Jul 25 19:25:11.907964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 23/38] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:11 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1221 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:12.167482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1020852266", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b6d8d22-cbba-4be4-870a-41dcb5ed33ac"}], "security_groups": [{"name": "tempest-securitygroup--616915401"}], "key_name": "tempest-keypair-899432830", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:12.182227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] validate_networks() for [('28fc3a60-4894-41c4-9de5-2a14cb3e2c8b', None, None, None, None, None)] {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:25:12.856726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=6 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:13.751499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] validate_networks() for [('5b6d8d22-cbba-4be4-870a-41dcb5ed33ac', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:25:14.998298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:17.098440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:25:17.099444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:25:17.100055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:25:17.100854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:25:17.101518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:25:17.131429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:17.144139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:17.145496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:17.146140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:17.290083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:25:17.317384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for user 6ecf34ceee294b53b5be7c1723b42950 and project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:25:17.337343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:25:17.342535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:25:17.565174 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66357b0b-a362-49c2-a725-c08b76a11193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.406170 Jul 25 19:25:17.571128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 24/39] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:25:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 5413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 19:25:17.593593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-98862fc6-5dfa-4a69-a235-0dbd567acbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:17.604753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-98862fc6-5dfa-4a69-a235-0dbd567acbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:17.638755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98862fc6-5dfa-4a69-a235-0dbd567acbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:17.639231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98862fc6-5dfa-4a69-a235-0dbd567acbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:17.640096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98862fc6-5dfa-4a69-a235-0dbd567acbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:17.640550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98862fc6-5dfa-4a69-a235-0dbd567acbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:18.210913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-98862fc6-5dfa-4a69-a235-0dbd567acbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:18.242259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-98862fc6-5dfa-4a69-a235-0dbd567acbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:18.249048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-98862fc6-5dfa-4a69-a235-0dbd567acbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:18.257001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-98862fc6-5dfa-4a69-a235-0dbd567acbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.669333 Jul 25 19:25:18.274887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 25/40] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:18.285253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1138849886", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:18.427064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:25:18.428948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:25:18.430153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:25:18.431111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:25:18.437768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:25:18.481314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] validate_networks() for [('2e5d12de-dfa3-4a0c-81d4-ecb6cbcb6f1d', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:25:18.481501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:18.481863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:18.483025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:18.483832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:18.622276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Getting quotas for project a6744feae17b4b32a60e06d373feb52d. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:25:18.636144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Getting quotas for user 30efc9bc66ce498d9d94980d85152694 and project a6744feae17b4b32a60e06d373feb52d. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:25:18.687491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:25:18.694581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:25:18.955145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eb92eb51-b098-45bc-abcd-036c4a44b389 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.623738 Jul 25 19:25:18.964174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 16/41] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:25:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 8634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:25:18.979246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9d71600c-f2a7-4371-a5b2-8929343f5863 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:19.000938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9d71600c-f2a7-4371-a5b2-8929343f5863 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:19.059693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d71600c-f2a7-4371-a5b2-8929343f5863 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:19.060721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d71600c-f2a7-4371-a5b2-8929343f5863 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:19.062151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d71600c-f2a7-4371-a5b2-8929343f5863 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:19.062921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d71600c-f2a7-4371-a5b2-8929343f5863 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:19.565318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9d71600c-f2a7-4371-a5b2-8929343f5863 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:19.599165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9d71600c-f2a7-4371-a5b2-8929343f5863 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1245 microversion: 2.1 time: 0.632121 Jul 25 19:25:19.603130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 17/42] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1245 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:19.629504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-221ebec6-70ad-4db3-9177-e1173cc83af3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:19.637115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-221ebec6-70ad-4db3-9177-e1173cc83af3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:20.426736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-221ebec6-70ad-4db3-9177-e1173cc83af3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:20.461159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-221ebec6-70ad-4db3-9177-e1173cc83af3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1215 microversion: 2.1 time: 0.841557 Jul 25 19:25:20.480401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 18/43] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:19 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1215 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:20.516705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-787b19aa-2d48-4068-b09c-102084e53be3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:20.518856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-787b19aa-2d48-4068-b09c-102084e53be3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:20.548322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-787b19aa-2d48-4068-b09c-102084e53be3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:20.553075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-787b19aa-2d48-4068-b09c-102084e53be3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:20.570509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-787b19aa-2d48-4068-b09c-102084e53be3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:20.571424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-787b19aa-2d48-4068-b09c-102084e53be3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:22.352062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:25:22.352953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:25:22.355740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:25:22.356668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:25:22.361903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:25:22.408191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-787b19aa-2d48-4068-b09c-102084e53be3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:22.421639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:22.433671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:22.436071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:22.442036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:22.447451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-787b19aa-2d48-4068-b09c-102084e53be3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:22.460011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-787b19aa-2d48-4068-b09c-102084e53be3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:22.481445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-787b19aa-2d48-4068-b09c-102084e53be3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 1.979947 Jul 25 19:25:22.485933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 19/44] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:22.514131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1782ca99-30e8-4b27-979f-e7d861f8c447 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:22.518105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1782ca99-30e8-4b27-979f-e7d861f8c447 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:22.579899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1782ca99-30e8-4b27-979f-e7d861f8c447 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:22.582345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1782ca99-30e8-4b27-979f-e7d861f8c447 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:22.584891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1782ca99-30e8-4b27-979f-e7d861f8c447 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:22.585614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Getting quotas for project 1df108d610134859919e6bf8903f6190. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:25:22.591045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1782ca99-30e8-4b27-979f-e7d861f8c447 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:22.605849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Getting quotas for user 0ed3ed6183d34c73ba40d13af037f838 and project 1df108d610134859919e6bf8903f6190. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:25:22.669572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:25:22.692111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:25:22.858770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1782ca99-30e8-4b27-979f-e7d861f8c447 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:22.928849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1782ca99-30e8-4b27-979f-e7d861f8c447 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1293 microversion: 2.1 time: 0.435495 Jul 25 19:25:22.948926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 20/45] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:22.966111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2486fbc6-6507-4c06-a9df-76b82268deb0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.686003 Jul 25 19:25:22.968215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 26/46] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:25:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 4693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:25:23.017880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5e7b6ed3-38a6-4ac7-adae-6f3ede79457e tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:23.022538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5e7b6ed3-38a6-4ac7-adae-6f3ede79457e tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:23.042571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e7b6ed3-38a6-4ac7-adae-6f3ede79457e tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:23.044107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e7b6ed3-38a6-4ac7-adae-6f3ede79457e tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:23.052473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e7b6ed3-38a6-4ac7-adae-6f3ede79457e tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:23.054387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e7b6ed3-38a6-4ac7-adae-6f3ede79457e tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:23.837074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5e7b6ed3-38a6-4ac7-adae-6f3ede79457e tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:23.914072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5e7b6ed3-38a6-4ac7-adae-6f3ede79457e tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1267 microversion: 2.1 time: 0.921191 Jul 25 19:25:23.916255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 27/47] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:22 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1267 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:24.040630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f56a8b03-091c-4b65-8fc6-77ed008f21ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:24.054916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f56a8b03-091c-4b65-8fc6-77ed008f21ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:24.599381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-9f60f7d1-3257-4c38-b300-f0de984c9eeb req-b8320621-7975-407d-b20f-8c3e76b55f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1007369a-dd3c-4837-95f4-e8326d600031", "tag": "33faefb9-12a5-4e86-b189-357d316c5553"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:24.718569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-9f60f7d1-3257-4c38-b300-f0de984c9eeb req-b8320621-7975-407d-b20f-8c3e76b55f8a service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:24.730745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-9f60f7d1-3257-4c38-b300-f0de984c9eeb req-b8320621-7975-407d-b20f-8c3e76b55f8a service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:24.964118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-9f60f7d1-3257-4c38-b300-f0de984c9eeb req-b8320621-7975-407d-b20f-8c3e76b55f8a service nova] Creating event network-changed:33faefb9-12a5-4e86-b189-357d316c5553 for instance 1007369a-dd3c-4837-95f4-e8326d600031 on hv-cinder-85093 Jul 25 19:25:24.965202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-9f60f7d1-3257-4c38-b300-f0de984c9eeb req-b8320621-7975-407d-b20f-8c3e76b55f8a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117952) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 19:25:24.980339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7cbb893-5f84-415d-9f77-ddf2572f3be5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:24.981765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7cbb893-5f84-415d-9f77-ddf2572f3be5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:24.988954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7cbb893-5f84-415d-9f77-ddf2572f3be5 None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:24.993091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7cbb893-5f84-415d-9f77-ddf2572f3be5 None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:25.049833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.compute.rpcapi [None req-f7cbb893-5f84-415d-9f77-ddf2572f3be5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 19:25:25.052075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7cbb893-5f84-415d-9f77-ddf2572f3be5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117952) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 19:25:25.127374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f7cbb893-5f84-415d-9f77-ddf2572f3be5 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 2.185633 Jul 25 19:25:25.128991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 21/48] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:25:25.151698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c2db4a4f-532d-42fc-9c2f-edc83b6ffa34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:25.152468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c2db4a4f-532d-42fc-9c2f-edc83b6ffa34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:25.208057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f56a8b03-091c-4b65-8fc6-77ed008f21ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:25.216189 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=31 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:25.233847 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c2db4a4f-532d-42fc-9c2f-edc83b6ffa34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:25.241592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c2db4a4f-532d-42fc-9c2f-edc83b6ffa34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:25.245968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c2db4a4f-532d-42fc-9c2f-edc83b6ffa34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:25.247480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c2db4a4f-532d-42fc-9c2f-edc83b6ffa34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:25.256446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f56a8b03-091c-4b65-8fc6-77ed008f21ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1222 microversion: 2.1 time: 1.287493 Jul 25 19:25:25.257818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 28/49] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:23 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1222 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:25.292837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ff22effc-92f5-446f-9a9b-d386d7d2ec29 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:25.298149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ff22effc-92f5-446f-9a9b-d386d7d2ec29 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:25.345883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff22effc-92f5-446f-9a9b-d386d7d2ec29 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:25.352498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff22effc-92f5-446f-9a9b-d386d7d2ec29 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:25.362899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff22effc-92f5-446f-9a9b-d386d7d2ec29 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:25.370088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff22effc-92f5-446f-9a9b-d386d7d2ec29 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:25.402496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=33 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:26.277622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ff22effc-92f5-446f-9a9b-d386d7d2ec29 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:26.321569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ff22effc-92f5-446f-9a9b-d386d7d2ec29 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1299 microversion: 2.1 time: 1.058650 Jul 25 19:25:26.359622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 29/50] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1299 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:26.394340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bf530c03-71e9-4071-855e-8d4991e7d13c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:26.404719 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bf530c03-71e9-4071-855e-8d4991e7d13c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:26.434088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf530c03-71e9-4071-855e-8d4991e7d13c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:26.437396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf530c03-71e9-4071-855e-8d4991e7d13c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:26.445242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf530c03-71e9-4071-855e-8d4991e7d13c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:26.447399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf530c03-71e9-4071-855e-8d4991e7d13c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:26.866265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bf530c03-71e9-4071-855e-8d4991e7d13c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:26.879780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bf530c03-71e9-4071-855e-8d4991e7d13c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1273 microversion: 2.1 time: 0.515581 Jul 25 19:25:26.885138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 30/51] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:26 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1273 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:26.896974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-947c1bdd-03b8-498f-9cc8-759718c63fa4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:26.902062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-947c1bdd-03b8-498f-9cc8-759718c63fa4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:26.926996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-947c1bdd-03b8-498f-9cc8-759718c63fa4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:26.929490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-947c1bdd-03b8-498f-9cc8-759718c63fa4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:26.934622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-947c1bdd-03b8-498f-9cc8-759718c63fa4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:26.938143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-947c1bdd-03b8-498f-9cc8-759718c63fa4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:27.100508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c2db4a4f-532d-42fc-9c2f-edc83b6ffa34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:27.131988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c2db4a4f-532d-42fc-9c2f-edc83b6ffa34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:27.136170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c2db4a4f-532d-42fc-9c2f-edc83b6ffa34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:27.139085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c2db4a4f-532d-42fc-9c2f-edc83b6ffa34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 2.008005 Jul 25 19:25:27.140981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 22/52] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:27.164370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-947c1bdd-03b8-498f-9cc8-759718c63fa4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:27.195920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-947c1bdd-03b8-498f-9cc8-759718c63fa4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1226 microversion: 2.1 time: 0.307189 Jul 25 19:25:27.201505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 31/53] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:26 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1226 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:27.378843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7bb30a0d-2f64-4912-b61a-73f4e0b5f64c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:27.379996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7bb30a0d-2f64-4912-b61a-73f4e0b5f64c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:27.410561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7bb30a0d-2f64-4912-b61a-73f4e0b5f64c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:27.411601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7bb30a0d-2f64-4912-b61a-73f4e0b5f64c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:27.413607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7bb30a0d-2f64-4912-b61a-73f4e0b5f64c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:27.415148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7bb30a0d-2f64-4912-b61a-73f4e0b5f64c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:27.581704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7bb30a0d-2f64-4912-b61a-73f4e0b5f64c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:27.623268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7bb30a0d-2f64-4912-b61a-73f4e0b5f64c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1299 microversion: 2.1 time: 0.253904 Jul 25 19:25:27.625101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 23/54] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:27.928582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-162564d3-3815-45b2-b168-9cd9ebfd842f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:27.929401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-162564d3-3815-45b2-b168-9cd9ebfd842f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:27.946535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-162564d3-3815-45b2-b168-9cd9ebfd842f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:27.949185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-162564d3-3815-45b2-b168-9cd9ebfd842f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:27.951289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-162564d3-3815-45b2-b168-9cd9ebfd842f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:27.952055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-162564d3-3815-45b2-b168-9cd9ebfd842f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:28.178772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-71215b28-6d12-4a78-b68d-f82dd5d1d0a4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:28.183045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-71215b28-6d12-4a78-b68d-f82dd5d1d0a4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:28.205892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71215b28-6d12-4a78-b68d-f82dd5d1d0a4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:28.206752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71215b28-6d12-4a78-b68d-f82dd5d1d0a4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:28.208431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71215b28-6d12-4a78-b68d-f82dd5d1d0a4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:28.209417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71215b28-6d12-4a78-b68d-f82dd5d1d0a4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:28.754361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-162564d3-3815-45b2-b168-9cd9ebfd842f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:28.792215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-162564d3-3815-45b2-b168-9cd9ebfd842f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.867979 Jul 25 19:25:28.801744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 32/55] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:27 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:28.826566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-21effcbd-0369-43b9-8ea3-268e1dc02bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:28.827724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-21effcbd-0369-43b9-8ea3-268e1dc02bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:28.872862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21effcbd-0369-43b9-8ea3-268e1dc02bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:28.876108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21effcbd-0369-43b9-8ea3-268e1dc02bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:28.879245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21effcbd-0369-43b9-8ea3-268e1dc02bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:28.880701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21effcbd-0369-43b9-8ea3-268e1dc02bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:28.965816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-71215b28-6d12-4a78-b68d-f82dd5d1d0a4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:28.983499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-71215b28-6d12-4a78-b68d-f82dd5d1d0a4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:28.988217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-71215b28-6d12-4a78-b68d-f82dd5d1d0a4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:28.991035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-71215b28-6d12-4a78-b68d-f82dd5d1d0a4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.817720 Jul 25 19:25:28.992446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 24/56] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:29.002654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7ce0ec16-3dce-4ccf-9d53-f72771e6556e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:29.004693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7ce0ec16-3dce-4ccf-9d53-f72771e6556e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:29.019829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ce0ec16-3dce-4ccf-9d53-f72771e6556e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:29.021202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ce0ec16-3dce-4ccf-9d53-f72771e6556e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:29.022667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ce0ec16-3dce-4ccf-9d53-f72771e6556e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:29.024062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ce0ec16-3dce-4ccf-9d53-f72771e6556e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:29.034754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=61 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:29.157954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-21effcbd-0369-43b9-8ea3-268e1dc02bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:29.203663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-21effcbd-0369-43b9-8ea3-268e1dc02bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1226 microversion: 2.1 time: 0.399752 Jul 25 19:25:29.204290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 33/57] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:28 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1226 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:29.297687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7ce0ec16-3dce-4ccf-9d53-f72771e6556e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:29.311075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7ce0ec16-3dce-4ccf-9d53-f72771e6556e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1299 microversion: 2.1 time: 0.315831 Jul 25 19:25:29.312484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 25/58] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1299 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:29.829540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ac9a8ac9-5fdd-4acf-bbc1-9c5b126ba639 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:29.830511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ac9a8ac9-5fdd-4acf-bbc1-9c5b126ba639 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:29.840836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac9a8ac9-5fdd-4acf-bbc1-9c5b126ba639 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:29.841417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac9a8ac9-5fdd-4acf-bbc1-9c5b126ba639 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:29.842246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac9a8ac9-5fdd-4acf-bbc1-9c5b126ba639 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:29.842683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac9a8ac9-5fdd-4acf-bbc1-9c5b126ba639 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:30.031679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-778c202f-a1fd-4466-921b-3b7eb88aa958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:30.032742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-778c202f-a1fd-4466-921b-3b7eb88aa958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:30.035869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:30.045760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-778c202f-a1fd-4466-921b-3b7eb88aa958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:30.046215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-778c202f-a1fd-4466-921b-3b7eb88aa958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:30.047014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-778c202f-a1fd-4466-921b-3b7eb88aa958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:30.047661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-778c202f-a1fd-4466-921b-3b7eb88aa958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:30.063907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ac9a8ac9-5fdd-4acf-bbc1-9c5b126ba639 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:30.090923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ac9a8ac9-5fdd-4acf-bbc1-9c5b126ba639 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.267399 Jul 25 19:25:30.095237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 34/59] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:29 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:30.270116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-938ccd61-97f1-4015-b8e0-5a5cbe015faa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:30.272561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-938ccd61-97f1-4015-b8e0-5a5cbe015faa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:30.288136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-938ccd61-97f1-4015-b8e0-5a5cbe015faa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:30.289933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-938ccd61-97f1-4015-b8e0-5a5cbe015faa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:30.292741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-938ccd61-97f1-4015-b8e0-5a5cbe015faa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:30.294605 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-938ccd61-97f1-4015-b8e0-5a5cbe015faa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:30.379487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-778c202f-a1fd-4466-921b-3b7eb88aa958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:30.398726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-778c202f-a1fd-4466-921b-3b7eb88aa958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:30.399325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-938ccd61-97f1-4015-b8e0-5a5cbe015faa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:30.403634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-778c202f-a1fd-4466-921b-3b7eb88aa958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:30.406705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-778c202f-a1fd-4466-921b-3b7eb88aa958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.378502 Jul 25 19:25:30.409070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 26/60] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:25:30.420709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5220288d-4d3b-47e0-bc0b-e1f19554e648 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:30.422295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-938ccd61-97f1-4015-b8e0-5a5cbe015faa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1226 microversion: 2.1 time: 0.174345 Jul 25 19:25:30.423055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5220288d-4d3b-47e0-bc0b-e1f19554e648 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:30.436317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 35/61] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:30 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1226 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:30.437123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5220288d-4d3b-47e0-bc0b-e1f19554e648 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:30.438201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5220288d-4d3b-47e0-bc0b-e1f19554e648 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:30.440027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5220288d-4d3b-47e0-bc0b-e1f19554e648 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:30.441282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5220288d-4d3b-47e0-bc0b-e1f19554e648 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:30.483114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=8 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:30.593722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5220288d-4d3b-47e0-bc0b-e1f19554e648 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:30.602557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5220288d-4d3b-47e0-bc0b-e1f19554e648 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1299 microversion: 2.1 time: 0.191513 Jul 25 19:25:30.612075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 27/62] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1299 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:31.124431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fdb97a10-b052-4795-ae97-749099a76db0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:31.125331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fdb97a10-b052-4795-ae97-749099a76db0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:31.138817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdb97a10-b052-4795-ae97-749099a76db0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:31.139609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdb97a10-b052-4795-ae97-749099a76db0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:31.140606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdb97a10-b052-4795-ae97-749099a76db0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:31.141421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdb97a10-b052-4795-ae97-749099a76db0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:31.379664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fdb97a10-b052-4795-ae97-749099a76db0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:31.393870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fdb97a10-b052-4795-ae97-749099a76db0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.275521 Jul 25 19:25:31.394988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 36/63] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:31 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:31.443059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fc2ac700-f05b-40bb-8b92-400bb707010e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:31.444196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fc2ac700-f05b-40bb-8b92-400bb707010e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:31.454536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc2ac700-f05b-40bb-8b92-400bb707010e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:31.458211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc2ac700-f05b-40bb-8b92-400bb707010e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:31.460123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc2ac700-f05b-40bb-8b92-400bb707010e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:31.461612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc2ac700-f05b-40bb-8b92-400bb707010e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:31.466886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3db94f0b-7b5d-445f-a26c-2096a8f6d719 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:31.468154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3db94f0b-7b5d-445f-a26c-2096a8f6d719 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:31.488398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3db94f0b-7b5d-445f-a26c-2096a8f6d719 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:31.488855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3db94f0b-7b5d-445f-a26c-2096a8f6d719 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:31.489666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3db94f0b-7b5d-445f-a26c-2096a8f6d719 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:31.490106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3db94f0b-7b5d-445f-a26c-2096a8f6d719 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:31.643654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3db94f0b-7b5d-445f-a26c-2096a8f6d719 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:31.660514 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3db94f0b-7b5d-445f-a26c-2096a8f6d719 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1226 microversion: 2.1 time: 0.201173 Jul 25 19:25:31.661179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 37/64] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:31 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1226 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:31.669594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ccfdd373-ce15-400a-be7a-e9f08844d897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:31.670891 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ccfdd373-ce15-400a-be7a-e9f08844d897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:31.682980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccfdd373-ce15-400a-be7a-e9f08844d897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:31.684718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccfdd373-ce15-400a-be7a-e9f08844d897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:31.686069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccfdd373-ce15-400a-be7a-e9f08844d897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:31.688073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccfdd373-ce15-400a-be7a-e9f08844d897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:31.824959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ccfdd373-ce15-400a-be7a-e9f08844d897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:31.844915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ccfdd373-ce15-400a-be7a-e9f08844d897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1299 microversion: 2.1 time: 0.175766 Jul 25 19:25:31.848844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 38/65] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:31.904446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fc2ac700-f05b-40bb-8b92-400bb707010e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:31.921402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fc2ac700-f05b-40bb-8b92-400bb707010e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:31.933216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fc2ac700-f05b-40bb-8b92-400bb707010e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:31.938517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fc2ac700-f05b-40bb-8b92-400bb707010e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.501633 Jul 25 19:25:31.941235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 28/66] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:32.437608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b0608242-b04c-480b-9835-4b0180e2d458 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:32.438494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b0608242-b04c-480b-9835-4b0180e2d458 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:32.469570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0608242-b04c-480b-9835-4b0180e2d458 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:32.472735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0608242-b04c-480b-9835-4b0180e2d458 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:32.473684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0608242-b04c-480b-9835-4b0180e2d458 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:32.476496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0608242-b04c-480b-9835-4b0180e2d458 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:32.546226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:32.708446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-38f38328-39f9-4ddb-bd9b-5fb9c3ef8efe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:32.716008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-38f38328-39f9-4ddb-bd9b-5fb9c3ef8efe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:32.744069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38f38328-39f9-4ddb-bd9b-5fb9c3ef8efe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:32.745749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38f38328-39f9-4ddb-bd9b-5fb9c3ef8efe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:32.753466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38f38328-39f9-4ddb-bd9b-5fb9c3ef8efe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:32.762978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38f38328-39f9-4ddb-bd9b-5fb9c3ef8efe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:33.004305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-38f38328-39f9-4ddb-bd9b-5fb9c3ef8efe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:33.028186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-38f38328-39f9-4ddb-bd9b-5fb9c3ef8efe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1226 microversion: 2.1 time: 0.328303 Jul 25 19:25:33.039093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 29/67] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:32 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1226 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:33.072987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f77859d9-3a3d-41e8-89c8-af72fa23aa49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:33.074798 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f77859d9-3a3d-41e8-89c8-af72fa23aa49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:33.093346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f77859d9-3a3d-41e8-89c8-af72fa23aa49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:33.094099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f77859d9-3a3d-41e8-89c8-af72fa23aa49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:33.095530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f77859d9-3a3d-41e8-89c8-af72fa23aa49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:33.097326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f77859d9-3a3d-41e8-89c8-af72fa23aa49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:33.851944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f77859d9-3a3d-41e8-89c8-af72fa23aa49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:33.878874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f77859d9-3a3d-41e8-89c8-af72fa23aa49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1299 microversion: 2.1 time: 0.827124 Jul 25 19:25:33.879973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 30/68] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1299 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:33.898662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-86e0d22e-2816-4a0c-92d1-78e97d5fc081 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:33.907882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-86e0d22e-2816-4a0c-92d1-78e97d5fc081 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:33.920330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86e0d22e-2816-4a0c-92d1-78e97d5fc081 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:33.921501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86e0d22e-2816-4a0c-92d1-78e97d5fc081 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:33.923936 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86e0d22e-2816-4a0c-92d1-78e97d5fc081 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:33.925161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86e0d22e-2816-4a0c-92d1-78e97d5fc081 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:33.961734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b0608242-b04c-480b-9835-4b0180e2d458 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:33.980183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b0608242-b04c-480b-9835-4b0180e2d458 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 1.553762 Jul 25 19:25:33.992423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 39/69] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:32 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:34.066973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8da91439-e6fa-4080-8be1-d43d5b037d5f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:34.068041 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8da91439-e6fa-4080-8be1-d43d5b037d5f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:34.078135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8da91439-e6fa-4080-8be1-d43d5b037d5f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:34.080146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8da91439-e6fa-4080-8be1-d43d5b037d5f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:34.081557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8da91439-e6fa-4080-8be1-d43d5b037d5f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:34.082284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8da91439-e6fa-4080-8be1-d43d5b037d5f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:34.383762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8da91439-e6fa-4080-8be1-d43d5b037d5f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:34.397766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8da91439-e6fa-4080-8be1-d43d5b037d5f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1226 microversion: 2.1 time: 0.334855 Jul 25 19:25:34.421095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 40/70] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:34 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1226 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:34.432540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-3449116f-2d31-4daf-91e7-606310332b86 req-dd8ca859-ead3-4582-b004-44799e21d8df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e4c5ca9-5dfe-4ed1-895e-a0db055e690a", "tag": "7d926653-f589-4d60-aaac-79517984d5e8"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:34.459927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-3449116f-2d31-4daf-91e7-606310332b86 req-dd8ca859-ead3-4582-b004-44799e21d8df service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:34.460830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-3449116f-2d31-4daf-91e7-606310332b86 req-dd8ca859-ead3-4582-b004-44799e21d8df service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:34.497534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-3449116f-2d31-4daf-91e7-606310332b86 req-dd8ca859-ead3-4582-b004-44799e21d8df service nova] Creating event network-changed:7d926653-f589-4d60-aaac-79517984d5e8 for instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a on hv-cinder-85093 Jul 25 19:25:34.497930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-3449116f-2d31-4daf-91e7-606310332b86 req-dd8ca859-ead3-4582-b004-44799e21d8df service nova] Acquired lock "compute-rpcapi-router" {{(pid=117951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 19:25:34.499117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2b2c348-f84d-497b-a62f-2269e94f0fb4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:34.499601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2b2c348-f84d-497b-a62f-2269e94f0fb4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:34.501003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2b2c348-f84d-497b-a62f-2269e94f0fb4 None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:34.501457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2b2c348-f84d-497b-a62f-2269e94f0fb4 None None] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:34.515071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.compute.rpcapi [None req-c2b2c348-f84d-497b-a62f-2269e94f0fb4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 19:25:34.516021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2b2c348-f84d-497b-a62f-2269e94f0fb4 None None] Releasing lock "compute-rpcapi-router" {{(pid=117951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 19:25:34.541629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2b2c348-f84d-497b-a62f-2269e94f0fb4 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116903 Jul 25 19:25:34.546513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 41/71] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:25:34.572720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86e0d22e-2816-4a0c-92d1-78e97d5fc081 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:34.590555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86e0d22e-2816-4a0c-92d1-78e97d5fc081 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:34.594721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86e0d22e-2816-4a0c-92d1-78e97d5fc081 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:34.597888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-86e0d22e-2816-4a0c-92d1-78e97d5fc081 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.708373 Jul 25 19:25:34.599356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 31/72] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:34.910618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-758f5220-fed3-465a-878a-f46bcefa67d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:34.916214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-758f5220-fed3-465a-878a-f46bcefa67d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:34.933996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-758f5220-fed3-465a-878a-f46bcefa67d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:34.935262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-758f5220-fed3-465a-878a-f46bcefa67d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:34.937207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-758f5220-fed3-465a-878a-f46bcefa67d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:34.938627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-758f5220-fed3-465a-878a-f46bcefa67d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:35.014331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-73b5a6b9-02af-430b-9148-56458b3f1fc8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:35.015203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-73b5a6b9-02af-430b-9148-56458b3f1fc8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:35.030982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:35.036982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-73b5a6b9-02af-430b-9148-56458b3f1fc8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:35.038221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-73b5a6b9-02af-430b-9148-56458b3f1fc8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:35.040976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-73b5a6b9-02af-430b-9148-56458b3f1fc8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:35.042059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-73b5a6b9-02af-430b-9148-56458b3f1fc8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:35.104772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-758f5220-fed3-465a-878a-f46bcefa67d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:35.115336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-758f5220-fed3-465a-878a-f46bcefa67d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1299 microversion: 2.1 time: 0.212813 Jul 25 19:25:35.116631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 42/73] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1299 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:35.429227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8376fd53-2c1c-4eeb-813f-ebc408979842 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:35.434761 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8376fd53-2c1c-4eeb-813f-ebc408979842 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:35.456459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:35.459127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8376fd53-2c1c-4eeb-813f-ebc408979842 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:35.460219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8376fd53-2c1c-4eeb-813f-ebc408979842 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:35.466132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8376fd53-2c1c-4eeb-813f-ebc408979842 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:35.466962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8376fd53-2c1c-4eeb-813f-ebc408979842 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:36.361076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8376fd53-2c1c-4eeb-813f-ebc408979842 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:36.378063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8376fd53-2c1c-4eeb-813f-ebc408979842 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1218 microversion: 2.1 time: 0.954270 Jul 25 19:25:36.379434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 43/74] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:35 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1218 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:36.394669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2891befa-fbed-4af2-a755-3e855156fb6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:36.396185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2891befa-fbed-4af2-a755-3e855156fb6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:36.398085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-73b5a6b9-02af-430b-9148-56458b3f1fc8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:36.411787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2891befa-fbed-4af2-a755-3e855156fb6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:36.418152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2891befa-fbed-4af2-a755-3e855156fb6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:36.418152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2891befa-fbed-4af2-a755-3e855156fb6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:36.418630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2891befa-fbed-4af2-a755-3e855156fb6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:36.421781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-73b5a6b9-02af-430b-9148-56458b3f1fc8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 1.411815 Jul 25 19:25:36.426895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 32/75] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:35 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:36.443587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf6411e3-faee-4b5a-8443-4fe7e858921f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:36.445575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cf6411e3-faee-4b5a-8443-4fe7e858921f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:36.466161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf6411e3-faee-4b5a-8443-4fe7e858921f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:36.466742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf6411e3-faee-4b5a-8443-4fe7e858921f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:36.467410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf6411e3-faee-4b5a-8443-4fe7e858921f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:36.468067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf6411e3-faee-4b5a-8443-4fe7e858921f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:36.794936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2891befa-fbed-4af2-a755-3e855156fb6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:36.810088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2891befa-fbed-4af2-a755-3e855156fb6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:36.813599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2891befa-fbed-4af2-a755-3e855156fb6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:36.815770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2891befa-fbed-4af2-a755-3e855156fb6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.434830 Jul 25 19:25:36.817480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 44/76] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:36.851485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf6411e3-faee-4b5a-8443-4fe7e858921f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:36.865805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cf6411e3-faee-4b5a-8443-4fe7e858921f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.428381 Jul 25 19:25:36.866816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 33/77] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:36.923761 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-ef97e7d9-0e86-44f0-ac4a-fa78f0134344 req-77393167-3527-41bb-ae89-e306ca39125c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad9c400-6df9-49ac-a7e5-e9336446af9e", "tag": "75adfdc2-df4c-4810-bd2e-e056db5829f5"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:36.940311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ef97e7d9-0e86-44f0-ac4a-fa78f0134344 req-77393167-3527-41bb-ae89-e306ca39125c service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:36.941458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ef97e7d9-0e86-44f0-ac4a-fa78f0134344 req-77393167-3527-41bb-ae89-e306ca39125c service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:36.963085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-ef97e7d9-0e86-44f0-ac4a-fa78f0134344 req-77393167-3527-41bb-ae89-e306ca39125c service nova] Creating event network-changed:75adfdc2-df4c-4810-bd2e-e056db5829f5 for instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e on hv-cinder-85093 Jul 25 19:25:36.972360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-ef97e7d9-0e86-44f0-ac4a-fa78f0134344 req-77393167-3527-41bb-ae89-e306ca39125c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151811 Jul 25 19:25:36.973944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 45/78] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:25:37.408856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-99ce2307-7a70-4553-903a-3403dfb72ebd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:37.409997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-99ce2307-7a70-4553-903a-3403dfb72ebd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:37.421470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99ce2307-7a70-4553-903a-3403dfb72ebd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:37.422215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99ce2307-7a70-4553-903a-3403dfb72ebd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:37.423577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99ce2307-7a70-4553-903a-3403dfb72ebd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:37.424306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99ce2307-7a70-4553-903a-3403dfb72ebd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:37.455366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd677f70-c0e7-490a-9fcc-929790faf71c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:37.456831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd677f70-c0e7-490a-9fcc-929790faf71c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:37.470385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd677f70-c0e7-490a-9fcc-929790faf71c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:37.471118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd677f70-c0e7-490a-9fcc-929790faf71c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:37.472598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd677f70-c0e7-490a-9fcc-929790faf71c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:37.473365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd677f70-c0e7-490a-9fcc-929790faf71c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:37.538790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-99ce2307-7a70-4553-903a-3403dfb72ebd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:37.556501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-99ce2307-7a70-4553-903a-3403dfb72ebd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1218 microversion: 2.1 time: 0.153689 Jul 25 19:25:37.557936 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 34/79] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:37 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:37.789215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd677f70-c0e7-490a-9fcc-929790faf71c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:37.793638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:37.803194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd677f70-c0e7-490a-9fcc-929790faf71c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.360193 Jul 25 19:25:37.804016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 46/80] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:37 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:37.859593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-63fd4a43-ddc9-4546-be21-602497bfd7a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:37.860862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-63fd4a43-ddc9-4546-be21-602497bfd7a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:37.873679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63fd4a43-ddc9-4546-be21-602497bfd7a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:37.874500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63fd4a43-ddc9-4546-be21-602497bfd7a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:37.876023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63fd4a43-ddc9-4546-be21-602497bfd7a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:37.877003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63fd4a43-ddc9-4546-be21-602497bfd7a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:37.905819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-585bb8aa-1509-41a8-a8c3-f4f33e4cf1c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:37.906939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-585bb8aa-1509-41a8-a8c3-f4f33e4cf1c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:37.918114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-585bb8aa-1509-41a8-a8c3-f4f33e4cf1c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:37.918877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-585bb8aa-1509-41a8-a8c3-f4f33e4cf1c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:37.920509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-585bb8aa-1509-41a8-a8c3-f4f33e4cf1c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:37.921292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-585bb8aa-1509-41a8-a8c3-f4f33e4cf1c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:38.198211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-63fd4a43-ddc9-4546-be21-602497bfd7a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:38.204261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-585bb8aa-1509-41a8-a8c3-f4f33e4cf1c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:38.217122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-585bb8aa-1509-41a8-a8c3-f4f33e4cf1c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.319901 Jul 25 19:25:38.217831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 47/81] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:38.220954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-63fd4a43-ddc9-4546-be21-602497bfd7a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:38.224752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-63fd4a43-ddc9-4546-be21-602497bfd7a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:38.227220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-63fd4a43-ddc9-4546-be21-602497bfd7a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.375644 Jul 25 19:25:38.239440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 35/82] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:38.587937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d277f477-6f8e-49b0-831c-dc0a6654aaaf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:38.588690 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d277f477-6f8e-49b0-831c-dc0a6654aaaf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:38.603127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d277f477-6f8e-49b0-831c-dc0a6654aaaf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:38.604461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d277f477-6f8e-49b0-831c-dc0a6654aaaf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:38.604740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d277f477-6f8e-49b0-831c-dc0a6654aaaf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:38.605188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d277f477-6f8e-49b0-831c-dc0a6654aaaf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:38.745790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d277f477-6f8e-49b0-831c-dc0a6654aaaf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:38.755505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d277f477-6f8e-49b0-831c-dc0a6654aaaf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1218 microversion: 2.1 time: 0.173549 Jul 25 19:25:38.756151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 48/83] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:38 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:38.832122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ac9d308b-5585-4c40-bc71-29fd3b1548f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:38.834370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ac9d308b-5585-4c40-bc71-29fd3b1548f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:38.846788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac9d308b-5585-4c40-bc71-29fd3b1548f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:38.847572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac9d308b-5585-4c40-bc71-29fd3b1548f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:38.849325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac9d308b-5585-4c40-bc71-29fd3b1548f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:38.850382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac9d308b-5585-4c40-bc71-29fd3b1548f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:39.254565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2191d8c2-a7cd-40f7-ab62-b08518b8cfd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:39.255675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2191d8c2-a7cd-40f7-ab62-b08518b8cfd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:39.266614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2191d8c2-a7cd-40f7-ab62-b08518b8cfd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:39.269163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2191d8c2-a7cd-40f7-ab62-b08518b8cfd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:39.271356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2191d8c2-a7cd-40f7-ab62-b08518b8cfd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:39.272597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2191d8c2-a7cd-40f7-ab62-b08518b8cfd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:39.364358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ac9d308b-5585-4c40-bc71-29fd3b1548f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:39.382505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ac9d308b-5585-4c40-bc71-29fd3b1548f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.557768 Jul 25 19:25:39.395010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 36/84] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:38 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:39.417852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9d9d2d10-668c-4960-8909-d71e8bd541c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:39.419067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9d9d2d10-668c-4960-8909-d71e8bd541c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:39.444938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d9d2d10-668c-4960-8909-d71e8bd541c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:39.447639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d9d2d10-668c-4960-8909-d71e8bd541c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:39.448922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d9d2d10-668c-4960-8909-d71e8bd541c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:39.449387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d9d2d10-668c-4960-8909-d71e8bd541c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:39.780127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2191d8c2-a7cd-40f7-ab62-b08518b8cfd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:39.800392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2191d8c2-a7cd-40f7-ab62-b08518b8cfd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.551704 Jul 25 19:25:39.802070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 49/85] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:39.811876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f48a53d4-bb6c-4cb6-89a4-714121293844 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:39.813794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f48a53d4-bb6c-4cb6-89a4-714121293844 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:39.825853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f48a53d4-bb6c-4cb6-89a4-714121293844 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:39.827257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f48a53d4-bb6c-4cb6-89a4-714121293844 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:39.829129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f48a53d4-bb6c-4cb6-89a4-714121293844 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:39.830243 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f48a53d4-bb6c-4cb6-89a4-714121293844 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:39.886653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9d9d2d10-668c-4960-8909-d71e8bd541c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:39.900357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9d9d2d10-668c-4960-8909-d71e8bd541c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:39.904589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9d9d2d10-668c-4960-8909-d71e8bd541c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:39.906777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9d9d2d10-668c-4960-8909-d71e8bd541c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.504828 Jul 25 19:25:39.913322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 37/86] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:40.009820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f48a53d4-bb6c-4cb6-89a4-714121293844 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:40.049612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f48a53d4-bb6c-4cb6-89a4-714121293844 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1218 microversion: 2.1 time: 0.231326 Jul 25 19:25:40.053561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 50/87] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:39 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:40.445947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-21e7fa34-31cc-4e81-99a2-b34a8101e7b6 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:40.447954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-21e7fa34-31cc-4e81-99a2-b34a8101e7b6 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:40.508699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21e7fa34-31cc-4e81-99a2-b34a8101e7b6 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:40.513914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21e7fa34-31cc-4e81-99a2-b34a8101e7b6 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:40.515185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21e7fa34-31cc-4e81-99a2-b34a8101e7b6 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:40.518737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21e7fa34-31cc-4e81-99a2-b34a8101e7b6 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:40.835103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8c37fc1b-72ee-41f1-a524-551e64cdb627 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:40.841460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8c37fc1b-72ee-41f1-a524-551e64cdb627 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:40.881828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c37fc1b-72ee-41f1-a524-551e64cdb627 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:40.888845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c37fc1b-72ee-41f1-a524-551e64cdb627 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:40.892207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c37fc1b-72ee-41f1-a524-551e64cdb627 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:40.900489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c37fc1b-72ee-41f1-a524-551e64cdb627 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:42.312409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-21e7fa34-31cc-4e81-99a2-b34a8101e7b6 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:42.324172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-21e7fa34-31cc-4e81-99a2-b34a8101e7b6 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 1.910603 Jul 25 19:25:42.325074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 38/88] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:40 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:42.325750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8c37fc1b-72ee-41f1-a524-551e64cdb627 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:42.342956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-afcc23cc-345a-4d39-98c4-ddf3af29899c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:42.347840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-afcc23cc-345a-4d39-98c4-ddf3af29899c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:42.365297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afcc23cc-345a-4d39-98c4-ddf3af29899c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:42.365876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8c37fc1b-72ee-41f1-a524-551e64cdb627 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 1.542584 Jul 25 19:25:42.367314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afcc23cc-345a-4d39-98c4-ddf3af29899c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:42.369292 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afcc23cc-345a-4d39-98c4-ddf3af29899c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:42.370381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afcc23cc-345a-4d39-98c4-ddf3af29899c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:42.377415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 51/89] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:42.391708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c953afed-908a-4660-bccf-cd47c98a8c2a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:42.392643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c953afed-908a-4660-bccf-cd47c98a8c2a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:42.407829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c953afed-908a-4660-bccf-cd47c98a8c2a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:42.411650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c953afed-908a-4660-bccf-cd47c98a8c2a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:42.412954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c953afed-908a-4660-bccf-cd47c98a8c2a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:42.413692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c953afed-908a-4660-bccf-cd47c98a8c2a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:42.623619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c953afed-908a-4660-bccf-cd47c98a8c2a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:42.639818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c953afed-908a-4660-bccf-cd47c98a8c2a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1292 microversion: 2.1 time: 0.259973 Jul 25 19:25:42.641341 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 52/90] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:42 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1292 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:43.138721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-afcc23cc-345a-4d39-98c4-ddf3af29899c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:43.153697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-afcc23cc-345a-4d39-98c4-ddf3af29899c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:43.155422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-afcc23cc-345a-4d39-98c4-ddf3af29899c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:43.157152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-afcc23cc-345a-4d39-98c4-ddf3af29899c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.829783 Jul 25 19:25:43.158183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 39/91] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:43.364094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51c0dcda-f780-4a46-a495-1ffcc57d9f39 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:43.364911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51c0dcda-f780-4a46-a495-1ffcc57d9f39 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:43.374439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c0dcda-f780-4a46-a495-1ffcc57d9f39 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:43.375038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c0dcda-f780-4a46-a495-1ffcc57d9f39 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:43.381414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-4ac88d66-b0b4-4c95-bd97-77bfa0da05bc req-cb26cdb0-5260-4654-af44-49e1c8d100ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bcfc471-41be-4079-81d3-0cf334d03888", "tag": "2eec74bc-2361-4fec-b124-95a6e3605926"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:43.389003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c0dcda-f780-4a46-a495-1ffcc57d9f39 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:43.389472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c0dcda-f780-4a46-a495-1ffcc57d9f39 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:43.413481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-4ac88d66-b0b4-4c95-bd97-77bfa0da05bc req-cb26cdb0-5260-4654-af44-49e1c8d100ac service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:43.414251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-4ac88d66-b0b4-4c95-bd97-77bfa0da05bc req-cb26cdb0-5260-4654-af44-49e1c8d100ac service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:43.451163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-4ac88d66-b0b4-4c95-bd97-77bfa0da05bc req-cb26cdb0-5260-4654-af44-49e1c8d100ac service nova] Creating event network-changed:2eec74bc-2361-4fec-b124-95a6e3605926 for instance 4bcfc471-41be-4079-81d3-0cf334d03888 on hv-cinder-85093 Jul 25 19:25:43.468824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-4ac88d66-b0b4-4c95-bd97-77bfa0da05bc req-cb26cdb0-5260-4654-af44-49e1c8d100ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091573 Jul 25 19:25:43.469758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 40/92] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:25:43.475481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ec5afac9-67c7-4a64-9e6f-1afdadb52f41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:43.476227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ec5afac9-67c7-4a64-9e6f-1afdadb52f41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:43.484700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec5afac9-67c7-4a64-9e6f-1afdadb52f41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:43.485381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec5afac9-67c7-4a64-9e6f-1afdadb52f41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:43.486426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec5afac9-67c7-4a64-9e6f-1afdadb52f41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:43.486834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec5afac9-67c7-4a64-9e6f-1afdadb52f41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:43.711168 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51c0dcda-f780-4a46-a495-1ffcc57d9f39 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:43.721551 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51c0dcda-f780-4a46-a495-1ffcc57d9f39 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.361478 Jul 25 19:25:43.722160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 53/93] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:43 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:43.728569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d7de3a72-8bae-45d5-a19a-23facb73a2fc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:43.729399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d7de3a72-8bae-45d5-a19a-23facb73a2fc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:43.736136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7de3a72-8bae-45d5-a19a-23facb73a2fc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:43.736630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7de3a72-8bae-45d5-a19a-23facb73a2fc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:43.740593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7de3a72-8bae-45d5-a19a-23facb73a2fc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:43.741095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7de3a72-8bae-45d5-a19a-23facb73a2fc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:43.758033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ec5afac9-67c7-4a64-9e6f-1afdadb52f41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:43.766767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ec5afac9-67c7-4a64-9e6f-1afdadb52f41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.295712 Jul 25 19:25:43.767711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 41/94] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:43.830647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7de3a72-8bae-45d5-a19a-23facb73a2fc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:43.845073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d7de3a72-8bae-45d5-a19a-23facb73a2fc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1280 microversion: 2.1 time: 0.121726 Jul 25 19:25:43.845678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 54/95] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:43 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1280 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:44.190635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e89d5aa3-f2c7-478c-af6b-162b465d3da6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:44.191248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e89d5aa3-f2c7-478c-af6b-162b465d3da6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:44.204433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e89d5aa3-f2c7-478c-af6b-162b465d3da6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:44.205401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e89d5aa3-f2c7-478c-af6b-162b465d3da6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:44.206861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e89d5aa3-f2c7-478c-af6b-162b465d3da6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:44.207663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e89d5aa3-f2c7-478c-af6b-162b465d3da6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:44.228663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:44.435963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e89d5aa3-f2c7-478c-af6b-162b465d3da6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:44.473883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e89d5aa3-f2c7-478c-af6b-162b465d3da6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:44.480225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e89d5aa3-f2c7-478c-af6b-162b465d3da6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:44.485002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e89d5aa3-f2c7-478c-af6b-162b465d3da6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.296870 Jul 25 19:25:44.487417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 42/96] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:44.754627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:44.762483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3ddbacb9-77e7-4634-b122-2b9479b0e408 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:44.763585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3ddbacb9-77e7-4634-b122-2b9479b0e408 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:44.771117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ddbacb9-77e7-4634-b122-2b9479b0e408 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:44.772930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ddbacb9-77e7-4634-b122-2b9479b0e408 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:44.777511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ddbacb9-77e7-4634-b122-2b9479b0e408 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:44.779316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ddbacb9-77e7-4634-b122-2b9479b0e408 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:44.798379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-94dba73a-780f-483e-8eab-e4c283e73414 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:44.800255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-94dba73a-780f-483e-8eab-e4c283e73414 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:44.820460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94dba73a-780f-483e-8eab-e4c283e73414 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:44.822467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94dba73a-780f-483e-8eab-e4c283e73414 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:44.824948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94dba73a-780f-483e-8eab-e4c283e73414 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:44.826196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94dba73a-780f-483e-8eab-e4c283e73414 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:45.267571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3ddbacb9-77e7-4634-b122-2b9479b0e408 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:45.282967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3ddbacb9-77e7-4634-b122-2b9479b0e408 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.529745 Jul 25 19:25:45.297952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 55/97] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:44 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:45.311975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-94dba73a-780f-483e-8eab-e4c283e73414 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:45.315549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-94dba73a-780f-483e-8eab-e4c283e73414 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.527074 Jul 25 19:25:45.317485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 43/98] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:45.331072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a1831642-c6e9-45d0-819f-3b12298b4218 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:45.332247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a1831642-c6e9-45d0-819f-3b12298b4218 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:45.351050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:45.357029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1831642-c6e9-45d0-819f-3b12298b4218 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:45.357857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1831642-c6e9-45d0-819f-3b12298b4218 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:45.359343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1831642-c6e9-45d0-819f-3b12298b4218 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:45.360091 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1831642-c6e9-45d0-819f-3b12298b4218 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:45.485006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1831642-c6e9-45d0-819f-3b12298b4218 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:45.495955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a1831642-c6e9-45d0-819f-3b12298b4218 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1280 microversion: 2.1 time: 0.196117 Jul 25 19:25:45.497919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 56/99] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:45 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1280 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:45.516789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-145f5fd1-03da-47d3-bb44-220a659015a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:45.517690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-145f5fd1-03da-47d3-bb44-220a659015a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:45.532191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-145f5fd1-03da-47d3-bb44-220a659015a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:45.533946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-145f5fd1-03da-47d3-bb44-220a659015a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:45.536109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-145f5fd1-03da-47d3-bb44-220a659015a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:45.539151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-145f5fd1-03da-47d3-bb44-220a659015a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:45.859424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-145f5fd1-03da-47d3-bb44-220a659015a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:45.884580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-145f5fd1-03da-47d3-bb44-220a659015a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:45.888095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-145f5fd1-03da-47d3-bb44-220a659015a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:45.890292 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-145f5fd1-03da-47d3-bb44-220a659015a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.381040 Jul 25 19:25:45.891367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 44/100] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:46.344186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0db79a71-2d5c-418d-a18b-53aa647120e3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:46.345277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0db79a71-2d5c-418d-a18b-53aa647120e3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:46.358051 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0db79a71-2d5c-418d-a18b-53aa647120e3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:46.358815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0db79a71-2d5c-418d-a18b-53aa647120e3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:46.360240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0db79a71-2d5c-418d-a18b-53aa647120e3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:46.360845 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-585cf021-eb41-421a-875f-7a44a3503194 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:46.361065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0db79a71-2d5c-418d-a18b-53aa647120e3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:46.363087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-585cf021-eb41-421a-875f-7a44a3503194 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:46.378564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585cf021-eb41-421a-875f-7a44a3503194 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:46.379881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585cf021-eb41-421a-875f-7a44a3503194 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:46.381946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585cf021-eb41-421a-875f-7a44a3503194 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:46.384155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585cf021-eb41-421a-875f-7a44a3503194 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:46.734622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0db79a71-2d5c-418d-a18b-53aa647120e3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:46.748640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-585cf021-eb41-421a-875f-7a44a3503194 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:46.761615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0db79a71-2d5c-418d-a18b-53aa647120e3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.424198 Jul 25 19:25:46.763331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 57/101] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:46 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:46.772273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-60fcd75e-394c-4dc6-80c7-5607322b0c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:46.773377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-60fcd75e-394c-4dc6-80c7-5607322b0c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:46.783801 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-585cf021-eb41-421a-875f-7a44a3503194 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.433391 Jul 25 19:25:46.786476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 45/102] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:46.788296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60fcd75e-394c-4dc6-80c7-5607322b0c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:46.791152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60fcd75e-394c-4dc6-80c7-5607322b0c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:46.794001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60fcd75e-394c-4dc6-80c7-5607322b0c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:46.796955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60fcd75e-394c-4dc6-80c7-5607322b0c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:46.918614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60fcd75e-394c-4dc6-80c7-5607322b0c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:46.935040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-60fcd75e-394c-4dc6-80c7-5607322b0c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1280 microversion: 2.1 time: 0.168251 Jul 25 19:25:46.937006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 58/103] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:46 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1280 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:46.944157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-27906d34-f3a2-437b-8e66-a997afa328ca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:46.945375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-27906d34-f3a2-437b-8e66-a997afa328ca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:46.965248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27906d34-f3a2-437b-8e66-a997afa328ca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:46.965248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27906d34-f3a2-437b-8e66-a997afa328ca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:46.965248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27906d34-f3a2-437b-8e66-a997afa328ca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:46.965248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27906d34-f3a2-437b-8e66-a997afa328ca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:47.204248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-27906d34-f3a2-437b-8e66-a997afa328ca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:47.220405 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-27906d34-f3a2-437b-8e66-a997afa328ca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:47.222534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-27906d34-f3a2-437b-8e66-a997afa328ca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:47.224295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-27906d34-f3a2-437b-8e66-a997afa328ca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.289152 Jul 25 19:25:47.225157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 46/104] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:25:47.801536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a1b3e7f6-c9ed-497c-816d-098c24c9e3bb tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:47.802357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a1b3e7f6-c9ed-497c-816d-098c24c9e3bb tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:47.812937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1b3e7f6-c9ed-497c-816d-098c24c9e3bb tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:47.813660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1b3e7f6-c9ed-497c-816d-098c24c9e3bb tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:47.815014 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1b3e7f6-c9ed-497c-816d-098c24c9e3bb tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:47.815726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1b3e7f6-c9ed-497c-816d-098c24c9e3bb tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:47.828320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-db1f0e62-9071-450f-a45a-b3fef5101267 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:47.830559 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-db1f0e62-9071-450f-a45a-b3fef5101267 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:47.846888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db1f0e62-9071-450f-a45a-b3fef5101267 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:47.847771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db1f0e62-9071-450f-a45a-b3fef5101267 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:47.849453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db1f0e62-9071-450f-a45a-b3fef5101267 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:47.850255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db1f0e62-9071-450f-a45a-b3fef5101267 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:48.147786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1b3e7f6-c9ed-497c-816d-098c24c9e3bb tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:48.172145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a1b3e7f6-c9ed-497c-816d-098c24c9e3bb tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.368415 Jul 25 19:25:48.174014 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 59/105] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:47 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:48.183669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bce931b8-b81d-496e-8a7f-d857102ef0f6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:48.184977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bce931b8-b81d-496e-8a7f-d857102ef0f6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:48.197358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bce931b8-b81d-496e-8a7f-d857102ef0f6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:48.198632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bce931b8-b81d-496e-8a7f-d857102ef0f6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:48.200293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bce931b8-b81d-496e-8a7f-d857102ef0f6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:48.200789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bce931b8-b81d-496e-8a7f-d857102ef0f6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:48.208970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-db1f0e62-9071-450f-a45a-b3fef5101267 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:48.224597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-db1f0e62-9071-450f-a45a-b3fef5101267 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.405915 Jul 25 19:25:48.228093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 47/106] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:48.251651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3da8131b-c21d-4b9c-ad76-b54363fd6de3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:48.256889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3da8131b-c21d-4b9c-ad76-b54363fd6de3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:48.270148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3da8131b-c21d-4b9c-ad76-b54363fd6de3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:48.270957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3da8131b-c21d-4b9c-ad76-b54363fd6de3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:48.272540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3da8131b-c21d-4b9c-ad76-b54363fd6de3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:48.273549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3da8131b-c21d-4b9c-ad76-b54363fd6de3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:48.335862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bce931b8-b81d-496e-8a7f-d857102ef0f6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:48.357238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bce931b8-b81d-496e-8a7f-d857102ef0f6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1280 microversion: 2.1 time: 0.180133 Jul 25 19:25:48.358689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 60/107] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:48 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1280 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:48.539097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3da8131b-c21d-4b9c-ad76-b54363fd6de3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:48.553867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3da8131b-c21d-4b9c-ad76-b54363fd6de3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:48.557437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3da8131b-c21d-4b9c-ad76-b54363fd6de3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:48.559706 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3da8131b-c21d-4b9c-ad76-b54363fd6de3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.311680 Jul 25 19:25:48.560631 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 48/108] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:48 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:25:49.217292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b240915-fa68-4189-8ed2-389e2e2f3234 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:49.218790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b240915-fa68-4189-8ed2-389e2e2f3234 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:49.233375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b240915-fa68-4189-8ed2-389e2e2f3234 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:49.234488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b240915-fa68-4189-8ed2-389e2e2f3234 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:49.236494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b240915-fa68-4189-8ed2-389e2e2f3234 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:49.238018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b240915-fa68-4189-8ed2-389e2e2f3234 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:49.264692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ff604301-16ea-4b5b-9f82-76cd3e2b2fac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:49.265749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ff604301-16ea-4b5b-9f82-76cd3e2b2fac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:49.296794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff604301-16ea-4b5b-9f82-76cd3e2b2fac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:49.298875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff604301-16ea-4b5b-9f82-76cd3e2b2fac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:49.300481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff604301-16ea-4b5b-9f82-76cd3e2b2fac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:49.301124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff604301-16ea-4b5b-9f82-76cd3e2b2fac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:49.730469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b240915-fa68-4189-8ed2-389e2e2f3234 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:49.745877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b240915-fa68-4189-8ed2-389e2e2f3234 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.542326 Jul 25 19:25:49.746860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 61/109] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:49 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:49.755118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0260abf7-9b2a-4fa2-b498-5fef846bc4d5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:49.756310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0260abf7-9b2a-4fa2-b498-5fef846bc4d5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:49.770005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0260abf7-9b2a-4fa2-b498-5fef846bc4d5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:49.770762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0260abf7-9b2a-4fa2-b498-5fef846bc4d5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:49.773132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0260abf7-9b2a-4fa2-b498-5fef846bc4d5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:49.774032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0260abf7-9b2a-4fa2-b498-5fef846bc4d5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:49.808736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ff604301-16ea-4b5b-9f82-76cd3e2b2fac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:49.820024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ff604301-16ea-4b5b-9f82-76cd3e2b2fac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.562607 Jul 25 19:25:49.821512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 49/110] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:49.830500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-da6be841-2ed0-4982-86e5-4505936c7403 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:49.832167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-da6be841-2ed0-4982-86e5-4505936c7403 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:49.846398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da6be841-2ed0-4982-86e5-4505936c7403 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:49.847469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da6be841-2ed0-4982-86e5-4505936c7403 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:49.849147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da6be841-2ed0-4982-86e5-4505936c7403 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:49.849917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da6be841-2ed0-4982-86e5-4505936c7403 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:49.932076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0260abf7-9b2a-4fa2-b498-5fef846bc4d5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:49.955866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0260abf7-9b2a-4fa2-b498-5fef846bc4d5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1280 microversion: 2.1 time: 0.206835 Jul 25 19:25:49.967608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 62/111] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:49 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1280 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:50.215952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da6be841-2ed0-4982-86e5-4505936c7403 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:50.237903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da6be841-2ed0-4982-86e5-4505936c7403 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:50.242255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da6be841-2ed0-4982-86e5-4505936c7403 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:50.246470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-da6be841-2ed0-4982-86e5-4505936c7403 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.422730 Jul 25 19:25:50.247906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 50/112] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:50.785242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4366c3b2-aa8d-4222-9c62-5ee2038548de tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:50.785959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4366c3b2-aa8d-4222-9c62-5ee2038548de tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:50.802487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4366c3b2-aa8d-4222-9c62-5ee2038548de tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:50.803235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4366c3b2-aa8d-4222-9c62-5ee2038548de tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:50.804270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4366c3b2-aa8d-4222-9c62-5ee2038548de tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:50.804904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4366c3b2-aa8d-4222-9c62-5ee2038548de tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:50.846086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fa65a974-d8e4-4a9b-8494-7ff1370aec8c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:50.846950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fa65a974-d8e4-4a9b-8494-7ff1370aec8c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:50.864441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa65a974-d8e4-4a9b-8494-7ff1370aec8c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:50.864883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa65a974-d8e4-4a9b-8494-7ff1370aec8c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:50.865896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa65a974-d8e4-4a9b-8494-7ff1370aec8c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:50.866699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa65a974-d8e4-4a9b-8494-7ff1370aec8c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:50.878489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:51.830287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fa65a974-d8e4-4a9b-8494-7ff1370aec8c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:51.859796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fa65a974-d8e4-4a9b-8494-7ff1370aec8c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 1.018392 Jul 25 19:25:51.864251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 51/113] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:51.879771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a10c8516-7c4b-434c-b7e3-ec189b4daa61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:51.885104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a10c8516-7c4b-434c-b7e3-ec189b4daa61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:51.895065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4366c3b2-aa8d-4222-9c62-5ee2038548de tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:51.895965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a10c8516-7c4b-434c-b7e3-ec189b4daa61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:51.896695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a10c8516-7c4b-434c-b7e3-ec189b4daa61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:51.898260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a10c8516-7c4b-434c-b7e3-ec189b4daa61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:51.899240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a10c8516-7c4b-434c-b7e3-ec189b4daa61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:51.933152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4366c3b2-aa8d-4222-9c62-5ee2038548de tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 1.143455 Jul 25 19:25:51.934715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 63/114] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:50 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:51.951640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0138433-c64a-4891-aa61-07abcb90278c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:51.953884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d0138433-c64a-4891-aa61-07abcb90278c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:51.978552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0138433-c64a-4891-aa61-07abcb90278c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:51.981716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0138433-c64a-4891-aa61-07abcb90278c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:51.983055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0138433-c64a-4891-aa61-07abcb90278c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:51.983917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0138433-c64a-4891-aa61-07abcb90278c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:52.422532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d0138433-c64a-4891-aa61-07abcb90278c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:52.433619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a10c8516-7c4b-434c-b7e3-ec189b4daa61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:52.447824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a10c8516-7c4b-434c-b7e3-ec189b4daa61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.581224 Jul 25 19:25:52.448937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 52/115] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:51 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:52.451058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d0138433-c64a-4891-aa61-07abcb90278c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:52.454925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d0138433-c64a-4891-aa61-07abcb90278c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:52.457167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d0138433-c64a-4891-aa61-07abcb90278c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.520603 Jul 25 19:25:52.458239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 64/116] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:52.891890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0d250e0e-bff9-4b0e-b1c2-21ee067b78d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:52.892742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0d250e0e-bff9-4b0e-b1c2-21ee067b78d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:52.903846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d250e0e-bff9-4b0e-b1c2-21ee067b78d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:52.904612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d250e0e-bff9-4b0e-b1c2-21ee067b78d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:52.905561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d250e0e-bff9-4b0e-b1c2-21ee067b78d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:52.906034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d250e0e-bff9-4b0e-b1c2-21ee067b78d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:52.946783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-93273098-24de-48a6-95bd-df766ca61a02 req-00cbf01d-a779-44d9-aaf0-53ccc9b216cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330d9ed8-749b-4f5b-9128-ee1dfda6c899", "tag": "10478694-66f5-4da9-97eb-15b49a4ea4db"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:52.965827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-93273098-24de-48a6-95bd-df766ca61a02 req-00cbf01d-a779-44d9-aaf0-53ccc9b216cf service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:52.966760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-93273098-24de-48a6-95bd-df766ca61a02 req-00cbf01d-a779-44d9-aaf0-53ccc9b216cf service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:52.991983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-93273098-24de-48a6-95bd-df766ca61a02 req-00cbf01d-a779-44d9-aaf0-53ccc9b216cf service nova] Creating event network-changed:10478694-66f5-4da9-97eb-15b49a4ea4db for instance 330d9ed8-749b-4f5b-9128-ee1dfda6c899 on hv-cinder-85093 Jul 25 19:25:53.015200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-93273098-24de-48a6-95bd-df766ca61a02 req-00cbf01d-a779-44d9-aaf0-53ccc9b216cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071914 Jul 25 19:25:53.016677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 65/117] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:25:53.028338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2bb9abfa-2441-438a-879c-3356f1e2a1f1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:53.029755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2bb9abfa-2441-438a-879c-3356f1e2a1f1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:53.045739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bb9abfa-2441-438a-879c-3356f1e2a1f1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:53.046569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bb9abfa-2441-438a-879c-3356f1e2a1f1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:53.048883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bb9abfa-2441-438a-879c-3356f1e2a1f1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:53.049950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bb9abfa-2441-438a-879c-3356f1e2a1f1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:53.311882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0d250e0e-bff9-4b0e-b1c2-21ee067b78d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:53.329852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0d250e0e-bff9-4b0e-b1c2-21ee067b78d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.442141 Jul 25 19:25:53.330733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 53/118] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:52 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:53.355981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2bb9abfa-2441-438a-879c-3356f1e2a1f1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:53.366702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2bb9abfa-2441-438a-879c-3356f1e2a1f1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.348286 Jul 25 19:25:53.367394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 66/119] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:53 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:53.489392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c95854c6-ac28-49b5-a68d-27506b45ee6c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:53.490179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c95854c6-ac28-49b5-a68d-27506b45ee6c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:53.498071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3a6c3afc-8f1e-4e9e-b24c-0ca57c56e958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:53.499315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3a6c3afc-8f1e-4e9e-b24c-0ca57c56e958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:53.503255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c95854c6-ac28-49b5-a68d-27506b45ee6c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:53.504116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c95854c6-ac28-49b5-a68d-27506b45ee6c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:53.505550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c95854c6-ac28-49b5-a68d-27506b45ee6c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:53.506597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c95854c6-ac28-49b5-a68d-27506b45ee6c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:53.510057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a6c3afc-8f1e-4e9e-b24c-0ca57c56e958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:53.510757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a6c3afc-8f1e-4e9e-b24c-0ca57c56e958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:53.512083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a6c3afc-8f1e-4e9e-b24c-0ca57c56e958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:53.514151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a6c3afc-8f1e-4e9e-b24c-0ca57c56e958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:53.873009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c95854c6-ac28-49b5-a68d-27506b45ee6c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:53.888112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c95854c6-ac28-49b5-a68d-27506b45ee6c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.406603 Jul 25 19:25:53.889084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 54/120] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:53 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:53.897837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3a6c3afc-8f1e-4e9e-b24c-0ca57c56e958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:53.916965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3a6c3afc-8f1e-4e9e-b24c-0ca57c56e958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:53.922449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3a6c3afc-8f1e-4e9e-b24c-0ca57c56e958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:53.925394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3a6c3afc-8f1e-4e9e-b24c-0ca57c56e958 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.433676 Jul 25 19:25:53.929499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 67/121] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:25:54.360364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9e4a57ba-a292-473d-a8b1-bde844178b03 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:54.361521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9e4a57ba-a292-473d-a8b1-bde844178b03 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:54.382439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e4a57ba-a292-473d-a8b1-bde844178b03 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:54.383242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e4a57ba-a292-473d-a8b1-bde844178b03 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:54.395349 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b20bf8e4-175e-4fda-a804-3a6c42b5f425 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:54.396582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b20bf8e4-175e-4fda-a804-3a6c42b5f425 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:54.409361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e4a57ba-a292-473d-a8b1-bde844178b03 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:54.410193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e4a57ba-a292-473d-a8b1-bde844178b03 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:54.430089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b20bf8e4-175e-4fda-a804-3a6c42b5f425 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:54.430967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b20bf8e4-175e-4fda-a804-3a6c42b5f425 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:54.439691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b20bf8e4-175e-4fda-a804-3a6c42b5f425 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:54.440522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b20bf8e4-175e-4fda-a804-3a6c42b5f425 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:55.330660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b20bf8e4-175e-4fda-a804-3a6c42b5f425 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:55.344568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b20bf8e4-175e-4fda-a804-3a6c42b5f425 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.956401 Jul 25 19:25:55.355943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 68/122] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:54 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:55.355943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8a0070c-2ec9-4346-adf5-2ddf1ffc23bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:55.355943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8a0070c-2ec9-4346-adf5-2ddf1ffc23bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:55.373530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8a0070c-2ec9-4346-adf5-2ddf1ffc23bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:55.373530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8a0070c-2ec9-4346-adf5-2ddf1ffc23bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:55.374531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8a0070c-2ec9-4346-adf5-2ddf1ffc23bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:55.374531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8a0070c-2ec9-4346-adf5-2ddf1ffc23bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:55.404175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9e4a57ba-a292-473d-a8b1-bde844178b03 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:55.426491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9e4a57ba-a292-473d-a8b1-bde844178b03 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 1.074062 Jul 25 19:25:55.431913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 55/123] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:55.442894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0f1051f7-67f4-4d25-97c0-3d3046a3f4ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:55.447941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0f1051f7-67f4-4d25-97c0-3d3046a3f4ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:55.467418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f1051f7-67f4-4d25-97c0-3d3046a3f4ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:55.468390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f1051f7-67f4-4d25-97c0-3d3046a3f4ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:55.471459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f1051f7-67f4-4d25-97c0-3d3046a3f4ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:55.472523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f1051f7-67f4-4d25-97c0-3d3046a3f4ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:55.844157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a8a0070c-2ec9-4346-adf5-2ddf1ffc23bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:55.888978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8a0070c-2ec9-4346-adf5-2ddf1ffc23bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.542218 Jul 25 19:25:55.921124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 69/124] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:55 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:56.166219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0f1051f7-67f4-4d25-97c0-3d3046a3f4ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:56.188199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0f1051f7-67f4-4d25-97c0-3d3046a3f4ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:56.191228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0f1051f7-67f4-4d25-97c0-3d3046a3f4ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:56.193386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0f1051f7-67f4-4d25-97c0-3d3046a3f4ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.757546 Jul 25 19:25:56.212664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 56/125] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:56.387882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b15b44eb-90b5-4d25-bdc7-71a9f6c13238 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:56.389151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b15b44eb-90b5-4d25-bdc7-71a9f6c13238 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:56.425449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b15b44eb-90b5-4d25-bdc7-71a9f6c13238 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.426344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b15b44eb-90b5-4d25-bdc7-71a9f6c13238 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.427930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b15b44eb-90b5-4d25-bdc7-71a9f6c13238 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.428743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b15b44eb-90b5-4d25-bdc7-71a9f6c13238 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.477288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-97eab427-bea7-42f8-a6dd-b28fa109c9b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:56.483222 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-97eab427-bea7-42f8-a6dd-b28fa109c9b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:56.512907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97eab427-bea7-42f8-a6dd-b28fa109c9b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.530429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97eab427-bea7-42f8-a6dd-b28fa109c9b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.532216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97eab427-bea7-42f8-a6dd-b28fa109c9b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.533562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97eab427-bea7-42f8-a6dd-b28fa109c9b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.921071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b15b44eb-90b5-4d25-bdc7-71a9f6c13238 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:56.937834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b15b44eb-90b5-4d25-bdc7-71a9f6c13238 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.562915 Jul 25 19:25:56.938909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 70/126] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:56 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:56.951731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-49d528e0-46df-43d9-a3e7-9c5e28704442 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:56.953841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-49d528e0-46df-43d9-a3e7-9c5e28704442 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:56.968285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-97eab427-bea7-42f8-a6dd-b28fa109c9b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:56.972068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49d528e0-46df-43d9-a3e7-9c5e28704442 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.972978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49d528e0-46df-43d9-a3e7-9c5e28704442 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.974455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49d528e0-46df-43d9-a3e7-9c5e28704442 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.975498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49d528e0-46df-43d9-a3e7-9c5e28704442 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.987804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-97eab427-bea7-42f8-a6dd-b28fa109c9b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.519314 Jul 25 19:25:56.989124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 57/127] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:57.235139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c05cd5df-f7ac-4c4d-95e6-994a1b681016 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:57.241928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c05cd5df-f7ac-4c4d-95e6-994a1b681016 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:57.272644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c05cd5df-f7ac-4c4d-95e6-994a1b681016 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:57.273514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c05cd5df-f7ac-4c4d-95e6-994a1b681016 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:57.275163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c05cd5df-f7ac-4c4d-95e6-994a1b681016 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:57.276131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c05cd5df-f7ac-4c4d-95e6-994a1b681016 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:57.631132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-49d528e0-46df-43d9-a3e7-9c5e28704442 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:57.654240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-49d528e0-46df-43d9-a3e7-9c5e28704442 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.710368 Jul 25 19:25:57.665714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 71/128] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:56 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:57.756244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c05cd5df-f7ac-4c4d-95e6-994a1b681016 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:57.779670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c05cd5df-f7ac-4c4d-95e6-994a1b681016 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:57.782796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c05cd5df-f7ac-4c4d-95e6-994a1b681016 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:57.785028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c05cd5df-f7ac-4c4d-95e6-994a1b681016 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.561791 Jul 25 19:25:57.786060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 58/129] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:57.972023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4c3d7f54-2950-43ed-8366-68d570c6f7ab tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:57.976457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4c3d7f54-2950-43ed-8366-68d570c6f7ab tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:58.002074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c3d7f54-2950-43ed-8366-68d570c6f7ab tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:58.014712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c3d7f54-2950-43ed-8366-68d570c6f7ab tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:58.017864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c3d7f54-2950-43ed-8366-68d570c6f7ab tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:58.043167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c3d7f54-2950-43ed-8366-68d570c6f7ab tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:58.047387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8b705c31-37fd-4be2-87ef-65ad6eeb9eca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:58.050841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8b705c31-37fd-4be2-87ef-65ad6eeb9eca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:58.081730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8b705c31-37fd-4be2-87ef-65ad6eeb9eca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:58.082453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8b705c31-37fd-4be2-87ef-65ad6eeb9eca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:58.084121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8b705c31-37fd-4be2-87ef-65ad6eeb9eca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:58.086089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8b705c31-37fd-4be2-87ef-65ad6eeb9eca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:58.102024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:58.439746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4c3d7f54-2950-43ed-8366-68d570c6f7ab tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:58.459090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8b705c31-37fd-4be2-87ef-65ad6eeb9eca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:58.467017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4c3d7f54-2950-43ed-8366-68d570c6f7ab tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.506557 Jul 25 19:25:58.471156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 72/130] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:57 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:58.485996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8b705c31-37fd-4be2-87ef-65ad6eeb9eca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.464913 Jul 25 19:25:58.490439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 59/131] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:58.694309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8399acda-480f-4902-9a72-8084a2031526 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:58.698617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8399acda-480f-4902-9a72-8084a2031526 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:58.712948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8399acda-480f-4902-9a72-8084a2031526 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:58.714364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8399acda-480f-4902-9a72-8084a2031526 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:58.716034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8399acda-480f-4902-9a72-8084a2031526 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:58.716843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8399acda-480f-4902-9a72-8084a2031526 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:58.782998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-cc0d8d73-acd5-4fe2-b26b-e9d86a0f935f req-1a62e0c4-b0b0-4497-abd7-dd522d3f87df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1007369a-dd3c-4837-95f4-e8326d600031", "name": "network-vif-plugged", "status": "completed", "tag": "33faefb9-12a5-4e86-b189-357d316c5553"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:58.806709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-cc0d8d73-acd5-4fe2-b26b-e9d86a0f935f req-1a62e0c4-b0b0-4497-abd7-dd522d3f87df service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:58.807536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-cc0d8d73-acd5-4fe2-b26b-e9d86a0f935f req-1a62e0c4-b0b0-4497-abd7-dd522d3f87df service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:58.829172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-cc0d8d73-acd5-4fe2-b26b-e9d86a0f935f req-1a62e0c4-b0b0-4497-abd7-dd522d3f87df service nova] Creating event network-vif-plugged:33faefb9-12a5-4e86-b189-357d316c5553 for instance 1007369a-dd3c-4837-95f4-e8326d600031 on hv-cinder-85093 Jul 25 19:25:58.840062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-cc0d8d73-acd5-4fe2-b26b-e9d86a0f935f req-1a62e0c4-b0b0-4497-abd7-dd522d3f87df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.363632 Jul 25 19:25:58.848663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 73/132] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:25:58.860439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2794da13-86b2-4415-a276-fca09275161d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:58.862371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2794da13-86b2-4415-a276-fca09275161d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:58.877469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2794da13-86b2-4415-a276-fca09275161d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:58.878428 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2794da13-86b2-4415-a276-fca09275161d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:58.880262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2794da13-86b2-4415-a276-fca09275161d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:58.881382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2794da13-86b2-4415-a276-fca09275161d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:59.157584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8399acda-480f-4902-9a72-8084a2031526 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:59.182392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8399acda-480f-4902-9a72-8084a2031526 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.496280 Jul 25 19:25:59.183256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 60/133] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:58 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:25:59.233645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2794da13-86b2-4415-a276-fca09275161d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:59.244206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2794da13-86b2-4415-a276-fca09275161d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:59.246323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2794da13-86b2-4415-a276-fca09275161d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:59.247906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2794da13-86b2-4415-a276-fca09275161d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.397068 Jul 25 19:25:59.248598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 74/134] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:25:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:25:59.521492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c75d67c-3297-4373-b44e-dd47f1ee44f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:59.524937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ae40435b-5ff9-4240-90d3-be766d403a50 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:59.526183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7c75d67c-3297-4373-b44e-dd47f1ee44f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:59.533092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ae40435b-5ff9-4240-90d3-be766d403a50 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:59.557969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c75d67c-3297-4373-b44e-dd47f1ee44f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:59.558751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c75d67c-3297-4373-b44e-dd47f1ee44f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:59.560630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c75d67c-3297-4373-b44e-dd47f1ee44f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:59.561673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c75d67c-3297-4373-b44e-dd47f1ee44f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:59.575334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae40435b-5ff9-4240-90d3-be766d403a50 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:59.576133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae40435b-5ff9-4240-90d3-be766d403a50 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:59.577479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae40435b-5ff9-4240-90d3-be766d403a50 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:59.579427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae40435b-5ff9-4240-90d3-be766d403a50 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:00.095867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7c75d67c-3297-4373-b44e-dd47f1ee44f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:00.112156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c75d67c-3297-4373-b44e-dd47f1ee44f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.598333 Jul 25 19:26:00.114408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ae40435b-5ff9-4240-90d3-be766d403a50 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:00.128890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 75/135] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:00.137281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ae40435b-5ff9-4240-90d3-be766d403a50 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.641396 Jul 25 19:26:00.155810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 61/136] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:59 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:00.211033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ed68b317-69ae-4143-b38a-6eebcc0b6bea tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:00.213325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ed68b317-69ae-4143-b38a-6eebcc0b6bea tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:00.227573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed68b317-69ae-4143-b38a-6eebcc0b6bea tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:00.228373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed68b317-69ae-4143-b38a-6eebcc0b6bea tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:00.230462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed68b317-69ae-4143-b38a-6eebcc0b6bea tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:00.231209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed68b317-69ae-4143-b38a-6eebcc0b6bea tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:00.298432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a8b10da0-5cf4-467c-a4fb-9cafcd651f96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:00.299566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a8b10da0-5cf4-467c-a4fb-9cafcd651f96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:00.310725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=72 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:00.315030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8b10da0-5cf4-467c-a4fb-9cafcd651f96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:00.316100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8b10da0-5cf4-467c-a4fb-9cafcd651f96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:00.317819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8b10da0-5cf4-467c-a4fb-9cafcd651f96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:00.318893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8b10da0-5cf4-467c-a4fb-9cafcd651f96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:00.666183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ed68b317-69ae-4143-b38a-6eebcc0b6bea tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:00.704862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ed68b317-69ae-4143-b38a-6eebcc0b6bea tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.500136 Jul 25 19:26:00.708666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 76/137] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:00 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:00.780211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a8b10da0-5cf4-467c-a4fb-9cafcd651f96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:00.796050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a8b10da0-5cf4-467c-a4fb-9cafcd651f96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:00.798046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a8b10da0-5cf4-467c-a4fb-9cafcd651f96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:00.799490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a8b10da0-5cf4-467c-a4fb-9cafcd651f96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.510004 Jul 25 19:26:00.800702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 62/138] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:26:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:26:01.156452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f0c2df8a-0a43-42de-8520-55ce941157e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:01.160703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f0c2df8a-0a43-42de-8520-55ce941157e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:01.185401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f5160dcd-c0fd-4f0c-92c9-4836e2625f00 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:01.186514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f5160dcd-c0fd-4f0c-92c9-4836e2625f00 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:01.204094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0c2df8a-0a43-42de-8520-55ce941157e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:01.212618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0c2df8a-0a43-42de-8520-55ce941157e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:01.233603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0c2df8a-0a43-42de-8520-55ce941157e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:01.239154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5160dcd-c0fd-4f0c-92c9-4836e2625f00 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:01.240062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0c2df8a-0a43-42de-8520-55ce941157e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:01.252975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5160dcd-c0fd-4f0c-92c9-4836e2625f00 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:01.254391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5160dcd-c0fd-4f0c-92c9-4836e2625f00 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:01.255128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5160dcd-c0fd-4f0c-92c9-4836e2625f00 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:02.644717 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f5160dcd-c0fd-4f0c-92c9-4836e2625f00 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:02.672499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f5160dcd-c0fd-4f0c-92c9-4836e2625f00 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 1.495578 Jul 25 19:26:02.680636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 63/139] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:01 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:02.698808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-017ddf01-91c4-486d-81c8-ac8d6fce553f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:02.700133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-017ddf01-91c4-486d-81c8-ac8d6fce553f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:02.728659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-017ddf01-91c4-486d-81c8-ac8d6fce553f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:02.729603 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-017ddf01-91c4-486d-81c8-ac8d6fce553f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:02.731008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-017ddf01-91c4-486d-81c8-ac8d6fce553f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:02.731943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-017ddf01-91c4-486d-81c8-ac8d6fce553f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:02.814461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f0c2df8a-0a43-42de-8520-55ce941157e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:02.832750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f0c2df8a-0a43-42de-8520-55ce941157e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 1.683527 Jul 25 19:26:02.846838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 77/140] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:02.913465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7462a95d-0dd5-43ff-849d-3d7ad818a043 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:02.915364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7462a95d-0dd5-43ff-849d-3d7ad818a043 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:02.932004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7462a95d-0dd5-43ff-849d-3d7ad818a043 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:02.932568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7462a95d-0dd5-43ff-849d-3d7ad818a043 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:02.934263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7462a95d-0dd5-43ff-849d-3d7ad818a043 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:02.935320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7462a95d-0dd5-43ff-849d-3d7ad818a043 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:03.711116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-017ddf01-91c4-486d-81c8-ac8d6fce553f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:03.730221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-017ddf01-91c4-486d-81c8-ac8d6fce553f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 1.047819 Jul 25 19:26:03.730943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 64/141] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:02 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:03.769457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f360f9f4-81c6-4efa-a00a-1a547eb23348 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:03.770921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7462a95d-0dd5-43ff-849d-3d7ad818a043 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:03.772617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f360f9f4-81c6-4efa-a00a-1a547eb23348 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:03.788821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7462a95d-0dd5-43ff-849d-3d7ad818a043 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:03.792346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f360f9f4-81c6-4efa-a00a-1a547eb23348 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:03.792810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f360f9f4-81c6-4efa-a00a-1a547eb23348 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:03.794044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7462a95d-0dd5-43ff-849d-3d7ad818a043 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:03.794372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f360f9f4-81c6-4efa-a00a-1a547eb23348 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:03.795058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f360f9f4-81c6-4efa-a00a-1a547eb23348 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:03.797313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7462a95d-0dd5-43ff-849d-3d7ad818a043 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.910107 Jul 25 19:26:03.798594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 78/142] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:26:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:26:03.887131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-39698355-7ebd-4fdb-81bb-e600c05ee38b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:03.888148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-39698355-7ebd-4fdb-81bb-e600c05ee38b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:03.901403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39698355-7ebd-4fdb-81bb-e600c05ee38b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:03.905497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39698355-7ebd-4fdb-81bb-e600c05ee38b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:03.906802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39698355-7ebd-4fdb-81bb-e600c05ee38b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:03.908198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39698355-7ebd-4fdb-81bb-e600c05ee38b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:04.166676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f360f9f4-81c6-4efa-a00a-1a547eb23348 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:04.201783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f360f9f4-81c6-4efa-a00a-1a547eb23348 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.448585 Jul 25 19:26:04.205111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 65/143] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:03 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:04.226303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-587ca636-908c-4232-b970-b04b8fce7c21 req-43aefdfc-8bcc-41db-9c2b-338f3d41a1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad9c400-6df9-49ac-a7e5-e9336446af9e", "name": "network-vif-plugged", "status": "completed", "tag": "75adfdc2-df4c-4810-bd2e-e056db5829f5"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:04.261864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-587ca636-908c-4232-b970-b04b8fce7c21 req-43aefdfc-8bcc-41db-9c2b-338f3d41a1f4 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:04.262592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-587ca636-908c-4232-b970-b04b8fce7c21 req-43aefdfc-8bcc-41db-9c2b-338f3d41a1f4 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:04.305339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-587ca636-908c-4232-b970-b04b8fce7c21 req-43aefdfc-8bcc-41db-9c2b-338f3d41a1f4 service nova] Creating event network-vif-plugged:75adfdc2-df4c-4810-bd2e-e056db5829f5 for instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e on hv-cinder-85093 Jul 25 19:26:04.328212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-587ca636-908c-4232-b970-b04b8fce7c21 req-43aefdfc-8bcc-41db-9c2b-338f3d41a1f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119898 Jul 25 19:26:04.330997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 66/144] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:04.379418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-39698355-7ebd-4fdb-81bb-e600c05ee38b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:04.406003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-39698355-7ebd-4fdb-81bb-e600c05ee38b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.524195 Jul 25 19:26:04.412085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 79/145] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:03 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:04.767935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-43d33f3f-d440-4b7f-b964-5e17d6940f89 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:04.769244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-43d33f3f-d440-4b7f-b964-5e17d6940f89 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:04.780561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43d33f3f-d440-4b7f-b964-5e17d6940f89 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:04.781407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43d33f3f-d440-4b7f-b964-5e17d6940f89 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:04.784699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43d33f3f-d440-4b7f-b964-5e17d6940f89 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:04.785466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43d33f3f-d440-4b7f-b964-5e17d6940f89 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:04.841134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4683802e-5a1f-433a-bb20-0cb5bdb7204e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:04.842186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4683802e-5a1f-433a-bb20-0cb5bdb7204e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:04.860791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4683802e-5a1f-433a-bb20-0cb5bdb7204e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:04.861442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4683802e-5a1f-433a-bb20-0cb5bdb7204e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:04.862938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4683802e-5a1f-433a-bb20-0cb5bdb7204e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:04.864253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4683802e-5a1f-433a-bb20-0cb5bdb7204e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:05.491479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-43d33f3f-d440-4b7f-b964-5e17d6940f89 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:05.505583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-43d33f3f-d440-4b7f-b964-5e17d6940f89 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.745973 Jul 25 19:26:05.519768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4683802e-5a1f-433a-bb20-0cb5bdb7204e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:05.545182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 67/146] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:04 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:05.566030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-254f43df-76ad-40f5-aed6-818defb80875 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:05.569475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-254f43df-76ad-40f5-aed6-818defb80875 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:05.598382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4683802e-5a1f-433a-bb20-0cb5bdb7204e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:05.601961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4683802e-5a1f-433a-bb20-0cb5bdb7204e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:05.605498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-254f43df-76ad-40f5-aed6-818defb80875 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:05.605937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-254f43df-76ad-40f5-aed6-818defb80875 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:05.607489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-254f43df-76ad-40f5-aed6-818defb80875 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:05.613615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-254f43df-76ad-40f5-aed6-818defb80875 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:05.615384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4683802e-5a1f-433a-bb20-0cb5bdb7204e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 0.775053 Jul 25 19:26:05.623759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 80/147] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:26:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:26:05.659413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e94f8f5-7fe9-48be-b46e-7ba49d734365 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:05.666351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e94f8f5-7fe9-48be-b46e-7ba49d734365 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:05.696771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e94f8f5-7fe9-48be-b46e-7ba49d734365 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:05.697977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e94f8f5-7fe9-48be-b46e-7ba49d734365 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:05.706282 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e94f8f5-7fe9-48be-b46e-7ba49d734365 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:05.707594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e94f8f5-7fe9-48be-b46e-7ba49d734365 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:05.781682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:06.280618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7e94f8f5-7fe9-48be-b46e-7ba49d734365 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:06.308006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e94f8f5-7fe9-48be-b46e-7ba49d734365 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.680652 Jul 25 19:26:06.309070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 81/148] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:06.319440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-254f43df-76ad-40f5-aed6-818defb80875 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:06.336123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-254f43df-76ad-40f5-aed6-818defb80875 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.788999 Jul 25 19:26:06.338484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 68/149] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:05 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:06.363960 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-2609ebf1-5417-49cd-ad32-df2dba156159 req-d9be1106-9dba-46e5-9ee1-c7283b801ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4c5ca9-5dfe-4ed1-895e-a0db055e690a", "name": "network-vif-plugged", "status": "completed", "tag": "7d926653-f589-4d60-aaac-79517984d5e8"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:06.388919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-2609ebf1-5417-49cd-ad32-df2dba156159 req-d9be1106-9dba-46e5-9ee1-c7283b801ef9 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:06.390021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-2609ebf1-5417-49cd-ad32-df2dba156159 req-d9be1106-9dba-46e5-9ee1-c7283b801ef9 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:06.418548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-2609ebf1-5417-49cd-ad32-df2dba156159 req-d9be1106-9dba-46e5-9ee1-c7283b801ef9 service nova] Creating event network-vif-plugged:7d926653-f589-4d60-aaac-79517984d5e8 for instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a on hv-cinder-85093 Jul 25 19:26:06.428733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-2609ebf1-5417-49cd-ad32-df2dba156159 req-d9be1106-9dba-46e5-9ee1-c7283b801ef9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072023 Jul 25 19:26:06.430310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 82/150] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:26:06.546112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a29cf832-ce5f-4218-960a-418414bd732f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:06.555291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a29cf832-ce5f-4218-960a-418414bd732f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:06.568269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a29cf832-ce5f-4218-960a-418414bd732f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:06.569846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a29cf832-ce5f-4218-960a-418414bd732f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:06.571711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a29cf832-ce5f-4218-960a-418414bd732f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:06.573021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a29cf832-ce5f-4218-960a-418414bd732f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:06.692371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b4d878d-de94-4efa-935b-595ef114a9f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:06.703841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b4d878d-de94-4efa-935b-595ef114a9f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:06.748451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b4d878d-de94-4efa-935b-595ef114a9f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:06.752852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b4d878d-de94-4efa-935b-595ef114a9f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:06.758539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b4d878d-de94-4efa-935b-595ef114a9f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:06.759534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b4d878d-de94-4efa-935b-595ef114a9f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:07.319568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a29cf832-ce5f-4218-960a-418414bd732f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:07.358577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a29cf832-ce5f-4218-960a-418414bd732f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.825363 Jul 25 19:26:07.370795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 69/151] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:06 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:07.412942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-68fd5e9f-ae24-4e7d-bde6-ddc2f93b286b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:07.415843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-68fd5e9f-ae24-4e7d-bde6-ddc2f93b286b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:07.441259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68fd5e9f-ae24-4e7d-bde6-ddc2f93b286b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:07.453105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68fd5e9f-ae24-4e7d-bde6-ddc2f93b286b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:07.456218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68fd5e9f-ae24-4e7d-bde6-ddc2f93b286b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:07.457366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68fd5e9f-ae24-4e7d-bde6-ddc2f93b286b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:07.785848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b4d878d-de94-4efa-935b-595ef114a9f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:07.828906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b4d878d-de94-4efa-935b-595ef114a9f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:07.833598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b4d878d-de94-4efa-935b-595ef114a9f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:07.837131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b4d878d-de94-4efa-935b-595ef114a9f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1407 microversion: 2.20 time: 1.174679 Jul 25 19:26:07.839345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 83/152] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:26:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1407 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:26:07.856144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3bbdd30d-1354-4572-988e-3d4a97db53a0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:07.859501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3bbdd30d-1354-4572-988e-3d4a97db53a0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:07.876226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bbdd30d-1354-4572-988e-3d4a97db53a0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:07.877448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bbdd30d-1354-4572-988e-3d4a97db53a0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:07.879702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bbdd30d-1354-4572-988e-3d4a97db53a0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:07.880538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bbdd30d-1354-4572-988e-3d4a97db53a0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:08.341025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-68fd5e9f-ae24-4e7d-bde6-ddc2f93b286b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:08.404237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-68fd5e9f-ae24-4e7d-bde6-ddc2f93b286b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 1.025812 Jul 25 19:26:08.407086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 70/153] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:08.427220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4f0454f4-543e-4e53-b925-320e27299aa7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:08.431012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4f0454f4-543e-4e53-b925-320e27299aa7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:08.448739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f0454f4-543e-4e53-b925-320e27299aa7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:08.449495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f0454f4-543e-4e53-b925-320e27299aa7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:08.450869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f0454f4-543e-4e53-b925-320e27299aa7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:08.451671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f0454f4-543e-4e53-b925-320e27299aa7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:08.686757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3bbdd30d-1354-4572-988e-3d4a97db53a0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:08.717128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3bbdd30d-1354-4572-988e-3d4a97db53a0 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.869225 Jul 25 19:26:08.718081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 84/154] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:07 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:08.877908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a9d4a3c0-4b56-4ffd-bdf3-ba2ef7e655d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:08.880506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a9d4a3c0-4b56-4ffd-bdf3-ba2ef7e655d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:08.905265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9d4a3c0-4b56-4ffd-bdf3-ba2ef7e655d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:08.909975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9d4a3c0-4b56-4ffd-bdf3-ba2ef7e655d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:08.911476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9d4a3c0-4b56-4ffd-bdf3-ba2ef7e655d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:08.917360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9d4a3c0-4b56-4ffd-bdf3-ba2ef7e655d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:08.930697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f0454f4-543e-4e53-b925-320e27299aa7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:08.960449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4f0454f4-543e-4e53-b925-320e27299aa7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.549175 Jul 25 19:26:08.966498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 71/155] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:08 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:09.444467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b4eff8aa-c799-40d2-b856-cb13ad87f98f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:09.446014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b4eff8aa-c799-40d2-b856-cb13ad87f98f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:09.479001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4eff8aa-c799-40d2-b856-cb13ad87f98f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:09.479775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4eff8aa-c799-40d2-b856-cb13ad87f98f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:09.482048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4eff8aa-c799-40d2-b856-cb13ad87f98f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:09.484430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4eff8aa-c799-40d2-b856-cb13ad87f98f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:09.766254 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a9d4a3c0-4b56-4ffd-bdf3-ba2ef7e655d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:09.780246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a9d4a3c0-4b56-4ffd-bdf3-ba2ef7e655d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:09.783158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a9d4a3c0-4b56-4ffd-bdf3-ba2ef7e655d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:09.784665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a9d4a3c0-4b56-4ffd-bdf3-ba2ef7e655d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1600 microversion: 2.20 time: 0.911546 Jul 25 19:26:09.785849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 85/156] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:26:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1600 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:26:09.812066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4c8e034d-fbba-4f89-81fa-9607f42a4688 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:09.813504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4c8e034d-fbba-4f89-81fa-9607f42a4688 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:09.822782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c8e034d-fbba-4f89-81fa-9607f42a4688 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:09.823478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c8e034d-fbba-4f89-81fa-9607f42a4688 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:09.824877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c8e034d-fbba-4f89-81fa-9607f42a4688 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:09.825643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c8e034d-fbba-4f89-81fa-9607f42a4688 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:09.893882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b4eff8aa-c799-40d2-b856-cb13ad87f98f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:09.909379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b4eff8aa-c799-40d2-b856-cb13ad87f98f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.468603 Jul 25 19:26:09.910454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 72/157] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:09.924912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ab5bddf2-0cdf-4d5d-9abd-9fa56b2a2b27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:09.926229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ab5bddf2-0cdf-4d5d-9abd-9fa56b2a2b27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:09.935623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab5bddf2-0cdf-4d5d-9abd-9fa56b2a2b27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:09.936857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab5bddf2-0cdf-4d5d-9abd-9fa56b2a2b27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:09.941016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab5bddf2-0cdf-4d5d-9abd-9fa56b2a2b27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:09.941783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab5bddf2-0cdf-4d5d-9abd-9fa56b2a2b27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:10.245651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ab5bddf2-0cdf-4d5d-9abd-9fa56b2a2b27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.325068 Jul 25 19:26:10.246794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 73/158] 10.222.0.18 () {60 vars in 1316 bytes} [Mon Jul 25 19:26:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-interface => generated 285 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:26:10.253750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4c8e034d-fbba-4f89-81fa-9607f42a4688 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:10.272846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-effec5e9-f6c4-440a-9da3-38d81859b09a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:10.274179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-effec5e9-f6c4-440a-9da3-38d81859b09a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:10.274695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4c8e034d-fbba-4f89-81fa-9607f42a4688 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1315 microversion: 2.1 time: 0.487198 Jul 25 19:26:10.276134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 86/159] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:09 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:10.287309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-effec5e9-f6c4-440a-9da3-38d81859b09a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:10.288092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-effec5e9-f6c4-440a-9da3-38d81859b09a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:10.289434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-effec5e9-f6c4-440a-9da3-38d81859b09a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:10.290367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-effec5e9-f6c4-440a-9da3-38d81859b09a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:10.959236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-effec5e9-f6c4-440a-9da3-38d81859b09a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:10.966032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1a8f84b-1009-4f43-9ba9-0aeb0777262e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:10.968991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c1a8f84b-1009-4f43-9ba9-0aeb0777262e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:10.994666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-effec5e9-f6c4-440a-9da3-38d81859b09a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.733390 Jul 25 19:26:10.996995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 74/160] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:10 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:11.001059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1a8f84b-1009-4f43-9ba9-0aeb0777262e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:11.002707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1a8f84b-1009-4f43-9ba9-0aeb0777262e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:11.005154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1a8f84b-1009-4f43-9ba9-0aeb0777262e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:11.006814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1a8f84b-1009-4f43-9ba9-0aeb0777262e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:11.322578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c2492035-c22a-4492-b0f1-65f80cbe5c8c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:11.323709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c2492035-c22a-4492-b0f1-65f80cbe5c8c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:11.331645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c2492035-c22a-4492-b0f1-65f80cbe5c8c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:11.332447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c2492035-c22a-4492-b0f1-65f80cbe5c8c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:11.333954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c2492035-c22a-4492-b0f1-65f80cbe5c8c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:11.334682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c2492035-c22a-4492-b0f1-65f80cbe5c8c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:12.434473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c1a8f84b-1009-4f43-9ba9-0aeb0777262e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:12.462635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c1a8f84b-1009-4f43-9ba9-0aeb0777262e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 1.519390 Jul 25 19:26:12.486803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 87/161] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:12.516758 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-90440034-c1ac-488c-a1e6-3d4f41a2855c req-7ddfe34a-fa80-4443-a078-ef856654a0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcfc471-41be-4079-81d3-0cf334d03888", "name": "network-vif-plugged", "status": "completed", "tag": "2eec74bc-2361-4fec-b124-95a6e3605926"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:12.576130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-90440034-c1ac-488c-a1e6-3d4f41a2855c req-7ddfe34a-fa80-4443-a078-ef856654a0f9 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:12.576130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-90440034-c1ac-488c-a1e6-3d4f41a2855c req-7ddfe34a-fa80-4443-a078-ef856654a0f9 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:12.641565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-90440034-c1ac-488c-a1e6-3d4f41a2855c req-7ddfe34a-fa80-4443-a078-ef856654a0f9 service nova] Creating event network-vif-plugged:2eec74bc-2361-4fec-b124-95a6e3605926 for instance 4bcfc471-41be-4079-81d3-0cf334d03888 on hv-cinder-85093 Jul 25 19:26:12.660037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-90440034-c1ac-488c-a1e6-3d4f41a2855c req-7ddfe34a-fa80-4443-a078-ef856654a0f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168076 Jul 25 19:26:12.676013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 88/162] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:12.702674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81814ee8-decc-4cd9-a3d9-2827c9056008 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:12.707101 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81814ee8-decc-4cd9-a3d9-2827c9056008 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:12.720889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81814ee8-decc-4cd9-a3d9-2827c9056008 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:12.722755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81814ee8-decc-4cd9-a3d9-2827c9056008 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:12.724387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81814ee8-decc-4cd9-a3d9-2827c9056008 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:12.725550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81814ee8-decc-4cd9-a3d9-2827c9056008 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:12.812815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c2492035-c22a-4492-b0f1-65f80cbe5c8c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:12.864102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c2492035-c22a-4492-b0f1-65f80cbe5c8c tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1500 microversion: 2.1 time: 1.547486 Jul 25 19:26:12.868724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 75/163] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:11 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1500 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:13.546356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e1851c22-a0a1-48cf-967d-9ac7c906d43e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:13.547447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e1851c22-a0a1-48cf-967d-9ac7c906d43e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:13.581335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1851c22-a0a1-48cf-967d-9ac7c906d43e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:13.581856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1851c22-a0a1-48cf-967d-9ac7c906d43e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:13.582763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1851c22-a0a1-48cf-967d-9ac7c906d43e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:13.583650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1851c22-a0a1-48cf-967d-9ac7c906d43e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:14.175455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-81814ee8-decc-4cd9-a3d9-2827c9056008 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:14.193251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81814ee8-decc-4cd9-a3d9-2827c9056008 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 1.515240 Jul 25 19:26:14.193939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 89/164] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:12 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:14.628150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e1851c22-a0a1-48cf-967d-9ac7c906d43e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:14.637326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:14.643355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e1851c22-a0a1-48cf-967d-9ac7c906d43e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 1.113265 Jul 25 19:26:14.656002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 76/165] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:14.703180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-fd083e82-d283-4b59-a344-8f5722ba5bfc req-096bc28d-0529-4caa-a82e-1f615b3dbe81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d9ed8-749b-4f5b-9128-ee1dfda6c899", "name": "network-vif-plugged", "status": "completed", "tag": "10478694-66f5-4da9-97eb-15b49a4ea4db"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:14.719005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-fd083e82-d283-4b59-a344-8f5722ba5bfc req-096bc28d-0529-4caa-a82e-1f615b3dbe81 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:14.719605 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-fd083e82-d283-4b59-a344-8f5722ba5bfc req-096bc28d-0529-4caa-a82e-1f615b3dbe81 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:14.755450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-fd083e82-d283-4b59-a344-8f5722ba5bfc req-096bc28d-0529-4caa-a82e-1f615b3dbe81 service nova] Creating event network-vif-plugged:10478694-66f5-4da9-97eb-15b49a4ea4db for instance 330d9ed8-749b-4f5b-9128-ee1dfda6c899 on hv-cinder-85093 Jul 25 19:26:14.778401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-fd083e82-d283-4b59-a344-8f5722ba5bfc req-096bc28d-0529-4caa-a82e-1f615b3dbe81 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086280 Jul 25 19:26:14.788445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 90/166] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:15.125339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-99c4be57-d178-489c-9542-77b88b295cb3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61482a23-8c7b-4dba-9f0f-4d45f8b0cfe4"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:15.139210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-99c4be57-d178-489c-9542-77b88b295cb3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:15.153029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99c4be57-d178-489c-9542-77b88b295cb3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:15.154114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99c4be57-d178-489c-9542-77b88b295cb3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:15.155308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99c4be57-d178-489c-9542-77b88b295cb3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:15.156504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99c4be57-d178-489c-9542-77b88b295cb3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:15.201263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-a71172ab-7ffa-4aff-b9b9-aab5de2fdc78 req-833d8a75-8e32-44bf-adb6-c282da99c220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1007369a-dd3c-4837-95f4-e8326d600031", "tag": "33faefb9-12a5-4e86-b189-357d316c5553"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:15.233788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-a71172ab-7ffa-4aff-b9b9-aab5de2fdc78 req-833d8a75-8e32-44bf-adb6-c282da99c220 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:15.239202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-a71172ab-7ffa-4aff-b9b9-aab5de2fdc78 req-833d8a75-8e32-44bf-adb6-c282da99c220 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:15.285438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-a71172ab-7ffa-4aff-b9b9-aab5de2fdc78 req-833d8a75-8e32-44bf-adb6-c282da99c220 service nova] Creating event network-changed:33faefb9-12a5-4e86-b189-357d316c5553 for instance 1007369a-dd3c-4837-95f4-e8326d600031 on hv-cinder-85093 Jul 25 19:26:15.296985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-a71172ab-7ffa-4aff-b9b9-aab5de2fdc78 req-833d8a75-8e32-44bf-adb6-c282da99c220 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112172 Jul 25 19:26:15.297908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 91/167] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:15.308055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-26840de9-6a21-4700-a92a-fcc9034d8a31 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:15.308847 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-26840de9-6a21-4700-a92a-fcc9034d8a31 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:15.317864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26840de9-6a21-4700-a92a-fcc9034d8a31 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:15.318080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26840de9-6a21-4700-a92a-fcc9034d8a31 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:15.318828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26840de9-6a21-4700-a92a-fcc9034d8a31 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:15.319272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26840de9-6a21-4700-a92a-fcc9034d8a31 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:15.585011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26840de9-6a21-4700-a92a-fcc9034d8a31 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:15.598874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-26840de9-6a21-4700-a92a-fcc9034d8a31 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.298831 Jul 25 19:26:15.600239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 92/168] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:15 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:15.673819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6021314c-4119-4cc2-a4e3-cc0ef9193511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:15.675348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6021314c-4119-4cc2-a4e3-cc0ef9193511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:15.688837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=74 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:15.694941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6021314c-4119-4cc2-a4e3-cc0ef9193511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:15.697121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6021314c-4119-4cc2-a4e3-cc0ef9193511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:15.708901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6021314c-4119-4cc2-a4e3-cc0ef9193511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:15.716879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6021314c-4119-4cc2-a4e3-cc0ef9193511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:16.369000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6021314c-4119-4cc2-a4e3-cc0ef9193511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:16.401392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6021314c-4119-4cc2-a4e3-cc0ef9193511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1366 microversion: 2.1 time: 0.733897 Jul 25 19:26:16.404930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 93/169] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1366 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:16.629611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-80398e03-408d-443a-88e5-fb85f71e4bf9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:16.630258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-80398e03-408d-443a-88e5-fb85f71e4bf9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:16.638894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80398e03-408d-443a-88e5-fb85f71e4bf9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:16.640437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80398e03-408d-443a-88e5-fb85f71e4bf9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:16.641861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80398e03-408d-443a-88e5-fb85f71e4bf9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:16.642890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80398e03-408d-443a-88e5-fb85f71e4bf9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:16.650597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-99c4be57-d178-489c-9542-77b88b295cb3 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.545626 Jul 25 19:26:16.651707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 77/170] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 19:26:15 2022] POST /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e/os-volume_attachments => generated 194 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:16.906668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-80398e03-408d-443a-88e5-fb85f71e4bf9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:16.919983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-80398e03-408d-443a-88e5-fb85f71e4bf9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.294900 Jul 25 19:26:16.920775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 94/171] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:16 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:17.447753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ee5572ba-ed66-4e45-b3c0-27ce6d7a6f00 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:17.456302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ee5572ba-ed66-4e45-b3c0-27ce6d7a6f00 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:17.496826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee5572ba-ed66-4e45-b3c0-27ce6d7a6f00 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:17.498182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee5572ba-ed66-4e45-b3c0-27ce6d7a6f00 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:17.499830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee5572ba-ed66-4e45-b3c0-27ce6d7a6f00 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:17.501604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee5572ba-ed66-4e45-b3c0-27ce6d7a6f00 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:17.818297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ee5572ba-ed66-4e45-b3c0-27ce6d7a6f00 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:17.844199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ee5572ba-ed66-4e45-b3c0-27ce6d7a6f00 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1555 microversion: 2.1 time: 0.405994 Jul 25 19:26:17.845997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 78/172] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1555 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:17.885493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-591500b1-9b4d-4651-bd9c-dd7d2ba5e8b3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:17.887903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-591500b1-9b4d-4651-bd9c-dd7d2ba5e8b3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:17.898486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-591500b1-9b4d-4651-bd9c-dd7d2ba5e8b3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:17.899765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-591500b1-9b4d-4651-bd9c-dd7d2ba5e8b3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:17.902010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-591500b1-9b4d-4651-bd9c-dd7d2ba5e8b3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:17.903071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-591500b1-9b4d-4651-bd9c-dd7d2ba5e8b3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:17.949011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7d9ffc70-462d-429e-8141-1d96781d5d1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:17.952996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7d9ffc70-462d-429e-8141-1d96781d5d1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:17.981221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d9ffc70-462d-429e-8141-1d96781d5d1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:17.982999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d9ffc70-462d-429e-8141-1d96781d5d1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:17.985938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d9ffc70-462d-429e-8141-1d96781d5d1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:17.986874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d9ffc70-462d-429e-8141-1d96781d5d1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:18.417211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-591500b1-9b4d-4651-bd9c-dd7d2ba5e8b3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.541010 Jul 25 19:26:18.440198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 95/173] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Jul 25 19:26:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-interface => generated 284 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:18.788831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7d9ffc70-462d-429e-8141-1d96781d5d1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:18.818006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7d9ffc70-462d-429e-8141-1d96781d5d1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1322 microversion: 2.1 time: 0.877331 Jul 25 19:26:18.823471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 79/174] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:17 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1322 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:19.865288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d7f96d3a-ddca-4dbc-afa4-1707a9560332 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:19.866391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d7f96d3a-ddca-4dbc-afa4-1707a9560332 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:19.877726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7f96d3a-ddca-4dbc-afa4-1707a9560332 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:19.878799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7f96d3a-ddca-4dbc-afa4-1707a9560332 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:19.880350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7f96d3a-ddca-4dbc-afa4-1707a9560332 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:19.881064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7f96d3a-ddca-4dbc-afa4-1707a9560332 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:20.158985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7f96d3a-ddca-4dbc-afa4-1707a9560332 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:20.176775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d7f96d3a-ddca-4dbc-afa4-1707a9560332 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1516 microversion: 2.1 time: 0.318992 Jul 25 19:26:20.177898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 96/175] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:19 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1516 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:20.222618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-91f26bb6-6400-4a2b-89d3-820c56f9d93c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:20.229942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-91f26bb6-6400-4a2b-89d3-820c56f9d93c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:20.244018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91f26bb6-6400-4a2b-89d3-820c56f9d93c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:20.244971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91f26bb6-6400-4a2b-89d3-820c56f9d93c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:20.246732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91f26bb6-6400-4a2b-89d3-820c56f9d93c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:20.247879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91f26bb6-6400-4a2b-89d3-820c56f9d93c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:20.306580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-91f26bb6-6400-4a2b-89d3-820c56f9d93c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lazy-loading 'flavor' on Instance uuid 330d9ed8-749b-4f5b-9128-ee1dfda6c899 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:26:20.584192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-91f26bb6-6400-4a2b-89d3-820c56f9d93c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "POST /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899/action" status: 200 len: 32 microversion: 2.1 time: 0.371012 Jul 25 19:26:20.586911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 80/176] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 19:26:20 2022] POST /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899/action => generated 32 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:26:20.608361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9439771c-2bd4-4c90-90ee-b672ecc52c2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:20.610038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9439771c-2bd4-4c90-90ee-b672ecc52c2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:20.622876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9439771c-2bd4-4c90-90ee-b672ecc52c2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:20.623908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9439771c-2bd4-4c90-90ee-b672ecc52c2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:20.625549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9439771c-2bd4-4c90-90ee-b672ecc52c2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:20.626508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9439771c-2bd4-4c90-90ee-b672ecc52c2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:21.079772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9439771c-2bd4-4c90-90ee-b672ecc52c2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:21.099240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9439771c-2bd4-4c90-90ee-b672ecc52c2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.498317 Jul 25 19:26:21.112672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 97/177] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:20 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:21.626067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-52241bda-e174-4e5e-8d75-1b5720541913 req-79a9e47c-641b-44c5-b5ea-5ee610decb86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bcfc471-41be-4079-81d3-0cf334d03888", "tag": "2eec74bc-2361-4fec-b124-95a6e3605926"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:21.651422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-52241bda-e174-4e5e-8d75-1b5720541913 req-79a9e47c-641b-44c5-b5ea-5ee610decb86 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:21.652574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-52241bda-e174-4e5e-8d75-1b5720541913 req-79a9e47c-641b-44c5-b5ea-5ee610decb86 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:21.693196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-52241bda-e174-4e5e-8d75-1b5720541913 req-79a9e47c-641b-44c5-b5ea-5ee610decb86 service nova] Creating event network-changed:2eec74bc-2361-4fec-b124-95a6e3605926 for instance 4bcfc471-41be-4079-81d3-0cf334d03888 on hv-cinder-85093 Jul 25 19:26:21.716018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-52241bda-e174-4e5e-8d75-1b5720541913 req-79a9e47c-641b-44c5-b5ea-5ee610decb86 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088275 Jul 25 19:26:21.717844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 81/178] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:22.142522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5197b771-a857-4592-b574-de58f2f04975 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:22.143708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5197b771-a857-4592-b574-de58f2f04975 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:22.155052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5197b771-a857-4592-b574-de58f2f04975 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:22.156165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5197b771-a857-4592-b574-de58f2f04975 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:22.157599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5197b771-a857-4592-b574-de58f2f04975 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:22.158708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5197b771-a857-4592-b574-de58f2f04975 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:22.492533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5197b771-a857-4592-b574-de58f2f04975 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:22.514734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5197b771-a857-4592-b574-de58f2f04975 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.384028 Jul 25 19:26:22.516079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 98/179] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:22 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:23.560638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9dcfca70-f2c4-4275-aa62-605f4bd64d62 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:23.560638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9dcfca70-f2c4-4275-aa62-605f4bd64d62 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:23.592972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9dcfca70-f2c4-4275-aa62-605f4bd64d62 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:23.593965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9dcfca70-f2c4-4275-aa62-605f4bd64d62 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:23.603067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9dcfca70-f2c4-4275-aa62-605f4bd64d62 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:23.603671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9dcfca70-f2c4-4275-aa62-605f4bd64d62 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:23.823698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9dcfca70-f2c4-4275-aa62-605f4bd64d62 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:23.834235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9dcfca70-f2c4-4275-aa62-605f4bd64d62 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.283556 Jul 25 19:26:23.835448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 82/180] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:23 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:24.874951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b5d87122-3e56-4fbc-afea-ac39e16e4052 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:24.876181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b5d87122-3e56-4fbc-afea-ac39e16e4052 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:24.891044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5d87122-3e56-4fbc-afea-ac39e16e4052 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:24.891942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5d87122-3e56-4fbc-afea-ac39e16e4052 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:24.893353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5d87122-3e56-4fbc-afea-ac39e16e4052 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:24.894145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5d87122-3e56-4fbc-afea-ac39e16e4052 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:25.557343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b5d87122-3e56-4fbc-afea-ac39e16e4052 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:25.573494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b5d87122-3e56-4fbc-afea-ac39e16e4052 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.706669 Jul 25 19:26:25.574659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 99/181] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:24 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:26.608153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c8244612-0a56-4720-b41e-687d1dab0075 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:26.609137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c8244612-0a56-4720-b41e-687d1dab0075 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:26.620190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8244612-0a56-4720-b41e-687d1dab0075 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:26.622228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8244612-0a56-4720-b41e-687d1dab0075 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:26.624053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8244612-0a56-4720-b41e-687d1dab0075 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:26.625083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8244612-0a56-4720-b41e-687d1dab0075 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:26.971156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c8244612-0a56-4720-b41e-687d1dab0075 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:26.987076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c8244612-0a56-4720-b41e-687d1dab0075 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.385680 Jul 25 19:26:26.992647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 83/182] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:26 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:28.028646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4c02eab7-4aeb-415e-8103-6c846c4a9be0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:28.029537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4c02eab7-4aeb-415e-8103-6c846c4a9be0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:28.039547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c02eab7-4aeb-415e-8103-6c846c4a9be0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:28.040373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c02eab7-4aeb-415e-8103-6c846c4a9be0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:28.041789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c02eab7-4aeb-415e-8103-6c846c4a9be0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:28.042686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c02eab7-4aeb-415e-8103-6c846c4a9be0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:28.294300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4c02eab7-4aeb-415e-8103-6c846c4a9be0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:28.304202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4c02eab7-4aeb-415e-8103-6c846c4a9be0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.282148 Jul 25 19:26:28.304913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 100/183] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:28 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:29.333570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d4d7e668-736e-4c0b-848c-18466ec952e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:29.334693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d4d7e668-736e-4c0b-848c-18466ec952e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:29.350184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4d7e668-736e-4c0b-848c-18466ec952e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:29.352954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4d7e668-736e-4c0b-848c-18466ec952e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:29.354539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4d7e668-736e-4c0b-848c-18466ec952e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:29.356016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4d7e668-736e-4c0b-848c-18466ec952e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:29.601152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d4d7e668-736e-4c0b-848c-18466ec952e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:29.611467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d4d7e668-736e-4c0b-848c-18466ec952e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.285371 Jul 25 19:26:29.612338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 84/184] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:29 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:30.648818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fa59ced4-bfeb-4802-b962-461013446d76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:30.651865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa59ced4-bfeb-4802-b962-461013446d76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:30.660330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa59ced4-bfeb-4802-b962-461013446d76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:30.661040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa59ced4-bfeb-4802-b962-461013446d76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:30.662267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa59ced4-bfeb-4802-b962-461013446d76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:30.662923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa59ced4-bfeb-4802-b962-461013446d76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:30.673398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:31.029697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa59ced4-bfeb-4802-b962-461013446d76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:31.046049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fa59ced4-bfeb-4802-b962-461013446d76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.409227 Jul 25 19:26:31.049911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 101/185] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:30 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:32.083325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2db3e306-9956-4e53-83ae-3a3d60a9313a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:32.084660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2db3e306-9956-4e53-83ae-3a3d60a9313a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:32.091324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=46 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:32.102040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2db3e306-9956-4e53-83ae-3a3d60a9313a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:32.108235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2db3e306-9956-4e53-83ae-3a3d60a9313a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:32.108235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2db3e306-9956-4e53-83ae-3a3d60a9313a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:32.108235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2db3e306-9956-4e53-83ae-3a3d60a9313a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:32.380930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2db3e306-9956-4e53-83ae-3a3d60a9313a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:32.395909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2db3e306-9956-4e53-83ae-3a3d60a9313a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.321061 Jul 25 19:26:32.396876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 85/186] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:32 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:33.431873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-61f618b4-6921-43b7-b4a1-f84d1f5e271f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:33.433158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-61f618b4-6921-43b7-b4a1-f84d1f5e271f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:33.445296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61f618b4-6921-43b7-b4a1-f84d1f5e271f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:33.446088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61f618b4-6921-43b7-b4a1-f84d1f5e271f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:33.447640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61f618b4-6921-43b7-b4a1-f84d1f5e271f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:33.448478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61f618b4-6921-43b7-b4a1-f84d1f5e271f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:33.675845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-61f618b4-6921-43b7-b4a1-f84d1f5e271f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:33.686531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-61f618b4-6921-43b7-b4a1-f84d1f5e271f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.262747 Jul 25 19:26:33.687350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 102/187] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:33 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:34.717398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f60a7214-7c7e-4393-98e8-c961c760fb67 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:34.717958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f60a7214-7c7e-4393-98e8-c961c760fb67 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:34.725543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f60a7214-7c7e-4393-98e8-c961c760fb67 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:34.726918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f60a7214-7c7e-4393-98e8-c961c760fb67 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:34.728552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f60a7214-7c7e-4393-98e8-c961c760fb67 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:34.728552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f60a7214-7c7e-4393-98e8-c961c760fb67 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:34.951246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f60a7214-7c7e-4393-98e8-c961c760fb67 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:34.963234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f60a7214-7c7e-4393-98e8-c961c760fb67 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.250108 Jul 25 19:26:34.964496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 86/188] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:34 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:36.001029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-93330414-d5ee-4831-a8d4-551089770fca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:36.001761 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93330414-d5ee-4831-a8d4-551089770fca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:36.011468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93330414-d5ee-4831-a8d4-551089770fca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:36.012126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93330414-d5ee-4831-a8d4-551089770fca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:36.013061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93330414-d5ee-4831-a8d4-551089770fca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:36.013678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93330414-d5ee-4831-a8d4-551089770fca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:36.241193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93330414-d5ee-4831-a8d4-551089770fca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:36.257932 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-93330414-d5ee-4831-a8d4-551089770fca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.261452 Jul 25 19:26:36.265300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 103/189] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:35 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:37.298831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ba1c2749-ce41-4a73-9ec8-0819b96776ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:37.299800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ba1c2749-ce41-4a73-9ec8-0819b96776ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:37.317172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba1c2749-ce41-4a73-9ec8-0819b96776ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:37.317935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba1c2749-ce41-4a73-9ec8-0819b96776ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:37.319392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba1c2749-ce41-4a73-9ec8-0819b96776ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:37.320267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba1c2749-ce41-4a73-9ec8-0819b96776ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:37.588055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ba1c2749-ce41-4a73-9ec8-0819b96776ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:37.602742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ba1c2749-ce41-4a73-9ec8-0819b96776ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.309166 Jul 25 19:26:37.603732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 87/190] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:37 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:38.643413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb83b272-cf1e-4289-adbe-09d4c9a1a22a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:38.645042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb83b272-cf1e-4289-adbe-09d4c9a1a22a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:38.657623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb83b272-cf1e-4289-adbe-09d4c9a1a22a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:38.658294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb83b272-cf1e-4289-adbe-09d4c9a1a22a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:38.659752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb83b272-cf1e-4289-adbe-09d4c9a1a22a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:38.660518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb83b272-cf1e-4289-adbe-09d4c9a1a22a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:38.885637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb83b272-cf1e-4289-adbe-09d4c9a1a22a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:38.898594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb83b272-cf1e-4289-adbe-09d4c9a1a22a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.262717 Jul 25 19:26:38.899547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 104/191] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:38 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:39.924517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-885d2fe8-34b5-449e-a3fa-cc331b817229 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:39.925126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-885d2fe8-34b5-449e-a3fa-cc331b817229 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:39.933413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-885d2fe8-34b5-449e-a3fa-cc331b817229 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:39.934077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-885d2fe8-34b5-449e-a3fa-cc331b817229 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:39.934963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-885d2fe8-34b5-449e-a3fa-cc331b817229 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:39.935490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-885d2fe8-34b5-449e-a3fa-cc331b817229 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:40.152990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-885d2fe8-34b5-449e-a3fa-cc331b817229 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:40.170171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-885d2fe8-34b5-449e-a3fa-cc331b817229 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.249838 Jul 25 19:26:40.171266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 88/192] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:39 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:41.197982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e37f7d84-3279-4041-8ca2-a16ba9b0eb27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:41.198883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e37f7d84-3279-4041-8ca2-a16ba9b0eb27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:41.206338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e37f7d84-3279-4041-8ca2-a16ba9b0eb27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:41.206787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e37f7d84-3279-4041-8ca2-a16ba9b0eb27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:41.207634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e37f7d84-3279-4041-8ca2-a16ba9b0eb27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:41.208073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e37f7d84-3279-4041-8ca2-a16ba9b0eb27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:41.409253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e37f7d84-3279-4041-8ca2-a16ba9b0eb27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:41.422509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e37f7d84-3279-4041-8ca2-a16ba9b0eb27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.230009 Jul 25 19:26:41.423280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 105/193] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:41 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:42.385311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d65b55b6-a894-4766-8b67-e11fcd07830b tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:42.386941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d65b55b6-a894-4766-8b67-e11fcd07830b tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:42.395691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d65b55b6-a894-4766-8b67-e11fcd07830b tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:42.396211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d65b55b6-a894-4766-8b67-e11fcd07830b tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:42.397048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d65b55b6-a894-4766-8b67-e11fcd07830b tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:42.399402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d65b55b6-a894-4766-8b67-e11fcd07830b tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:42.439825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d65b55b6-a894-4766-8b67-e11fcd07830b tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Going to try to terminate instance {{(pid=117952) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:26:42.452955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd81e0e6-202b-419e-bb2c-8d9d4e24750f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:42.453856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd81e0e6-202b-419e-bb2c-8d9d4e24750f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:42.462468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd81e0e6-202b-419e-bb2c-8d9d4e24750f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:42.463298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd81e0e6-202b-419e-bb2c-8d9d4e24750f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:42.464745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd81e0e6-202b-419e-bb2c-8d9d4e24750f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:42.465191 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd81e0e6-202b-419e-bb2c-8d9d4e24750f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:42.501768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:42.605503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d65b55b6-a894-4766-8b67-e11fcd07830b tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 204 len: 0 microversion: 2.1 time: 0.225234 Jul 25 19:26:42.607012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 89/194] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:26:42 2022] DELETE /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:26:42.628300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4e98109a-1a54-4baf-a7b3-8b3a7afd0aa1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:42.629920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4e98109a-1a54-4baf-a7b3-8b3a7afd0aa1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:42.642660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e98109a-1a54-4baf-a7b3-8b3a7afd0aa1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:42.643479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e98109a-1a54-4baf-a7b3-8b3a7afd0aa1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:42.644970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e98109a-1a54-4baf-a7b3-8b3a7afd0aa1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:42.645784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e98109a-1a54-4baf-a7b3-8b3a7afd0aa1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:42.704032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fd81e0e6-202b-419e-bb2c-8d9d4e24750f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:42.718438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fd81e0e6-202b-419e-bb2c-8d9d4e24750f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.269785 Jul 25 19:26:42.719396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 106/195] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:42 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:42.894497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e98109a-1a54-4baf-a7b3-8b3a7afd0aa1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:42.905645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4e98109a-1a54-4baf-a7b3-8b3a7afd0aa1 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1552 microversion: 2.1 time: 0.291935 Jul 25 19:26:42.906310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 90/196] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:42 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1552 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:43.759279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-adc5df9e-e44e-4e7a-ba10-ed75267b260f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:43.761658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-adc5df9e-e44e-4e7a-ba10-ed75267b260f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:43.773501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adc5df9e-e44e-4e7a-ba10-ed75267b260f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:43.774245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adc5df9e-e44e-4e7a-ba10-ed75267b260f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:43.776110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adc5df9e-e44e-4e7a-ba10-ed75267b260f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:43.777372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adc5df9e-e44e-4e7a-ba10-ed75267b260f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:43.937816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bc0083c3-258a-4eed-bc35-05d893aa0be4 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:43.939346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bc0083c3-258a-4eed-bc35-05d893aa0be4 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:43.953986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc0083c3-258a-4eed-bc35-05d893aa0be4 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:43.955410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc0083c3-258a-4eed-bc35-05d893aa0be4 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:43.957143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc0083c3-258a-4eed-bc35-05d893aa0be4 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:43.958335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc0083c3-258a-4eed-bc35-05d893aa0be4 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:44.048997 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-adc5df9e-e44e-4e7a-ba10-ed75267b260f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:44.065854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-adc5df9e-e44e-4e7a-ba10-ed75267b260f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.313540 Jul 25 19:26:44.066736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 107/197] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:43 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:44.244656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bc0083c3-258a-4eed-bc35-05d893aa0be4 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:44.277122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bc0083c3-258a-4eed-bc35-05d893aa0be4 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1552 microversion: 2.1 time: 0.348680 Jul 25 19:26:44.281037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 91/198] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:43 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1552 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:45.096095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8c44720-2eea-4d08-ad58-cab33bdb53c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:45.098336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8c44720-2eea-4d08-ad58-cab33bdb53c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:45.109462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8c44720-2eea-4d08-ad58-cab33bdb53c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:45.110233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8c44720-2eea-4d08-ad58-cab33bdb53c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:45.111723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8c44720-2eea-4d08-ad58-cab33bdb53c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:45.112500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8c44720-2eea-4d08-ad58-cab33bdb53c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:45.317020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0f94f3fe-38d1-4fd8-9350-4990f52cc4f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:45.318124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0f94f3fe-38d1-4fd8-9350-4990f52cc4f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:45.328284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f94f3fe-38d1-4fd8-9350-4990f52cc4f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:45.328765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f94f3fe-38d1-4fd8-9350-4990f52cc4f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:45.329604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f94f3fe-38d1-4fd8-9350-4990f52cc4f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:45.330046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f94f3fe-38d1-4fd8-9350-4990f52cc4f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:45.413340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a8c44720-2eea-4d08-ad58-cab33bdb53c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:45.427386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8c44720-2eea-4d08-ad58-cab33bdb53c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.338678 Jul 25 19:26:45.428584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 108/199] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:45 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:45.656551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0f94f3fe-38d1-4fd8-9350-4990f52cc4f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:45.668686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0f94f3fe-38d1-4fd8-9350-4990f52cc4f5 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1552 microversion: 2.1 time: 0.358483 Jul 25 19:26:45.669305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 92/200] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:45 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1552 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:46.451105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f1bdf81e-0c09-486c-9ee6-d1f90e72157a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:46.451917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f1bdf81e-0c09-486c-9ee6-d1f90e72157a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:46.463711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=32 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:46.466300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1bdf81e-0c09-486c-9ee6-d1f90e72157a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:46.467098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1bdf81e-0c09-486c-9ee6-d1f90e72157a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:46.467945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1bdf81e-0c09-486c-9ee6-d1f90e72157a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:46.469388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1bdf81e-0c09-486c-9ee6-d1f90e72157a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:46.698125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-42846402-5c4b-4656-8a12-70676602a274 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:46.704423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f1bdf81e-0c09-486c-9ee6-d1f90e72157a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:46.707922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-42846402-5c4b-4656-8a12-70676602a274 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:46.716942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f1bdf81e-0c09-486c-9ee6-d1f90e72157a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.269653 Jul 25 19:26:46.724612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42846402-5c4b-4656-8a12-70676602a274 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:46.725944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42846402-5c4b-4656-8a12-70676602a274 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:46.728935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42846402-5c4b-4656-8a12-70676602a274 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:46.729743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42846402-5c4b-4656-8a12-70676602a274 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:46.732283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 109/201] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:46 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:47.086603 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-42846402-5c4b-4656-8a12-70676602a274 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:47.100178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-42846402-5c4b-4656-8a12-70676602a274 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1552 microversion: 2.1 time: 0.410322 Jul 25 19:26:47.101162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 93/202] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:46 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1552 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:47.743910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fe6209b8-25ef-459a-aaa5-8fddc9aa529e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:47.745011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fe6209b8-25ef-459a-aaa5-8fddc9aa529e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:47.753401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe6209b8-25ef-459a-aaa5-8fddc9aa529e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:47.753974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe6209b8-25ef-459a-aaa5-8fddc9aa529e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:47.754872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe6209b8-25ef-459a-aaa5-8fddc9aa529e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:47.755489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe6209b8-25ef-459a-aaa5-8fddc9aa529e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:48.008161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe6209b8-25ef-459a-aaa5-8fddc9aa529e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:48.027355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fe6209b8-25ef-459a-aaa5-8fddc9aa529e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.287677 Jul 25 19:26:48.031218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 110/203] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:47 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:48.130767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d3ba9c55-5fc0-4c79-9fc1-0e36ebe049aa tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:48.134035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d3ba9c55-5fc0-4c79-9fc1-0e36ebe049aa tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:48.146233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3ba9c55-5fc0-4c79-9fc1-0e36ebe049aa tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:48.147042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3ba9c55-5fc0-4c79-9fc1-0e36ebe049aa tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:48.149086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3ba9c55-5fc0-4c79-9fc1-0e36ebe049aa tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:48.149867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3ba9c55-5fc0-4c79-9fc1-0e36ebe049aa tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:48.423568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d3ba9c55-5fc0-4c79-9fc1-0e36ebe049aa tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:48.437945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d3ba9c55-5fc0-4c79-9fc1-0e36ebe049aa tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1552 microversion: 2.1 time: 0.315385 Jul 25 19:26:48.440156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 94/204] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:48 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1552 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:48.941097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-dd8caa00-f662-4ed1-a4eb-e9339d2c21d5 req-744306f2-8b9d-47cd-86d3-fb1c372b6384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad9c400-6df9-49ac-a7e5-e9336446af9e", "name": "network-vif-deleted", "tag": "75adfdc2-df4c-4810-bd2e-e056db5829f5"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:48.960780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-dd8caa00-f662-4ed1-a4eb-e9339d2c21d5 req-744306f2-8b9d-47cd-86d3-fb1c372b6384 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:48.961375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-dd8caa00-f662-4ed1-a4eb-e9339d2c21d5 req-744306f2-8b9d-47cd-86d3-fb1c372b6384 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:48.983704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-dd8caa00-f662-4ed1-a4eb-e9339d2c21d5 req-744306f2-8b9d-47cd-86d3-fb1c372b6384 service nova] Creating event network-vif-deleted:75adfdc2-df4c-4810-bd2e-e056db5829f5 for instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e on hv-cinder-85093 Jul 25 19:26:48.993478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-dd8caa00-f662-4ed1-a4eb-e9339d2c21d5 req-744306f2-8b9d-47cd-86d3-fb1c372b6384 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058716 Jul 25 19:26:48.994517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 111/205] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:26:49.056967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c08da558-6327-45cb-a255-8e25dc44926d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:49.058018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c08da558-6327-45cb-a255-8e25dc44926d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:49.066023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c08da558-6327-45cb-a255-8e25dc44926d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:49.066704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c08da558-6327-45cb-a255-8e25dc44926d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:49.068106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c08da558-6327-45cb-a255-8e25dc44926d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:49.068731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c08da558-6327-45cb-a255-8e25dc44926d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:49.260696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c08da558-6327-45cb-a255-8e25dc44926d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:49.274893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c08da558-6327-45cb-a255-8e25dc44926d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.226095 Jul 25 19:26:49.281194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 95/206] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:49 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:49.479819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6c8bfbd8-4edf-4dd3-9a95-078db56823ea tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:49.480519 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6c8bfbd8-4edf-4dd3-9a95-078db56823ea tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:49.487773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c8bfbd8-4edf-4dd3-9a95-078db56823ea tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:49.488236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c8bfbd8-4edf-4dd3-9a95-078db56823ea tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:49.489043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c8bfbd8-4edf-4dd3-9a95-078db56823ea tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:49.489481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c8bfbd8-4edf-4dd3-9a95-078db56823ea tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:49.601741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6c8bfbd8-4edf-4dd3-9a95-078db56823ea tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:49.620570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6c8bfbd8-4edf-4dd3-9a95-078db56823ea tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1510 microversion: 2.1 time: 0.145736 Jul 25 19:26:49.622237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 112/207] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:49 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:50.306696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ffd89811-c6c3-49e6-ae1f-66002503d05c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:50.307944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ffd89811-c6c3-49e6-ae1f-66002503d05c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:50.321286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd89811-c6c3-49e6-ae1f-66002503d05c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:50.322112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd89811-c6c3-49e6-ae1f-66002503d05c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:50.323500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd89811-c6c3-49e6-ae1f-66002503d05c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:50.324375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd89811-c6c3-49e6-ae1f-66002503d05c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:50.572833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ffd89811-c6c3-49e6-ae1f-66002503d05c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:50.585387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ffd89811-c6c3-49e6-ae1f-66002503d05c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.289168 Jul 25 19:26:50.587448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 96/208] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:50 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:50.646275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d71c551-6395-4b4a-80e2-0b9c1a1be9cc tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:50.648060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d71c551-6395-4b4a-80e2-0b9c1a1be9cc tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:50.670064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d71c551-6395-4b4a-80e2-0b9c1a1be9cc tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:50.670757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d71c551-6395-4b4a-80e2-0b9c1a1be9cc tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:50.672022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d71c551-6395-4b4a-80e2-0b9c1a1be9cc tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:50.672691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d71c551-6395-4b4a-80e2-0b9c1a1be9cc tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:50.793031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d71c551-6395-4b4a-80e2-0b9c1a1be9cc tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:50.807437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d71c551-6395-4b4a-80e2-0b9c1a1be9cc tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1346 microversion: 2.1 time: 0.167400 Jul 25 19:26:50.815165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 113/209] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:50 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:51.620368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a11f3640-a2cf-4bbc-b1b6-3e223c593c2f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:51.622554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a11f3640-a2cf-4bbc-b1b6-3e223c593c2f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:51.637642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a11f3640-a2cf-4bbc-b1b6-3e223c593c2f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:51.638540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a11f3640-a2cf-4bbc-b1b6-3e223c593c2f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:51.640041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a11f3640-a2cf-4bbc-b1b6-3e223c593c2f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:51.643669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a11f3640-a2cf-4bbc-b1b6-3e223c593c2f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:51.843245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:51.845525 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:51.859960 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:51.865406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:51.871584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:51.873399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:51.949763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:51.950535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:51.951273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lazy-loading 'fault' on Instance uuid 1ad9c400-6df9-49ac-a7e5-e9336446af9e {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:26:51.951833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a11f3640-a2cf-4bbc-b1b6-3e223c593c2f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:51.976213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a11f3640-a2cf-4bbc-b1b6-3e223c593c2f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.364309 Jul 25 19:26:51.977306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 97/210] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:51 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:52.033583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30efc9bc66ce498d9d94980d85152694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6744feae17b4b32a60e06d373feb52d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:52.054432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-734b2b37-7b55-49c4-8ede-1f730204aa48 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 200 len: 1351 microversion: 2.1 time: 0.216011 Jul 25 19:26:52.070249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 114/211] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:51 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 1351 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:53.011563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a1ccd8a6-67a3-433e-949f-b4459b989fa3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:53.012486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a1ccd8a6-67a3-433e-949f-b4459b989fa3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:53.022417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1ccd8a6-67a3-433e-949f-b4459b989fa3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:53.023652 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1ccd8a6-67a3-433e-949f-b4459b989fa3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:53.025116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1ccd8a6-67a3-433e-949f-b4459b989fa3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:53.025557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1ccd8a6-67a3-433e-949f-b4459b989fa3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:53.104758 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7bf1ae11-9f87-414f-b9ca-9b9e26cb4f3f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:53.107314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7bf1ae11-9f87-414f-b9ca-9b9e26cb4f3f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:53.121256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bf1ae11-9f87-414f-b9ca-9b9e26cb4f3f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:53.122084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bf1ae11-9f87-414f-b9ca-9b9e26cb4f3f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:53.123473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bf1ae11-9f87-414f-b9ca-9b9e26cb4f3f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:53.124285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bf1ae11-9f87-414f-b9ca-9b9e26cb4f3f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:53.153372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-7bf1ae11-9f87-414f-b9ca-9b9e26cb4f3f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] HTTP exception thrown: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7bf1ae11-9f87-414f-b9ca-9b9e26cb4f3f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Request method failure captured: Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e HTTP/1.1 Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u4VHCjSSDgj0PrWltJrJ51ZvLVIPK0E4hFYew79Paz9GoqLlEz2OG2ms_oWC5a_MVYGVrWCf7aBeL0T8PMC3kN96zTo6Vn0XH09Ub3Lc6m5s--WrX2ZjvqeQRs1yREjQ9ass8pi358hh9gxHbF1jxKpkr9xLCg4pWahaW6cuKVdOls Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: a6744feae17b4b32a60e06d373feb52d Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:26:53.181570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a6744feae17b4b32a60e06d373feb52d", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: a6744feae17b4b32a60e06d373feb52d Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-DeleteServersTestJSON-1037354956-project Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 30efc9bc66ce498d9d94980d85152694 Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-DeleteServersTestJSON-1037354956-project Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:53.183089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '1ad9c400-6df9-49ac-a7e5-e9336446af9e'} Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:26:53.184069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:53.185931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:53.191095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7bf1ae11-9f87-414f-b9ca-9b9e26cb4f3f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Returning 404 to user: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:26:53.192709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7bf1ae11-9f87-414f-b9ca-9b9e26cb4f3f tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 404 len: 111 microversion: 2.1 time: 0.096523 Jul 25 19:26:53.195305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 115/212] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:53 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 19:26:53.308197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a1ccd8a6-67a3-433e-949f-b4459b989fa3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:53.319693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a1ccd8a6-67a3-433e-949f-b4459b989fa3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.314404 Jul 25 19:26:53.321360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 98/213] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:53 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:53.409049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d859af48-dd5c-4bad-9a38-e9dde4db7f07 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:53.411473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d859af48-dd5c-4bad-9a38-e9dde4db7f07 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:53.419462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d859af48-dd5c-4bad-9a38-e9dde4db7f07 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:53.420025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d859af48-dd5c-4bad-9a38-e9dde4db7f07 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:53.420856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d859af48-dd5c-4bad-9a38-e9dde4db7f07 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:53.421172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d859af48-dd5c-4bad-9a38-e9dde4db7f07 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:53.444907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-d859af48-dd5c-4bad-9a38-e9dde4db7f07 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] HTTP exception thrown: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d859af48-dd5c-4bad-9a38-e9dde4db7f07 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Request method failure captured: Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e/os-volume_attachments HTTP/1.1 Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u4VHCjSSDgj0PrWltJrJ51ZvLVIPK0E4hFYew79Paz9GoqLlEz2OG2ms_oWC5a_MVYGVrWCf7aBeL0T8PMC3kN96zTo6Vn0XH09Ub3Lc6m5s--WrX2ZjvqeQRs1yREjQ9ass8pi358hh9gxHbF1jxKpkr9xLCg4pWahaW6cuKVdOls Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: a6744feae17b4b32a60e06d373feb52d Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:26:53.447817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a6744feae17b4b32a60e06d373feb52d", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: a6744feae17b4b32a60e06d373feb52d Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-DeleteServersTestJSON-1037354956-project Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 30efc9bc66ce498d9d94980d85152694 Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-DeleteServersTestJSON-1037354956-project Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:53.450468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '1ad9c400-6df9-49ac-a7e5-e9336446af9e'} Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:26:53.452077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:53.454774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:53.457256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d859af48-dd5c-4bad-9a38-e9dde4db7f07 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Returning 404 to user: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:26:53.460337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d859af48-dd5c-4bad-9a38-e9dde4db7f07 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055422 Jul 25 19:26:53.462156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 116/214] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:26:53 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 19:26:54.362393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2f99e9c4-e9f7-409c-b0e8-6a2232e4fc3a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:54.363386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2f99e9c4-e9f7-409c-b0e8-6a2232e4fc3a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:54.376858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f99e9c4-e9f7-409c-b0e8-6a2232e4fc3a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:54.377737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f99e9c4-e9f7-409c-b0e8-6a2232e4fc3a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:54.379195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f99e9c4-e9f7-409c-b0e8-6a2232e4fc3a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:54.380041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f99e9c4-e9f7-409c-b0e8-6a2232e4fc3a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:54.813083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-428fab5b-c2a2-4b6e-b905-9d42f44c27f8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:54.813989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-428fab5b-c2a2-4b6e-b905-9d42f44c27f8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:54.826445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-428fab5b-c2a2-4b6e-b905-9d42f44c27f8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:54.827257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-428fab5b-c2a2-4b6e-b905-9d42f44c27f8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:54.828801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-428fab5b-c2a2-4b6e-b905-9d42f44c27f8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:54.829571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-428fab5b-c2a2-4b6e-b905-9d42f44c27f8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:54.852628 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-428fab5b-c2a2-4b6e-b905-9d42f44c27f8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] HTTP exception thrown: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-428fab5b-c2a2-4b6e-b905-9d42f44c27f8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Request method failure captured: Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e HTTP/1.1 Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u4VHCjSSDgj0PrWltJrJ51ZvLVIPK0E4hFYew79Paz9GoqLlEz2OG2ms_oWC5a_MVYGVrWCf7aBeL0T8PMC3kN96zTo6Vn0XH09Ub3Lc6m5s--WrX2ZjvqeQRs1yREjQ9ass8pi358hh9gxHbF1jxKpkr9xLCg4pWahaW6cuKVdOls Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: a6744feae17b4b32a60e06d373feb52d Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:26:54.854222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a6744feae17b4b32a60e06d373feb52d", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: a6744feae17b4b32a60e06d373feb52d Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-DeleteServersTestJSON-1037354956-project Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 30efc9bc66ce498d9d94980d85152694 Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-DeleteServersTestJSON-1037354956-project Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:54.856712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '1ad9c400-6df9-49ac-a7e5-e9336446af9e'} Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:26:54.858139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:54.861832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:54.867703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-428fab5b-c2a2-4b6e-b905-9d42f44c27f8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Returning 404 to user: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:26:54.867703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-428fab5b-c2a2-4b6e-b905-9d42f44c27f8 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 404 len: 111 microversion: 2.1 time: 0.049496 Jul 25 19:26:54.867703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 117/215] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:26:54 2022] DELETE /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:26:54.868761 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f79321eb-6294-492c-99a6-f3ab520ea924 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:54.869390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f79321eb-6294-492c-99a6-f3ab520ea924 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] [instance: 1ad9c400-6df9-49ac-a7e5-e9336446af9e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:54.876717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f79321eb-6294-492c-99a6-f3ab520ea924 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:54.876962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2f99e9c4-e9f7-409c-b0e8-6a2232e4fc3a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:54.877295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f79321eb-6294-492c-99a6-f3ab520ea924 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:54.877998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f79321eb-6294-492c-99a6-f3ab520ea924 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:54.878460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f79321eb-6294-492c-99a6-f3ab520ea924 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:54.888749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2f99e9c4-e9f7-409c-b0e8-6a2232e4fc3a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.533400 Jul 25 19:26:54.889390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 99/216] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:54 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:54.904020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-f79321eb-6294-492c-99a6-f3ab520ea924 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] HTTP exception thrown: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f79321eb-6294-492c-99a6-f3ab520ea924 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Request method failure captured: Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e HTTP/1.1 Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u4VHCjSSDgj0PrWltJrJ51ZvLVIPK0E4hFYew79Paz9GoqLlEz2OG2ms_oWC5a_MVYGVrWCf7aBeL0T8PMC3kN96zTo6Vn0XH09Ub3Lc6m5s--WrX2ZjvqeQRs1yREjQ9ass8pi358hh9gxHbF1jxKpkr9xLCg4pWahaW6cuKVdOls Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: a6744feae17b4b32a60e06d373feb52d Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:26:54.907215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a6744feae17b4b32a60e06d373feb52d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a6744feae17b4b32a60e06d373feb52d", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: a6744feae17b4b32a60e06d373feb52d Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-DeleteServersTestJSON-1037354956 Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-DeleteServersTestJSON-1037354956-project Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 30efc9bc66ce498d9d94980d85152694 Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-DeleteServersTestJSON-1037354956-project Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:54.908580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '1ad9c400-6df9-49ac-a7e5-e9336446af9e'} Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:26:54.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. Jul 25 19:26:54.910397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:26:54.911365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f79321eb-6294-492c-99a6-f3ab520ea924 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] Returning 404 to user: Instance 1ad9c400-6df9-49ac-a7e5-e9336446af9e could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:26:54.911365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f79321eb-6294-492c-99a6-f3ab520ea924 tempest-DeleteServersTestJSON-1037354956 tempest-DeleteServersTestJSON-1037354956-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e" status: 404 len: 111 microversion: 2.1 time: 0.046136 Jul 25 19:26:54.912164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 118/217] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:54 2022] GET /compute/v2.1/servers/1ad9c400-6df9-49ac-a7e5-e9336446af9e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:26:55.930402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5fd8e9c1-cc71-4e0b-8186-14837f327ae8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:55.933899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5fd8e9c1-cc71-4e0b-8186-14837f327ae8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:55.964502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5fd8e9c1-cc71-4e0b-8186-14837f327ae8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:55.965849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5fd8e9c1-cc71-4e0b-8186-14837f327ae8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:55.967693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5fd8e9c1-cc71-4e0b-8186-14837f327ae8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:55.968960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5fd8e9c1-cc71-4e0b-8186-14837f327ae8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:56.269996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5fd8e9c1-cc71-4e0b-8186-14837f327ae8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:56.284577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5fd8e9c1-cc71-4e0b-8186-14837f327ae8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.362803 Jul 25 19:26:56.285890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 100/218] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:55 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:57.329792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f17a21d0-3418-4eab-9db6-2c72e8693657 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:57.331175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f17a21d0-3418-4eab-9db6-2c72e8693657 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:57.386560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f17a21d0-3418-4eab-9db6-2c72e8693657 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:57.387202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f17a21d0-3418-4eab-9db6-2c72e8693657 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:57.388674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f17a21d0-3418-4eab-9db6-2c72e8693657 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:57.389601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f17a21d0-3418-4eab-9db6-2c72e8693657 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:57.794951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f17a21d0-3418-4eab-9db6-2c72e8693657 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:57.822875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f17a21d0-3418-4eab-9db6-2c72e8693657 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.500191 Jul 25 19:26:57.824914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 119/219] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:57 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:58.861110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d49fea83-d318-4384-8727-761e4d6b3069 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:58.863340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d49fea83-d318-4384-8727-761e4d6b3069 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:58.892505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d49fea83-d318-4384-8727-761e4d6b3069 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:58.896396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d49fea83-d318-4384-8727-761e4d6b3069 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:58.902118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d49fea83-d318-4384-8727-761e4d6b3069 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:58.903057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d49fea83-d318-4384-8727-761e4d6b3069 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:59.625097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d49fea83-d318-4384-8727-761e4d6b3069 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:59.660434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d49fea83-d318-4384-8727-761e4d6b3069 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.787700 Jul 25 19:26:59.660434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 101/220] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:58 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:00.689295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ab65c7f7-a217-406e-880c-08f76d76990b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:00.696615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ab65c7f7-a217-406e-880c-08f76d76990b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:00.718080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab65c7f7-a217-406e-880c-08f76d76990b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:00.718763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab65c7f7-a217-406e-880c-08f76d76990b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:00.728900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab65c7f7-a217-406e-880c-08f76d76990b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:00.729927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab65c7f7-a217-406e-880c-08f76d76990b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:00.748023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=96 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:01.095937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ab65c7f7-a217-406e-880c-08f76d76990b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:01.133025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ab65c7f7-a217-406e-880c-08f76d76990b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.457237 Jul 25 19:27:01.141001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 120/221] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:00 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:02.183693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a272fae0-16e5-4e22-a1b2-105abe234bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:02.184823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a272fae0-16e5-4e22-a1b2-105abe234bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:02.189260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:02.213586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a272fae0-16e5-4e22-a1b2-105abe234bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:02.214567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a272fae0-16e5-4e22-a1b2-105abe234bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:02.218757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a272fae0-16e5-4e22-a1b2-105abe234bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:02.219534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a272fae0-16e5-4e22-a1b2-105abe234bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:02.762606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a272fae0-16e5-4e22-a1b2-105abe234bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:02.780969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a272fae0-16e5-4e22-a1b2-105abe234bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.611995 Jul 25 19:27:02.781940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 102/222] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:02 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:03.831388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b64b71b6-9fb8-437b-9e33-25810bfdf3c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:03.835995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b64b71b6-9fb8-437b-9e33-25810bfdf3c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:03.854420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b64b71b6-9fb8-437b-9e33-25810bfdf3c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:03.859395 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b64b71b6-9fb8-437b-9e33-25810bfdf3c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:03.862174 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b64b71b6-9fb8-437b-9e33-25810bfdf3c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:03.863380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b64b71b6-9fb8-437b-9e33-25810bfdf3c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:04.230887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b64b71b6-9fb8-437b-9e33-25810bfdf3c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:04.277158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b64b71b6-9fb8-437b-9e33-25810bfdf3c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.465663 Jul 25 19:27:04.278522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 121/223] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:03 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:05.318285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7af5d859-3380-4234-a4d3-78672eb79991 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:05.322330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7af5d859-3380-4234-a4d3-78672eb79991 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:05.348100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7af5d859-3380-4234-a4d3-78672eb79991 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:05.349352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7af5d859-3380-4234-a4d3-78672eb79991 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:05.352895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7af5d859-3380-4234-a4d3-78672eb79991 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:05.355142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7af5d859-3380-4234-a4d3-78672eb79991 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:05.868254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7af5d859-3380-4234-a4d3-78672eb79991 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:05.885474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7af5d859-3380-4234-a4d3-78672eb79991 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.584441 Jul 25 19:27:05.891778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 103/224] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:05 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:06.927650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2fd060cf-1491-4421-91d3-7a4d176d589f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:06.929386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2fd060cf-1491-4421-91d3-7a4d176d589f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:06.948912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fd060cf-1491-4421-91d3-7a4d176d589f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:06.951012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fd060cf-1491-4421-91d3-7a4d176d589f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:06.951999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fd060cf-1491-4421-91d3-7a4d176d589f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:06.952699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fd060cf-1491-4421-91d3-7a4d176d589f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:07.211004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1587483223", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:07.361308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] validate_networks() for None {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:27:07.756622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2fd060cf-1491-4421-91d3-7a4d176d589f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:07.793694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2fd060cf-1491-4421-91d3-7a4d176d589f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.871598 Jul 25 19:27:07.796508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 122/225] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:06 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:08.115937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:27:08.116624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:27:08.117266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:27:08.117679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:27:08.118094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:27:08.141330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:08.143650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:08.147057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:08.148396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:08.199096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Getting quotas for project a092c7d1ac694eab812fe205ccbe5434. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:27:08.210248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Getting quotas for user dc63fdeacd514eac8e4a5882190f8d66 and project a092c7d1ac694eab812fe205ccbe5434. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:27:08.236074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:27:08.244302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:27:08.408290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2ebe764e-5ce6-40e5-8b0f-bd77f0926e2a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206028 Jul 25 19:27:08.410727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 104/226] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:27:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:27:08.431922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ac36bd8-b9d7-4786-8bf0-2d618173c848 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:08.433232 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ac36bd8-b9d7-4786-8bf0-2d618173c848 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:08.569713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0ac36bd8-b9d7-4786-8bf0-2d618173c848 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:08.603018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ac36bd8-b9d7-4786-8bf0-2d618173c848 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1215 microversion: 2.1 time: 0.177887 Jul 25 19:27:08.625318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 123/227] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:08 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:08.838001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-608ec68a-6775-4822-9bee-80f91aab6e45 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:08.840689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-608ec68a-6775-4822-9bee-80f91aab6e45 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:08.873080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-608ec68a-6775-4822-9bee-80f91aab6e45 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:08.876165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-608ec68a-6775-4822-9bee-80f91aab6e45 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:08.897014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-608ec68a-6775-4822-9bee-80f91aab6e45 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:08.903476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-608ec68a-6775-4822-9bee-80f91aab6e45 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:09.326847 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-608ec68a-6775-4822-9bee-80f91aab6e45 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:09.348848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-608ec68a-6775-4822-9bee-80f91aab6e45 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.533008 Jul 25 19:27:09.351906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 105/228] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:08 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:09.649755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-82dfb534-d834-4bbf-9d22-d6f157a5cf34 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:09.653075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-82dfb534-d834-4bbf-9d22-d6f157a5cf34 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:09.832922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-82dfb534-d834-4bbf-9d22-d6f157a5cf34 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:09.874502 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-82dfb534-d834-4bbf-9d22-d6f157a5cf34 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1215 microversion: 2.1 time: 0.231749 Jul 25 19:27:09.883860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 124/229] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:09 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:10.389916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df8fcfef-9006-44e2-86c3-57dad5a74e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:10.391915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df8fcfef-9006-44e2-86c3-57dad5a74e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:10.406898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df8fcfef-9006-44e2-86c3-57dad5a74e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:10.408237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df8fcfef-9006-44e2-86c3-57dad5a74e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:10.413370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df8fcfef-9006-44e2-86c3-57dad5a74e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:10.414981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df8fcfef-9006-44e2-86c3-57dad5a74e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:10.508471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:10.930827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4be8e85b-1c4c-478f-b1ee-7052b5e13bad tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:10.931978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4be8e85b-1c4c-478f-b1ee-7052b5e13bad tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:10.939479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df8fcfef-9006-44e2-86c3-57dad5a74e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:10.972749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4be8e85b-1c4c-478f-b1ee-7052b5e13bad tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:10.973740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4be8e85b-1c4c-478f-b1ee-7052b5e13bad tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:10.976561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4be8e85b-1c4c-478f-b1ee-7052b5e13bad tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:10.980418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4be8e85b-1c4c-478f-b1ee-7052b5e13bad tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:10.981157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df8fcfef-9006-44e2-86c3-57dad5a74e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 0.599624 Jul 25 19:27:10.982541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 106/230] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:10 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:11.290679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4be8e85b-1c4c-478f-b1ee-7052b5e13bad tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:11.338185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4be8e85b-1c4c-478f-b1ee-7052b5e13bad tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1267 microversion: 2.1 time: 0.422124 Jul 25 19:27:11.342767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 125/231] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:10 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1267 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:12.027677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-28fa165b-3c03-4a0c-be1d-d511b13cf335 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:12.028891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-28fa165b-3c03-4a0c-be1d-d511b13cf335 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:12.053602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28fa165b-3c03-4a0c-be1d-d511b13cf335 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:12.054486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28fa165b-3c03-4a0c-be1d-d511b13cf335 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:12.056727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28fa165b-3c03-4a0c-be1d-d511b13cf335 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:12.057514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28fa165b-3c03-4a0c-be1d-d511b13cf335 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:12.385684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-088402ba-c25e-47c9-a7dc-48caf8e53367 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:12.393760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-088402ba-c25e-47c9-a7dc-48caf8e53367 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:12.417631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088402ba-c25e-47c9-a7dc-48caf8e53367 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:12.418507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088402ba-c25e-47c9-a7dc-48caf8e53367 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:12.419787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088402ba-c25e-47c9-a7dc-48caf8e53367 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:12.420538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088402ba-c25e-47c9-a7dc-48caf8e53367 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:12.760479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-088402ba-c25e-47c9-a7dc-48caf8e53367 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:12.795680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-088402ba-c25e-47c9-a7dc-48caf8e53367 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1273 microversion: 2.1 time: 0.413193 Jul 25 19:27:12.797266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 126/232] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:12 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1273 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:13.855550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-243327ad-293a-4498-abc3-c61c7c68ba50 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:13.857117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-243327ad-293a-4498-abc3-c61c7c68ba50 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:13.872434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-243327ad-293a-4498-abc3-c61c7c68ba50 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:13.880164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-243327ad-293a-4498-abc3-c61c7c68ba50 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:13.882424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-243327ad-293a-4498-abc3-c61c7c68ba50 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:13.892279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-243327ad-293a-4498-abc3-c61c7c68ba50 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:13.907249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-28fa165b-3c03-4a0c-be1d-d511b13cf335 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:13.939744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-28fa165b-3c03-4a0c-be1d-d511b13cf335 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 1.921649 Jul 25 19:27:13.941388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 107/233] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:12 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:14.420974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-243327ad-293a-4498-abc3-c61c7c68ba50 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:14.440924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-243327ad-293a-4498-abc3-c61c7c68ba50 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1273 microversion: 2.1 time: 0.603019 Jul 25 19:27:14.442424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 127/234] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:13 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1273 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:14.990818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-16d4234b-c1af-425e-bf7b-481fd6cc0802 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:14.994411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-16d4234b-c1af-425e-bf7b-481fd6cc0802 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:15.020246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16d4234b-c1af-425e-bf7b-481fd6cc0802 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:15.023208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16d4234b-c1af-425e-bf7b-481fd6cc0802 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:15.025726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16d4234b-c1af-425e-bf7b-481fd6cc0802 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:15.027132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16d4234b-c1af-425e-bf7b-481fd6cc0802 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:15.500816 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-497d7a74-7b26-4c7a-82c0-ca9efb8c6f1c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:15.509188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-497d7a74-7b26-4c7a-82c0-ca9efb8c6f1c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:15.543334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-497d7a74-7b26-4c7a-82c0-ca9efb8c6f1c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:15.550140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-497d7a74-7b26-4c7a-82c0-ca9efb8c6f1c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:15.558224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-497d7a74-7b26-4c7a-82c0-ca9efb8c6f1c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:15.575676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-497d7a74-7b26-4c7a-82c0-ca9efb8c6f1c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:15.939626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-16d4234b-c1af-425e-bf7b-481fd6cc0802 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:15.986746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-16d4234b-c1af-425e-bf7b-481fd6cc0802 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1522 microversion: 2.1 time: 1.007132 Jul 25 19:27:16.004634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 108/235] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:14 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1522 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:16.208102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-497d7a74-7b26-4c7a-82c0-ca9efb8c6f1c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:16.231500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-497d7a74-7b26-4c7a-82c0-ca9efb8c6f1c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1273 microversion: 2.1 time: 0.741375 Jul 25 19:27:16.236599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 128/236] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:15 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1273 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:17.034747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d543c06f-3cb2-478c-a7b9-32a906143ddf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:17.035687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d543c06f-3cb2-478c-a7b9-32a906143ddf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:17.055965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d543c06f-3cb2-478c-a7b9-32a906143ddf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:17.056777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d543c06f-3cb2-478c-a7b9-32a906143ddf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:17.057765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d543c06f-3cb2-478c-a7b9-32a906143ddf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:17.058324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d543c06f-3cb2-478c-a7b9-32a906143ddf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:17.278715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af75b5c5-3728-49cf-a1ec-c4d30ffd06a9 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:17.282491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af75b5c5-3728-49cf-a1ec-c4d30ffd06a9 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:17.287805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=46 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:17.299865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af75b5c5-3728-49cf-a1ec-c4d30ffd06a9 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:17.300900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af75b5c5-3728-49cf-a1ec-c4d30ffd06a9 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:17.302577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af75b5c5-3728-49cf-a1ec-c4d30ffd06a9 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:17.303321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af75b5c5-3728-49cf-a1ec-c4d30ffd06a9 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:17.702443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d543c06f-3cb2-478c-a7b9-32a906143ddf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:17.742160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d543c06f-3cb2-478c-a7b9-32a906143ddf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1502 microversion: 2.1 time: 0.712727 Jul 25 19:27:17.756608 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 109/237] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:17 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1502 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:17.783347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-af75b5c5-3728-49cf-a1ec-c4d30ffd06a9 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:17.813307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af75b5c5-3728-49cf-a1ec-c4d30ffd06a9 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1315 microversion: 2.1 time: 0.545064 Jul 25 19:27:17.823618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 129/238] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:17 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:17.829005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ec128a49-3889-44d0-97ac-50a87c9bb552 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:17.829671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ec128a49-3889-44d0-97ac-50a87c9bb552 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:17.867198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec128a49-3889-44d0-97ac-50a87c9bb552 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:17.868283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec128a49-3889-44d0-97ac-50a87c9bb552 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:17.869814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec128a49-3889-44d0-97ac-50a87c9bb552 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:17.870632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec128a49-3889-44d0-97ac-50a87c9bb552 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:18.175496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:18.228121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=6 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:18.580302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ec128a49-3889-44d0-97ac-50a87c9bb552 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:18.615099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ec128a49-3889-44d0-97ac-50a87c9bb552 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1514 microversion: 2.1 time: 0.787671 Jul 25 19:27:18.617549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 130/239] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:17 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1514 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:18.713894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-01ed6100-3f31-4304-ba11-39cbeae0b598 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Action: 'create', calling method: .version_select at 0x7feafb616e50>, body: {"keypair": {"name": "tempest-keypair-925335282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQRlKbbJ26gV13LZGGgqsYWwFiYiPWxwpm8c5SYfmdBjiYgOrydabaXKuLgmssBMljTbQYspfp79KfWWbMiUSpqcC8fpijA4Wsr4eXjA9b/4viW4mYD1Tb4lHJTdn6Kxw=="}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:18.763376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-01ed6100-3f31-4304-ba11-39cbeae0b598 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Getting quotas for project ac9a533f6f6f49e2bd73771fc99919c0. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:27:18.777334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-01ed6100-3f31-4304-ba11-39cbeae0b598 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Getting quotas for user 581ae6d40d34447da6651f3b2c21bdf0 and project ac9a533f6f6f49e2bd73771fc99919c0. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:27:18.827297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-974244856", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "networks": [{"uuid": "b42ccee9-c8ef-49d3-8102-8319595ff383"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:18.862146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-01ed6100-3f31-4304-ba11-39cbeae0b598 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.101741 Jul 25 19:27:18.863429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 110/240] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Jul 25 19:27:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:18.871278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1b6b6e64-bd12-44af-b4dd-d1925457a4c5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:18.872285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1b6b6e64-bd12-44af-b4dd-d1925457a4c5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:18.901508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b6b6e64-bd12-44af-b4dd-d1925457a4c5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:18.903978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b6b6e64-bd12-44af-b4dd-d1925457a4c5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:18.907435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b6b6e64-bd12-44af-b4dd-d1925457a4c5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:18.908834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b6b6e64-bd12-44af-b4dd-d1925457a4c5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:19.089751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] validate_networks() for [('b42ccee9-c8ef-49d3-8102-8319595ff383', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:27:19.766689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1b6b6e64-bd12-44af-b4dd-d1925457a4c5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:19.811211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1b6b6e64-bd12-44af-b4dd-d1925457a4c5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1315 microversion: 2.1 time: 0.939006 Jul 25 19:27:19.814568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 111/241] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:18 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1315 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:19.840210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:20.855911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-34f05676-7eef-4390-ac76-03a1db30b4c3 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:20.856733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-34f05676-7eef-4390-ac76-03a1db30b4c3 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:20.868399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34f05676-7eef-4390-ac76-03a1db30b4c3 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:20.868946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34f05676-7eef-4390-ac76-03a1db30b4c3 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:20.869855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34f05676-7eef-4390-ac76-03a1db30b4c3 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:20.871266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34f05676-7eef-4390-ac76-03a1db30b4c3 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:21.421683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:27:21.422797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:27:21.423812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:27:21.425942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:27:21.427157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:27:21.449790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:21.451096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:21.453939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:21.455885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:21.479608 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-34f05676-7eef-4390-ac76-03a1db30b4c3 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:21.492135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-34f05676-7eef-4390-ac76-03a1db30b4c3 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1315 microversion: 2.1 time: 0.640944 Jul 25 19:27:21.494085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 112/242] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:20 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:21.505712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Getting quotas for project 43cfdd0ba7de4e46a17d4c0d698159cf. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:27:21.515361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Getting quotas for user 324738dd872e445ba845a101f45fa595 and project 43cfdd0ba7de4e46a17d4c0d698159cf. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:27:21.528848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-436f0252-b73d-4973-998a-1caa7dfaa361 req-86eb036e-c981-4f5f-aa0a-3238660d6471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9925bc-3de1-46c3-b42d-b93789c0e56a", "tag": "f736798d-e590-4b06-95c8-2bbd73208b66"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:21.557277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:27:21.561926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:27:21.608297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-436f0252-b73d-4973-998a-1caa7dfaa361 req-86eb036e-c981-4f5f-aa0a-3238660d6471 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:21.610056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-436f0252-b73d-4973-998a-1caa7dfaa361 req-86eb036e-c981-4f5f-aa0a-3238660d6471 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:21.669099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-436f0252-b73d-4973-998a-1caa7dfaa361 req-86eb036e-c981-4f5f-aa0a-3238660d6471 service nova] Creating event network-changed:f736798d-e590-4b06-95c8-2bbd73208b66 for instance 6e9925bc-3de1-46c3-b42d-b93789c0e56a on hv-cinder-85093 Jul 25 19:27:21.699173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-436f0252-b73d-4973-998a-1caa7dfaa361 req-86eb036e-c981-4f5f-aa0a-3238660d6471 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193866 Jul 25 19:27:21.701068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 113/243] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:21.717116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-45273e26-eb45-426c-9b7b-f8b56a283b2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:21.725163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-45273e26-eb45-426c-9b7b-f8b56a283b2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:21.757963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b8c7b0a-cd36-42dc-8dc6-1b231d7f6734 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.945321 Jul 25 19:27:21.763161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 131/244] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:27:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 19:27:21.777816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-45273e26-eb45-426c-9b7b-f8b56a283b2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:21.780059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-45273e26-eb45-426c-9b7b-f8b56a283b2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:21.789194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-45273e26-eb45-426c-9b7b-f8b56a283b2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:21.790749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-45273e26-eb45-426c-9b7b-f8b56a283b2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:21.794813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a13853a-6687-437e-a996-a2b08f68b7c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:21.795881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a13853a-6687-437e-a996-a2b08f68b7c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:21.884721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-45273e26-eb45-426c-9b7b-f8b56a283b2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lazy-loading 'flavor' on Instance uuid 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:27:22.000488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a13853a-6687-437e-a996-a2b08f68b7c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:22.032039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a13853a-6687-437e-a996-a2b08f68b7c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1218 microversion: 2.1 time: 0.256269 Jul 25 19:27:22.033169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 132/245] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:21 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:22.174569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-45273e26-eb45-426c-9b7b-f8b56a283b2c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "POST /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a/action" status: 200 len: 32 microversion: 2.1 time: 0.470692 Jul 25 19:27:22.212071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 114/246] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 19:27:21 2022] POST /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a/action => generated 32 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:27:22.218486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-093b0503-db98-430e-89f3-0147e7fca123 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:22.222861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-093b0503-db98-430e-89f3-0147e7fca123 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:22.290052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-093b0503-db98-430e-89f3-0147e7fca123 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:22.299014 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-093b0503-db98-430e-89f3-0147e7fca123 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:22.301036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-093b0503-db98-430e-89f3-0147e7fca123 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:22.302087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-093b0503-db98-430e-89f3-0147e7fca123 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:22.544254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-15726498-d274-4ff0-917e-6f51091adba5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:22.548323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-15726498-d274-4ff0-917e-6f51091adba5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:22.590073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15726498-d274-4ff0-917e-6f51091adba5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:22.590759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15726498-d274-4ff0-917e-6f51091adba5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:22.592300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15726498-d274-4ff0-917e-6f51091adba5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:22.593060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15726498-d274-4ff0-917e-6f51091adba5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:23.797867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-093b0503-db98-430e-89f3-0147e7fca123 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:23.844557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-093b0503-db98-430e-89f3-0147e7fca123 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 1.654885 Jul 25 19:27:23.847420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 133/247] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:22 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:23.864207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0714469f-5e7c-4f1f-aa1b-0bb00db77760 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:23.868050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0714469f-5e7c-4f1f-aa1b-0bb00db77760 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:23.885655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0714469f-5e7c-4f1f-aa1b-0bb00db77760 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:23.889108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0714469f-5e7c-4f1f-aa1b-0bb00db77760 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:23.890249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0714469f-5e7c-4f1f-aa1b-0bb00db77760 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:23.892451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0714469f-5e7c-4f1f-aa1b-0bb00db77760 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:24.149337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-15726498-d274-4ff0-917e-6f51091adba5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:24.157667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-15726498-d274-4ff0-917e-6f51091adba5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1315 microversion: 2.1 time: 1.632970 Jul 25 19:27:24.158294 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 115/248] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:22 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1315 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:24.168183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0714469f-5e7c-4f1f-aa1b-0bb00db77760 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:24.171202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-34242652-4179-470f-ab55-6e03ac5f81d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:24.172615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-34242652-4179-470f-ab55-6e03ac5f81d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:24.188673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34242652-4179-470f-ab55-6e03ac5f81d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:24.189511 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34242652-4179-470f-ab55-6e03ac5f81d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:24.192082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34242652-4179-470f-ab55-6e03ac5f81d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:24.194627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34242652-4179-470f-ab55-6e03ac5f81d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:24.198953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0714469f-5e7c-4f1f-aa1b-0bb00db77760 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1214 microversion: 2.1 time: 0.348486 Jul 25 19:27:24.199843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 134/249] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:23 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1214 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:24.246732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-34242652-4179-470f-ab55-6e03ac5f81d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/ips" status: 200 len: 152 microversion: 2.20 time: 0.063353 Jul 25 19:27:24.248102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 116/250] 10.222.0.18 () {60 vars in 1289 bytes} [Mon Jul 25 19:27:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/ips => generated 152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:27:24.434053 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1642261748", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34810a1c-22b1-48d9-b272-3e2c508f82c9"}], "security_groups": [{"name": "tempest-securitygroup--66437607"}], "key_name": "tempest-keypair-925335282", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:24.715620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] validate_networks() for [('34810a1c-22b1-48d9-b272-3e2c508f82c9', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:27:24.895901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-16a77bd8-4118-493b-bef6-d355f2b58a25 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:24.897097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-16a77bd8-4118-493b-bef6-d355f2b58a25 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:24.938885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16a77bd8-4118-493b-bef6-d355f2b58a25 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:24.944674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16a77bd8-4118-493b-bef6-d355f2b58a25 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:24.946420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16a77bd8-4118-493b-bef6-d355f2b58a25 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:24.948111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16a77bd8-4118-493b-bef6-d355f2b58a25 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:25.415965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-16a77bd8-4118-493b-bef6-d355f2b58a25 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:25.442951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-16a77bd8-4118-493b-bef6-d355f2b58a25 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.559616 Jul 25 19:27:25.468081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 117/251] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:24 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:25.489732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aa50108c-73dc-41b7-aa42-53b98b9e657c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:25.492237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aa50108c-73dc-41b7-aa42-53b98b9e657c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:25.510713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa50108c-73dc-41b7-aa42-53b98b9e657c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:25.526264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa50108c-73dc-41b7-aa42-53b98b9e657c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:25.527251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa50108c-73dc-41b7-aa42-53b98b9e657c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:25.527906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa50108c-73dc-41b7-aa42-53b98b9e657c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:25.983387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:27:25.984741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:27:25.985300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:27:25.985923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:27:25.986422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:27:26.018782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:26.019273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:26.020481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:26.021957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:26.056194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Getting quotas for project ac9a533f6f6f49e2bd73771fc99919c0. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:27:26.066698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-aa50108c-73dc-41b7-aa42-53b98b9e657c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:26.071456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Getting quotas for user 581ae6d40d34447da6651f3b2c21bdf0 and project ac9a533f6f6f49e2bd73771fc99919c0. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:27:26.081332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aa50108c-73dc-41b7-aa42-53b98b9e657c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1315 microversion: 2.1 time: 0.611060 Jul 25 19:27:26.098189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 118/252] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:25 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:26.115192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-723f2ff1-7343-490e-9fd3-007574a81cc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:26.124118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-723f2ff1-7343-490e-9fd3-007574a81cc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:26.136102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:27:26.141538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:27:26.150888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-723f2ff1-7343-490e-9fd3-007574a81cc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:26.151347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-723f2ff1-7343-490e-9fd3-007574a81cc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:26.152209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-723f2ff1-7343-490e-9fd3-007574a81cc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:26.152789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-723f2ff1-7343-490e-9fd3-007574a81cc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:26.294542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-961872a2-1400-4116-9c32-791018162cbb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.864360 Jul 25 19:27:26.296893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 135/253] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:27:24 2022] POST /compute/v2.1/servers => generated 400 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:27:26.319729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0f456aa-5950-4154-a9b8-1df3cee44374 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:26.321511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d0f456aa-5950-4154-a9b8-1df3cee44374 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:26.600447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-723f2ff1-7343-490e-9fd3-007574a81cc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:26.605034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d0f456aa-5950-4154-a9b8-1df3cee44374 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:26.621623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-723f2ff1-7343-490e-9fd3-007574a81cc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1278 microversion: 2.1 time: 0.519095 Jul 25 19:27:26.625432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d0f456aa-5950-4154-a9b8-1df3cee44374 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1237 microversion: 2.1 time: 0.314942 Jul 25 19:27:26.626339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 119/254] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:26 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1278 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:26.626537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 136/255] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:26 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1237 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:26.649808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aa82d12d-1122-41a8-9b2c-46ef689026d2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:26.651052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aa82d12d-1122-41a8-9b2c-46ef689026d2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:26.660951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa82d12d-1122-41a8-9b2c-46ef689026d2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:26.662170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa82d12d-1122-41a8-9b2c-46ef689026d2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:26.665985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa82d12d-1122-41a8-9b2c-46ef689026d2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:26.666736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa82d12d-1122-41a8-9b2c-46ef689026d2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:27.107747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb36e2b8-249c-4def-bfe4-c6b338595482 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:27.108510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb36e2b8-249c-4def-bfe4-c6b338595482 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:27.126562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb36e2b8-249c-4def-bfe4-c6b338595482 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:27.137865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb36e2b8-249c-4def-bfe4-c6b338595482 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:27.144013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb36e2b8-249c-4def-bfe4-c6b338595482 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:27.144998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb36e2b8-249c-4def-bfe4-c6b338595482 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:27.368755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-aa82d12d-1122-41a8-9b2c-46ef689026d2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:27.383588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aa82d12d-1122-41a8-9b2c-46ef689026d2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.755213 Jul 25 19:27:27.384863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 120/256] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:26 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:27.653668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ef1604d7-6c39-4420-a516-cc8ddb8d8c38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:27.655059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ef1604d7-6c39-4420-a516-cc8ddb8d8c38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:27.700580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef1604d7-6c39-4420-a516-cc8ddb8d8c38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:27.702920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef1604d7-6c39-4420-a516-cc8ddb8d8c38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:27.705190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef1604d7-6c39-4420-a516-cc8ddb8d8c38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:27.706119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef1604d7-6c39-4420-a516-cc8ddb8d8c38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:27.920057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fb36e2b8-249c-4def-bfe4-c6b338595482 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:27.939948 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb36e2b8-249c-4def-bfe4-c6b338595482 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1315 microversion: 2.1 time: 0.837073 Jul 25 19:27:27.944641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 137/257] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:27 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:27.959483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-57a1fee2-6090-4adb-98bc-a422a1012dbe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:27.965323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-57a1fee2-6090-4adb-98bc-a422a1012dbe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:27.981392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a1fee2-6090-4adb-98bc-a422a1012dbe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:27.982199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a1fee2-6090-4adb-98bc-a422a1012dbe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:27.983599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a1fee2-6090-4adb-98bc-a422a1012dbe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:27.991632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a1fee2-6090-4adb-98bc-a422a1012dbe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:28.069073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ef1604d7-6c39-4420-a516-cc8ddb8d8c38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:28.098830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ef1604d7-6c39-4420-a516-cc8ddb8d8c38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1289 microversion: 2.1 time: 0.450854 Jul 25 19:27:28.101012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 121/258] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:27 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1289 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:28.145187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3586d61d-90e0-4a74-ac25-a6417f87810f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:28.148730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3586d61d-90e0-4a74-ac25-a6417f87810f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:28.151192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-57a1fee2-6090-4adb-98bc-a422a1012dbe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:28.166505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3586d61d-90e0-4a74-ac25-a6417f87810f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:28.167719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3586d61d-90e0-4a74-ac25-a6417f87810f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:28.169596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3586d61d-90e0-4a74-ac25-a6417f87810f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:28.170700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3586d61d-90e0-4a74-ac25-a6417f87810f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:28.181252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-57a1fee2-6090-4adb-98bc-a422a1012dbe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1276 microversion: 2.1 time: 0.234444 Jul 25 19:27:28.182751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 138/259] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:27 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:28.235654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-3586d61d-90e0-4a74-ac25-a6417f87810f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lazy-loading 'flavor' on Instance uuid 1007369a-dd3c-4837-95f4-e8326d600031 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:27:28.262251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:28.423804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-30554fb1-20e0-4514-9bed-e7044cb78155 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:28.427695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-30554fb1-20e0-4514-9bed-e7044cb78155 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:28.466384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30554fb1-20e0-4514-9bed-e7044cb78155 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:28.472660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30554fb1-20e0-4514-9bed-e7044cb78155 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:28.488042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30554fb1-20e0-4514-9bed-e7044cb78155 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:28.500623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30554fb1-20e0-4514-9bed-e7044cb78155 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:28.822854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:28.888314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3586d61d-90e0-4a74-ac25-a6417f87810f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "POST /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/action" status: 202 len: 0 microversion: 2.20 time: 0.750651 Jul 25 19:27:28.889293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 122/260] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Jul 25 19:27:28 2022] POST /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/action => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:27:28.904238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-af6e6cc3-28c3-40e2-b870-50274bbbc3a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:28.914273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-30554fb1-20e0-4514-9bed-e7044cb78155 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:28.926351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-af6e6cc3-28c3-40e2-b870-50274bbbc3a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:28.947028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-30554fb1-20e0-4514-9bed-e7044cb78155 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.528331 Jul 25 19:27:28.962428 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 139/261] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:28 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:28.983361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ec62520-1bf4-4630-ad57-ebc926807223 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:28.984380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ec62520-1bf4-4630-ad57-ebc926807223 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:28.986010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af6e6cc3-28c3-40e2-b870-50274bbbc3a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:28.992080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af6e6cc3-28c3-40e2-b870-50274bbbc3a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:28.994193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af6e6cc3-28c3-40e2-b870-50274bbbc3a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:28.996119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af6e6cc3-28c3-40e2-b870-50274bbbc3a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:29.004689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ec62520-1bf4-4630-ad57-ebc926807223 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:29.006413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ec62520-1bf4-4630-ad57-ebc926807223 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:29.007935 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ec62520-1bf4-4630-ad57-ebc926807223 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:29.008827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ec62520-1bf4-4630-ad57-ebc926807223 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:29.943134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ec62520-1bf4-4630-ad57-ebc926807223 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:29.960272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ec62520-1bf4-4630-ad57-ebc926807223 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1315 microversion: 2.1 time: 0.985955 Jul 25 19:27:29.963884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-af6e6cc3-28c3-40e2-b870-50274bbbc3a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:29.969921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 140/262] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:28 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:29.990046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-af6e6cc3-28c3-40e2-b870-50274bbbc3a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:29.994253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-af6e6cc3-28c3-40e2-b870-50274bbbc3a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:29.997276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-af6e6cc3-28c3-40e2-b870-50274bbbc3a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 1.101852 Jul 25 19:27:29.998549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 123/263] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:27:30.003486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4b6ea0b9-86b2-457d-a6cf-b3df3cd33554 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:30.005866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4b6ea0b9-86b2-457d-a6cf-b3df3cd33554 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:30.014362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-20a8301a-98b6-4b6a-8f93-04b8269d6947 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:30.017931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-20a8301a-98b6-4b6a-8f93-04b8269d6947 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:30.025530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b6ea0b9-86b2-457d-a6cf-b3df3cd33554 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:30.025530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b6ea0b9-86b2-457d-a6cf-b3df3cd33554 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:30.027491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b6ea0b9-86b2-457d-a6cf-b3df3cd33554 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:30.028724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b6ea0b9-86b2-457d-a6cf-b3df3cd33554 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:30.046066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-20a8301a-98b6-4b6a-8f93-04b8269d6947 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:30.047188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-20a8301a-98b6-4b6a-8f93-04b8269d6947 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:30.048796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-20a8301a-98b6-4b6a-8f93-04b8269d6947 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:30.049772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-20a8301a-98b6-4b6a-8f93-04b8269d6947 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:30.250975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4b6ea0b9-86b2-457d-a6cf-b3df3cd33554 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:30.276841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4b6ea0b9-86b2-457d-a6cf-b3df3cd33554 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1295 microversion: 2.1 time: 0.304720 Jul 25 19:27:30.278262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 141/264] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:29 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1295 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:30.289175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-37cf1852-ce47-4b63-8e7a-0bf5d3b9d146 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:30.291187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-37cf1852-ce47-4b63-8e7a-0bf5d3b9d146 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:30.306181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37cf1852-ce47-4b63-8e7a-0bf5d3b9d146 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:30.307353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37cf1852-ce47-4b63-8e7a-0bf5d3b9d146 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:30.309428 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37cf1852-ce47-4b63-8e7a-0bf5d3b9d146 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:30.310633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37cf1852-ce47-4b63-8e7a-0bf5d3b9d146 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:30.320301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:30.701772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-20a8301a-98b6-4b6a-8f93-04b8269d6947 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:30.712683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-20a8301a-98b6-4b6a-8f93-04b8269d6947 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1318 microversion: 2.1 time: 0.712058 Jul 25 19:27:30.713607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 124/265] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:29 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:30.720890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-a3a6a1f4-6af4-4fca-b871-4d96f8ccee35 req-16b36451-1cce-43db-8c1c-59b2261e79f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9925bc-3de1-46c3-b42d-b93789c0e56a", "name": "network-vif-plugged", "status": "completed", "tag": "f736798d-e590-4b06-95c8-2bbd73208b66"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:30.736043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-a3a6a1f4-6af4-4fca-b871-4d96f8ccee35 req-16b36451-1cce-43db-8c1c-59b2261e79f5 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:30.736523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-a3a6a1f4-6af4-4fca-b871-4d96f8ccee35 req-16b36451-1cce-43db-8c1c-59b2261e79f5 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:30.754078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-a3a6a1f4-6af4-4fca-b871-4d96f8ccee35 req-16b36451-1cce-43db-8c1c-59b2261e79f5 service nova] Creating event network-vif-plugged:f736798d-e590-4b06-95c8-2bbd73208b66 for instance 6e9925bc-3de1-46c3-b42d-b93789c0e56a on hv-cinder-85093 Jul 25 19:27:30.761656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-a3a6a1f4-6af4-4fca-b871-4d96f8ccee35 req-16b36451-1cce-43db-8c1c-59b2261e79f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045947 Jul 25 19:27:30.762270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 125/266] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:30.771902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b91ab5e0-bc57-4390-a643-24fafcef32d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:30.773336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b91ab5e0-bc57-4390-a643-24fafcef32d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:30.780656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b91ab5e0-bc57-4390-a643-24fafcef32d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:30.781110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b91ab5e0-bc57-4390-a643-24fafcef32d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:30.782034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b91ab5e0-bc57-4390-a643-24fafcef32d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:30.782474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b91ab5e0-bc57-4390-a643-24fafcef32d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:30.817199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b91ab5e0-bc57-4390-a643-24fafcef32d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/ips" status: 200 len: 149 microversion: 2.1 time: 0.053386 Jul 25 19:27:30.818421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 126/267] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Jul 25 19:27:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:30.867262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37cf1852-ce47-4b63-8e7a-0bf5d3b9d146 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:30.881150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-37cf1852-ce47-4b63-8e7a-0bf5d3b9d146 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.600206 Jul 25 19:27:30.882743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 142/268] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:30 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:30.999860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f6afd20a-433d-49e1-95bd-52c649205ce7 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:31.000755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f6afd20a-433d-49e1-95bd-52c649205ce7 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:31.012125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6afd20a-433d-49e1-95bd-52c649205ce7 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:31.013026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6afd20a-433d-49e1-95bd-52c649205ce7 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:31.014353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6afd20a-433d-49e1-95bd-52c649205ce7 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:31.015154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6afd20a-433d-49e1-95bd-52c649205ce7 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:31.064107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ed53c57c-e9b6-4f8a-b1e7-72092f844b07 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:31.068615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ed53c57c-e9b6-4f8a-b1e7-72092f844b07 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:31.105397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed53c57c-e9b6-4f8a-b1e7-72092f844b07 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:31.106239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed53c57c-e9b6-4f8a-b1e7-72092f844b07 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:31.108079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed53c57c-e9b6-4f8a-b1e7-72092f844b07 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:31.108872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed53c57c-e9b6-4f8a-b1e7-72092f844b07 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:31.844020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f6afd20a-433d-49e1-95bd-52c649205ce7 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:31.858151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f6afd20a-433d-49e1-95bd-52c649205ce7 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1315 microversion: 2.1 time: 0.863766 Jul 25 19:27:31.859131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 127/269] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:30 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1315 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:31.868226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dcc667b8-17e4-4188-b51c-04406b4460e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:31.869263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dcc667b8-17e4-4188-b51c-04406b4460e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:31.880849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dcc667b8-17e4-4188-b51c-04406b4460e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:31.881616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dcc667b8-17e4-4188-b51c-04406b4460e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:31.883016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dcc667b8-17e4-4188-b51c-04406b4460e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:31.883812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dcc667b8-17e4-4188-b51c-04406b4460e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:31.954695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ed53c57c-e9b6-4f8a-b1e7-72092f844b07 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:31.970137 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ed53c57c-e9b6-4f8a-b1e7-72092f844b07 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:31.973213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ed53c57c-e9b6-4f8a-b1e7-72092f844b07 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:31.976111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ed53c57c-e9b6-4f8a-b1e7-72092f844b07 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.935525 Jul 25 19:27:31.977895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 143/270] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:27:31.985466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-18a0517d-67d7-4844-b4a4-64a171e29f8c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:31.986815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-18a0517d-67d7-4844-b4a4-64a171e29f8c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:31.999238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18a0517d-67d7-4844-b4a4-64a171e29f8c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:32.000009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18a0517d-67d7-4844-b4a4-64a171e29f8c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:32.001343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18a0517d-67d7-4844-b4a4-64a171e29f8c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:32.002096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18a0517d-67d7-4844-b4a4-64a171e29f8c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:32.066623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-dcc667b8-17e4-4188-b51c-04406b4460e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:32.082911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dcc667b8-17e4-4188-b51c-04406b4460e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1295 microversion: 2.1 time: 0.221530 Jul 25 19:27:32.084772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 128/271] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:31 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1295 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:32.094289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-177f651b-f686-478e-9f30-814ce6c646e2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:32.096998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-177f651b-f686-478e-9f30-814ce6c646e2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:32.108858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-177f651b-f686-478e-9f30-814ce6c646e2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:32.109307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-177f651b-f686-478e-9f30-814ce6c646e2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:32.110339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-177f651b-f686-478e-9f30-814ce6c646e2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:32.110756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-177f651b-f686-478e-9f30-814ce6c646e2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:32.635810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-18a0517d-67d7-4844-b4a4-64a171e29f8c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:32.645293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-18a0517d-67d7-4844-b4a4-64a171e29f8c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1318 microversion: 2.1 time: 0.666666 Jul 25 19:27:32.646574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 144/272] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:31 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:32.654115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-909d8ae9-21c8-4f95-bb1d-08b070f3d52e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:32.658507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-909d8ae9-21c8-4f95-bb1d-08b070f3d52e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:32.670733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-909d8ae9-21c8-4f95-bb1d-08b070f3d52e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:32.670733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-909d8ae9-21c8-4f95-bb1d-08b070f3d52e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:32.673446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-909d8ae9-21c8-4f95-bb1d-08b070f3d52e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:32.674327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-909d8ae9-21c8-4f95-bb1d-08b070f3d52e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:32.677000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-177f651b-f686-478e-9f30-814ce6c646e2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:32.693967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-177f651b-f686-478e-9f30-814ce6c646e2 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.605611 Jul 25 19:27:32.695457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 129/273] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:32 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:32.895250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8d6c264b-e0c5-49b7-ab55-fb7b503a0f5b tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:32.897807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8d6c264b-e0c5-49b7-ab55-fb7b503a0f5b tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:32.915247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:32.918269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d6c264b-e0c5-49b7-ab55-fb7b503a0f5b tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:32.919429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d6c264b-e0c5-49b7-ab55-fb7b503a0f5b tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:32.921033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d6c264b-e0c5-49b7-ab55-fb7b503a0f5b tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:32.921770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d6c264b-e0c5-49b7-ab55-fb7b503a0f5b tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:33.427592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-909d8ae9-21c8-4f95-bb1d-08b070f3d52e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778328 Jul 25 19:27:33.428440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 145/274] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 19:27:32 2022] POST /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:33.437483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-08612735-7a13-400e-abce-577fbedb6173 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:33.438605 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-08612735-7a13-400e-abce-577fbedb6173 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:33.451501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08612735-7a13-400e-abce-577fbedb6173 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:33.452277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08612735-7a13-400e-abce-577fbedb6173 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:33.453532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08612735-7a13-400e-abce-577fbedb6173 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:33.454079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08612735-7a13-400e-abce-577fbedb6173 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:33.489058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8d6c264b-e0c5-49b7-ab55-fb7b503a0f5b tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:33.518931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8d6c264b-e0c5-49b7-ab55-fb7b503a0f5b tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1315 microversion: 2.1 time: 0.631522 Jul 25 19:27:33.524260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 130/275] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:32 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:33.549814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-f5f71b63-d290-47b3-96a7-e4d1bfbd027d req-8e915ec9-3125-4f0f-b08b-a6b27b0626a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2586b4-247f-4532-9c19-9a01f3732354", "tag": "e5b3607f-3afc-4de1-8b22-93fd905a7c49"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:33.571123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-f5f71b63-d290-47b3-96a7-e4d1bfbd027d req-8e915ec9-3125-4f0f-b08b-a6b27b0626a3 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:33.572474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-f5f71b63-d290-47b3-96a7-e4d1bfbd027d req-8e915ec9-3125-4f0f-b08b-a6b27b0626a3 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:33.611549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-f5f71b63-d290-47b3-96a7-e4d1bfbd027d req-8e915ec9-3125-4f0f-b08b-a6b27b0626a3 service nova] Creating event network-changed:e5b3607f-3afc-4de1-8b22-93fd905a7c49 for instance 2f2586b4-247f-4532-9c19-9a01f3732354 on hv-cinder-85093 Jul 25 19:27:33.616766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-f5f71b63-d290-47b3-96a7-e4d1bfbd027d req-8e915ec9-3125-4f0f-b08b-a6b27b0626a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089872 Jul 25 19:27:33.618059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 131/276] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:33.629020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3036344e-af93-4b80-ac67-ce3026922d2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:33.630745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3036344e-af93-4b80-ac67-ce3026922d2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:33.642573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3036344e-af93-4b80-ac67-ce3026922d2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:33.643344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3036344e-af93-4b80-ac67-ce3026922d2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:33.644764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3036344e-af93-4b80-ac67-ce3026922d2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:33.645528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3036344e-af93-4b80-ac67-ce3026922d2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:34.058602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08612735-7a13-400e-abce-577fbedb6173 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:34.078557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08612735-7a13-400e-abce-577fbedb6173 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:34.081463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08612735-7a13-400e-abce-577fbedb6173 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:34.084676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-08612735-7a13-400e-abce-577fbedb6173 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.654386 Jul 25 19:27:34.085633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 146/277] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:27:34.093964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-108ff61d-4d20-4128-a8c8-fe4e9a94e672 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:34.095430 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-108ff61d-4d20-4128-a8c8-fe4e9a94e672 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:34.105349 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-108ff61d-4d20-4128-a8c8-fe4e9a94e672 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:34.106037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-108ff61d-4d20-4128-a8c8-fe4e9a94e672 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:34.107708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-108ff61d-4d20-4128-a8c8-fe4e9a94e672 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:34.108668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-108ff61d-4d20-4128-a8c8-fe4e9a94e672 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:34.134399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3036344e-af93-4b80-ac67-ce3026922d2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:34.145506 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3036344e-af93-4b80-ac67-ce3026922d2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.525270 Jul 25 19:27:34.146236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 132/278] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:33 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:34.151667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d837a9dd-91df-4345-9bbc-adce27b90ffc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:34.152612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d837a9dd-91df-4345-9bbc-adce27b90ffc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:34.173188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d837a9dd-91df-4345-9bbc-adce27b90ffc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:34.173907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d837a9dd-91df-4345-9bbc-adce27b90ffc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:34.175215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d837a9dd-91df-4345-9bbc-adce27b90ffc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:34.175916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d837a9dd-91df-4345-9bbc-adce27b90ffc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:34.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-108ff61d-4d20-4128-a8c8-fe4e9a94e672 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:34.710286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-108ff61d-4d20-4128-a8c8-fe4e9a94e672 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1318 microversion: 2.1 time: 0.621619 Jul 25 19:27:34.711647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 147/279] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:34 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:34.721838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-34991603-466f-4244-a176-3f155e8edde5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:34.723883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-34991603-466f-4244-a176-3f155e8edde5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:34.735138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34991603-466f-4244-a176-3f155e8edde5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:34.735893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34991603-466f-4244-a176-3f155e8edde5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:34.737204 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34991603-466f-4244-a176-3f155e8edde5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:34.737888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34991603-466f-4244-a176-3f155e8edde5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:34.756609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d837a9dd-91df-4345-9bbc-adce27b90ffc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:34.788174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d837a9dd-91df-4345-9bbc-adce27b90ffc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.635013 Jul 25 19:27:34.790168 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 133/280] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:34 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:35.125828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aa2df841-0fe6-45f2-8e21-89c9c64bec80 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:35.126416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aa2df841-0fe6-45f2-8e21-89c9c64bec80 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:35.134785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa2df841-0fe6-45f2-8e21-89c9c64bec80 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:35.135768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa2df841-0fe6-45f2-8e21-89c9c64bec80 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:35.137244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa2df841-0fe6-45f2-8e21-89c9c64bec80 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:35.137997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa2df841-0fe6-45f2-8e21-89c9c64bec80 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:35.435272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34991603-466f-4244-a176-3f155e8edde5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:35.446775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-34991603-466f-4244-a176-3f155e8edde5 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1465 microversion: 2.1 time: 0.733337 Jul 25 19:27:35.447589 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 148/281] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:34 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1465 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:35.454230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d907ca97-b251-4189-9048-7169725f4abb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:35.455278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d907ca97-b251-4189-9048-7169725f4abb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:35.469841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d907ca97-b251-4189-9048-7169725f4abb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:35.470774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d907ca97-b251-4189-9048-7169725f4abb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:35.471837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d907ca97-b251-4189-9048-7169725f4abb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:35.472440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d907ca97-b251-4189-9048-7169725f4abb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:35.828733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-aa2df841-0fe6-45f2-8e21-89c9c64bec80 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:35.848043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-aa2df841-0fe6-45f2-8e21-89c9c64bec80 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:35.852975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-aa2df841-0fe6-45f2-8e21-89c9c64bec80 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:35.855651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aa2df841-0fe6-45f2-8e21-89c9c64bec80 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.733505 Jul 25 19:27:35.857584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 134/282] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:27:35.867192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-08b89afe-cffd-43e1-8ce5-bb41f82f50bc tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:35.868190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-08b89afe-cffd-43e1-8ce5-bb41f82f50bc tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:35.877886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08b89afe-cffd-43e1-8ce5-bb41f82f50bc tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:35.879030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08b89afe-cffd-43e1-8ce5-bb41f82f50bc tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:35.884833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08b89afe-cffd-43e1-8ce5-bb41f82f50bc tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:35.886013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08b89afe-cffd-43e1-8ce5-bb41f82f50bc tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:35.940802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-08b89afe-cffd-43e1-8ce5-bb41f82f50bc tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Going to try to terminate instance {{(pid=117952) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:27:36.034287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:36.077393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-08b89afe-cffd-43e1-8ce5-bb41f82f50bc tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 204 len: 0 microversion: 2.1 time: 0.216449 Jul 25 19:27:36.080395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 135/283] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:27:35 2022] DELETE /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:27:36.088865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-616235bf-fc31-4389-ba46-356b76ce6a5b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:36.090322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-616235bf-fc31-4389-ba46-356b76ce6a5b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:36.100983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-616235bf-fc31-4389-ba46-356b76ce6a5b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:36.101713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-616235bf-fc31-4389-ba46-356b76ce6a5b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:36.102523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-616235bf-fc31-4389-ba46-356b76ce6a5b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:36.103023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-616235bf-fc31-4389-ba46-356b76ce6a5b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:36.126070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d907ca97-b251-4189-9048-7169725f4abb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:36.139037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d907ca97-b251-4189-9048-7169725f4abb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.690179 Jul 25 19:27:36.142712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 149/284] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:35 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:36.176190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de20850b-af86-44ba-86ea-787d139880bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:36.177157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de20850b-af86-44ba-86ea-787d139880bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:36.186231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de20850b-af86-44ba-86ea-787d139880bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:36.186722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de20850b-af86-44ba-86ea-787d139880bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:36.187575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de20850b-af86-44ba-86ea-787d139880bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:36.188088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de20850b-af86-44ba-86ea-787d139880bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:36.610971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=16 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:36.789290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-616235bf-fc31-4389-ba46-356b76ce6a5b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:36.802674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-616235bf-fc31-4389-ba46-356b76ce6a5b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1318 microversion: 2.1 time: 0.720245 Jul 25 19:27:36.803660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 136/285] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:36 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:36.810548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de20850b-af86-44ba-86ea-787d139880bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:36.811855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-acf8bd84-7167-4058-b3c5-23f6509d5f13 req-786eb646-ba2f-4ba4-b1d4-734a631e1594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f20ea26-3cf4-4cfd-820d-dc05ed15b079", "tag": "1ade161c-f9c0-488a-9248-931d1a9d4469"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:36.825907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de20850b-af86-44ba-86ea-787d139880bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.675552 Jul 25 19:27:36.827012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 150/286] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:36 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:36.829547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-acf8bd84-7167-4058-b3c5-23f6509d5f13 req-786eb646-ba2f-4ba4-b1d4-734a631e1594 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:36.830382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-acf8bd84-7167-4058-b3c5-23f6509d5f13 req-786eb646-ba2f-4ba4-b1d4-734a631e1594 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:36.836892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-781f1d1e-ee60-4a85-8ba9-94daf54f266a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:36.838213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-781f1d1e-ee60-4a85-8ba9-94daf54f266a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:36.851128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-781f1d1e-ee60-4a85-8ba9-94daf54f266a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:36.851893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-781f1d1e-ee60-4a85-8ba9-94daf54f266a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:36.853012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-781f1d1e-ee60-4a85-8ba9-94daf54f266a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:36.854791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-781f1d1e-ee60-4a85-8ba9-94daf54f266a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:36.854946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-acf8bd84-7167-4058-b3c5-23f6509d5f13 req-786eb646-ba2f-4ba4-b1d4-734a631e1594 service nova] Creating event network-changed:1ade161c-f9c0-488a-9248-931d1a9d4469 for instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 on hv-cinder-85093 Jul 25 19:27:36.860183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-acf8bd84-7167-4058-b3c5-23f6509d5f13 req-786eb646-ba2f-4ba4-b1d4-734a631e1594 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054935 Jul 25 19:27:36.860802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 137/287] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:36.908125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-197eaed7-53e1-4c6c-a88e-46b9eb83b997 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:36.909435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-197eaed7-53e1-4c6c-a88e-46b9eb83b997 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:36.921789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-197eaed7-53e1-4c6c-a88e-46b9eb83b997 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:36.922446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-197eaed7-53e1-4c6c-a88e-46b9eb83b997 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:36.924098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-197eaed7-53e1-4c6c-a88e-46b9eb83b997 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:36.924435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-197eaed7-53e1-4c6c-a88e-46b9eb83b997 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:36.956079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:37.206902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-781f1d1e-ee60-4a85-8ba9-94daf54f266a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:37.216029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-781f1d1e-ee60-4a85-8ba9-94daf54f266a tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1471 microversion: 2.1 time: 0.386995 Jul 25 19:27:37.217225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 151/288] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:36 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:37.224556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-82b2a22c-f624-44b9-9ab8-7ea4ceffd6a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:37.225773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-82b2a22c-f624-44b9-9ab8-7ea4ceffd6a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:37.235168 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82b2a22c-f624-44b9-9ab8-7ea4ceffd6a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:37.236182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82b2a22c-f624-44b9-9ab8-7ea4ceffd6a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:37.237269 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82b2a22c-f624-44b9-9ab8-7ea4ceffd6a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:37.237928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82b2a22c-f624-44b9-9ab8-7ea4ceffd6a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:37.251640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-197eaed7-53e1-4c6c-a88e-46b9eb83b997 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:37.270865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-197eaed7-53e1-4c6c-a88e-46b9eb83b997 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:37.273439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-197eaed7-53e1-4c6c-a88e-46b9eb83b997 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:37.276175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-197eaed7-53e1-4c6c-a88e-46b9eb83b997 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.376225 Jul 25 19:27:37.277196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 138/289] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:27:37.455072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-82b2a22c-f624-44b9-9ab8-7ea4ceffd6a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:37.464598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-82b2a22c-f624-44b9-9ab8-7ea4ceffd6a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.245620 Jul 25 19:27:37.465351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 152/290] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:37 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:37.830685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-82a4d784-155b-44e1-ba0f-c601b5471252 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:37.831782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-82a4d784-155b-44e1-ba0f-c601b5471252 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:37.841961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82a4d784-155b-44e1-ba0f-c601b5471252 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:37.842865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82a4d784-155b-44e1-ba0f-c601b5471252 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:37.844135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82a4d784-155b-44e1-ba0f-c601b5471252 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:37.844866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82a4d784-155b-44e1-ba0f-c601b5471252 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:37.863893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-516926bd-c7b6-4c24-87c6-a6ae700c3985 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:37.865560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-516926bd-c7b6-4c24-87c6-a6ae700c3985 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:37.873535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-516926bd-c7b6-4c24-87c6-a6ae700c3985 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:37.874178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-516926bd-c7b6-4c24-87c6-a6ae700c3985 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:37.875203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-516926bd-c7b6-4c24-87c6-a6ae700c3985 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:37.875825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-516926bd-c7b6-4c24-87c6-a6ae700c3985 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:38.164053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-82a4d784-155b-44e1-ba0f-c601b5471252 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:38.174597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-516926bd-c7b6-4c24-87c6-a6ae700c3985 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:38.182095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-82a4d784-155b-44e1-ba0f-c601b5471252 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1318 microversion: 2.1 time: 0.357143 Jul 25 19:27:38.183463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 139/291] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:37 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:38.189331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-516926bd-c7b6-4c24-87c6-a6ae700c3985 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.332417 Jul 25 19:27:38.190277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 153/292] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:37 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:38.249052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c508742a-89d4-4ef1-8207-eaa475149da4 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:38.249560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c508742a-89d4-4ef1-8207-eaa475149da4 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:38.257760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c508742a-89d4-4ef1-8207-eaa475149da4 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:38.258294 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c508742a-89d4-4ef1-8207-eaa475149da4 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:38.259110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c508742a-89d4-4ef1-8207-eaa475149da4 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:38.259726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c508742a-89d4-4ef1-8207-eaa475149da4 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:38.319920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6baf0f9f-14a1-47dc-ac3a-6d36a9d61024 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:38.321616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6baf0f9f-14a1-47dc-ac3a-6d36a9d61024 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:38.331735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6baf0f9f-14a1-47dc-ac3a-6d36a9d61024 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:38.332183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6baf0f9f-14a1-47dc-ac3a-6d36a9d61024 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:38.333646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6baf0f9f-14a1-47dc-ac3a-6d36a9d61024 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:38.334103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6baf0f9f-14a1-47dc-ac3a-6d36a9d61024 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:38.607129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c508742a-89d4-4ef1-8207-eaa475149da4 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:38.618859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c508742a-89d4-4ef1-8207-eaa475149da4 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1471 microversion: 2.1 time: 0.374143 Jul 25 19:27:38.620197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 140/293] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:38 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:38.628495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-47a02b3e-75d3-4051-902f-b6530891ebae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:38.629813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-47a02b3e-75d3-4051-902f-b6530891ebae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:38.642123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47a02b3e-75d3-4051-902f-b6530891ebae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:38.643105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47a02b3e-75d3-4051-902f-b6530891ebae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:38.644832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47a02b3e-75d3-4051-902f-b6530891ebae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:38.646264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47a02b3e-75d3-4051-902f-b6530891ebae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:38.658648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6baf0f9f-14a1-47dc-ac3a-6d36a9d61024 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:38.673917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6baf0f9f-14a1-47dc-ac3a-6d36a9d61024 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:38.677852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6baf0f9f-14a1-47dc-ac3a-6d36a9d61024 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:38.679831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6baf0f9f-14a1-47dc-ac3a-6d36a9d61024 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.369049 Jul 25 19:27:38.680799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 154/294] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:38 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:27:38.855212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-47a02b3e-75d3-4051-902f-b6530891ebae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:38.869401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-47a02b3e-75d3-4051-902f-b6530891ebae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.247529 Jul 25 19:27:38.870348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 141/295] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:38 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:39.221396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-08920cfc-3cbc-41c5-a5d1-cb4b350ae68f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:39.222005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-08920cfc-3cbc-41c5-a5d1-cb4b350ae68f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:39.230505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-de309804-9043-4589-ac08-8406b2e96d13 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:39.231454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08920cfc-3cbc-41c5-a5d1-cb4b350ae68f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:39.231937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08920cfc-3cbc-41c5-a5d1-cb4b350ae68f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:39.232443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-de309804-9043-4589-ac08-8406b2e96d13 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:39.232726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08920cfc-3cbc-41c5-a5d1-cb4b350ae68f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:39.233166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08920cfc-3cbc-41c5-a5d1-cb4b350ae68f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:39.246409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de309804-9043-4589-ac08-8406b2e96d13 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:39.247241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de309804-9043-4589-ac08-8406b2e96d13 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:39.248636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de309804-9043-4589-ac08-8406b2e96d13 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:39.249404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de309804-9043-4589-ac08-8406b2e96d13 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:39.508316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08920cfc-3cbc-41c5-a5d1-cb4b350ae68f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:39.520132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-de309804-9043-4589-ac08-8406b2e96d13 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:39.522519 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-08920cfc-3cbc-41c5-a5d1-cb4b350ae68f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1318 microversion: 2.1 time: 0.304676 Jul 25 19:27:39.523651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 155/296] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:39 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:39.531249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-de309804-9043-4589-ac08-8406b2e96d13 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.310068 Jul 25 19:27:39.531906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 142/297] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:39 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:39.658832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7494ba25-42c4-4b16-8100-6cb522334a2e tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:39.659999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7494ba25-42c4-4b16-8100-6cb522334a2e tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:39.672444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7494ba25-42c4-4b16-8100-6cb522334a2e tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:39.673105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7494ba25-42c4-4b16-8100-6cb522334a2e tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:39.674648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7494ba25-42c4-4b16-8100-6cb522334a2e tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:39.675612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7494ba25-42c4-4b16-8100-6cb522334a2e tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:39.724986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-38098f0c-bb8a-42d1-be1c-8141aa547ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:39.726426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-38098f0c-bb8a-42d1-be1c-8141aa547ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:39.740085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38098f0c-bb8a-42d1-be1c-8141aa547ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:39.740551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38098f0c-bb8a-42d1-be1c-8141aa547ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:39.741708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38098f0c-bb8a-42d1-be1c-8141aa547ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:39.742311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38098f0c-bb8a-42d1-be1c-8141aa547ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:40.033453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7494ba25-42c4-4b16-8100-6cb522334a2e tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:40.048305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7494ba25-42c4-4b16-8100-6cb522334a2e tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1471 microversion: 2.1 time: 0.395006 Jul 25 19:27:40.049077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 156/298] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:39 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1471 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:40.056928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c00e6798-76ae-4622-a40c-fb66dd264e1a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:40.058285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c00e6798-76ae-4622-a40c-fb66dd264e1a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:40.069922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c00e6798-76ae-4622-a40c-fb66dd264e1a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:40.070514 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c00e6798-76ae-4622-a40c-fb66dd264e1a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:40.071879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c00e6798-76ae-4622-a40c-fb66dd264e1a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:40.072667 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c00e6798-76ae-4622-a40c-fb66dd264e1a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:40.087649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-38098f0c-bb8a-42d1-be1c-8141aa547ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:40.098131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-38098f0c-bb8a-42d1-be1c-8141aa547ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:40.100648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:40.102140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-38098f0c-bb8a-42d1-be1c-8141aa547ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:40.103802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-38098f0c-bb8a-42d1-be1c-8141aa547ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.387004 Jul 25 19:27:40.104815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 143/299] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:27:40.327843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c00e6798-76ae-4622-a40c-fb66dd264e1a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:40.341599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c00e6798-76ae-4622-a40c-fb66dd264e1a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.290736 Jul 25 19:27:40.343060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 157/300] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:40 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:40.558730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-22de7bf7-869c-447c-886d-2b691fd354eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:40.559622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-22de7bf7-869c-447c-886d-2b691fd354eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:40.571721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-38ef4d7a-74a1-49f8-a27b-7ec8f3a177c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:40.572522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-38ef4d7a-74a1-49f8-a27b-7ec8f3a177c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:40.579551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-22de7bf7-869c-447c-886d-2b691fd354eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:40.580400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-22de7bf7-869c-447c-886d-2b691fd354eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:40.582374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-22de7bf7-869c-447c-886d-2b691fd354eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:40.583359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-22de7bf7-869c-447c-886d-2b691fd354eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:40.584179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38ef4d7a-74a1-49f8-a27b-7ec8f3a177c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:40.585152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38ef4d7a-74a1-49f8-a27b-7ec8f3a177c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:40.586606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38ef4d7a-74a1-49f8-a27b-7ec8f3a177c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:40.587232 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38ef4d7a-74a1-49f8-a27b-7ec8f3a177c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:41.274621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-38ef4d7a-74a1-49f8-a27b-7ec8f3a177c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:41.283627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-22de7bf7-869c-447c-886d-2b691fd354eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:41.311588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-38ef4d7a-74a1-49f8-a27b-7ec8f3a177c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.744234 Jul 25 19:27:41.314006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 158/301] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:40 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:41.321747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-22de7bf7-869c-447c-886d-2b691fd354eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1318 microversion: 2.1 time: 0.750960 Jul 25 19:27:41.336059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 144/302] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:40 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1318 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:41.344335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-97e06c28-b27f-42cc-b59f-9c1e34fbdcc1 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:41.347848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-97e06c28-b27f-42cc-b59f-9c1e34fbdcc1 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:41.369504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8fa0940a-11c2-41ec-a29f-8cdd190b94a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:41.370361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8fa0940a-11c2-41ec-a29f-8cdd190b94a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:41.375233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e06c28-b27f-42cc-b59f-9c1e34fbdcc1 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:41.376804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e06c28-b27f-42cc-b59f-9c1e34fbdcc1 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:41.379493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e06c28-b27f-42cc-b59f-9c1e34fbdcc1 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:41.383295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e06c28-b27f-42cc-b59f-9c1e34fbdcc1 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:41.384030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fa0940a-11c2-41ec-a29f-8cdd190b94a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:41.385038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fa0940a-11c2-41ec-a29f-8cdd190b94a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:41.387059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fa0940a-11c2-41ec-a29f-8cdd190b94a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:41.388759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fa0940a-11c2-41ec-a29f-8cdd190b94a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:42.309463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8fa0940a-11c2-41ec-a29f-8cdd190b94a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:42.322343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8fa0940a-11c2-41ec-a29f-8cdd190b94a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:42.325038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8fa0940a-11c2-41ec-a29f-8cdd190b94a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:42.327124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8fa0940a-11c2-41ec-a29f-8cdd190b94a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.989644 Jul 25 19:27:42.327503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97e06c28-b27f-42cc-b59f-9c1e34fbdcc1 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:42.331087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 145/303] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:27:42.340156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7d925e83-95f2-4779-aa43-05ab98f2db01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:42.341166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7d925e83-95f2-4779-aa43-05ab98f2db01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:42.351245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d925e83-95f2-4779-aa43-05ab98f2db01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:42.351994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d925e83-95f2-4779-aa43-05ab98f2db01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:42.352200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-97e06c28-b27f-42cc-b59f-9c1e34fbdcc1 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1471 microversion: 2.1 time: 1.035233 Jul 25 19:27:42.353511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 159/304] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:41 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1471 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:42.354013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d925e83-95f2-4779-aa43-05ab98f2db01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:42.355319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d925e83-95f2-4779-aa43-05ab98f2db01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:42.361273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e7eb448e-c935-40b8-ab93-ae477b2a87c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:42.362233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e7eb448e-c935-40b8-ab93-ae477b2a87c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:42.388199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7eb448e-c935-40b8-ab93-ae477b2a87c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:42.399451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7eb448e-c935-40b8-ab93-ae477b2a87c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:42.401958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7eb448e-c935-40b8-ab93-ae477b2a87c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:42.404092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7eb448e-c935-40b8-ab93-ae477b2a87c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:42.736768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7d925e83-95f2-4779-aa43-05ab98f2db01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:42.752424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7d925e83-95f2-4779-aa43-05ab98f2db01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.417611 Jul 25 19:27:42.759459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 146/305] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:42 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:42.766436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-492fd6fa-42c2-48b2-b89f-a71c4d3a83a2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:42.767335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-492fd6fa-42c2-48b2-b89f-a71c4d3a83a2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:42.768645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e7eb448e-c935-40b8-ab93-ae477b2a87c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:42.777713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-492fd6fa-42c2-48b2-b89f-a71c4d3a83a2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:42.778176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-492fd6fa-42c2-48b2-b89f-a71c4d3a83a2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:42.778989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-492fd6fa-42c2-48b2-b89f-a71c4d3a83a2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:42.779433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-492fd6fa-42c2-48b2-b89f-a71c4d3a83a2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:42.789623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e7eb448e-c935-40b8-ab93-ae477b2a87c4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.434445 Jul 25 19:27:42.790668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 160/306] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:42 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:42.798851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-be87d1b3-790c-4808-9c60-4ffa76a374d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: .version_select at 0x7feb086449d0>, body: {"keypair": {"name": "tempest-keypair-1925928688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkVlDu0a/HzsK6+690OBn5pcl7J+Vju5hFUo7LVQAZyj/WcXji5OPAlqy6dUA3OB4nSWK++ZTHTIzvAkyi8/MljkWd7+zpHlZf9YZQEei0dLwhkkXvUuA9Xlw01cdC2YA=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:42.825226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:42.839640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-be87d1b3-790c-4808-9c60-4ffa76a374d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:27:42.845002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-be87d1b3-790c-4808-9c60-4ffa76a374d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for user 6ecf34ceee294b53b5be7c1723b42950 and project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:27:42.897884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-be87d1b3-790c-4808-9c60-4ffa76a374d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105243 Jul 25 19:27:42.898800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 161/307] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Jul 25 19:27:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:42.907602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-a993e8eb-109c-4a5b-b37e-36f7a87859d7 req-c4c74fa5-842b-428f-bad8-ebcef7693c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9925bc-3de1-46c3-b42d-b93789c0e56a", "name": "network-vif-deleted", "tag": "f736798d-e590-4b06-95c8-2bbd73208b66"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:42.928198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-a993e8eb-109c-4a5b-b37e-36f7a87859d7 req-c4c74fa5-842b-428f-bad8-ebcef7693c2a service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:42.928487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-a993e8eb-109c-4a5b-b37e-36f7a87859d7 req-c4c74fa5-842b-428f-bad8-ebcef7693c2a service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:42.952701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-a993e8eb-109c-4a5b-b37e-36f7a87859d7 req-c4c74fa5-842b-428f-bad8-ebcef7693c2a service nova] Creating event network-vif-deleted:f736798d-e590-4b06-95c8-2bbd73208b66 for instance 6e9925bc-3de1-46c3-b42d-b93789c0e56a on hv-cinder-85093 Jul 25 19:27:42.965116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-a993e8eb-109c-4a5b-b37e-36f7a87859d7 req-c4c74fa5-842b-428f-bad8-ebcef7693c2a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062853 Jul 25 19:27:42.965455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 162/308] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:43.022236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-492fd6fa-42c2-48b2-b89f-a71c4d3a83a2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:43.038776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-492fd6fa-42c2-48b2-b89f-a71c4d3a83a2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1318 microversion: 2.1 time: 0.277342 Jul 25 19:27:43.049167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 147/309] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:42 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:43.361123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d8c38b9-de94-4e07-bd81-ae6eba230a0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:43.362262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d8c38b9-de94-4e07-bd81-ae6eba230a0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:43.372940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d8c38b9-de94-4e07-bd81-ae6eba230a0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:43.373659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d8c38b9-de94-4e07-bd81-ae6eba230a0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:43.374926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d8c38b9-de94-4e07-bd81-ae6eba230a0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:43.375682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d8c38b9-de94-4e07-bd81-ae6eba230a0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:43.394159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cc9c9f2a-361a-4ec5-a50b-c80eb9ec1c5c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:43.395251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cc9c9f2a-361a-4ec5-a50b-c80eb9ec1c5c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:43.403988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc9c9f2a-361a-4ec5-a50b-c80eb9ec1c5c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:43.404741 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc9c9f2a-361a-4ec5-a50b-c80eb9ec1c5c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:43.406455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc9c9f2a-361a-4ec5-a50b-c80eb9ec1c5c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:43.407668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc9c9f2a-361a-4ec5-a50b-c80eb9ec1c5c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:43.601158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cc9c9f2a-361a-4ec5-a50b-c80eb9ec1c5c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:43.615140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cc9c9f2a-361a-4ec5-a50b-c80eb9ec1c5c tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1429 microversion: 2.1 time: 0.227506 Jul 25 19:27:43.616084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 148/310] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:43 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1429 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:43.794009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6fb28129-4c68-4388-aca9-5204cc5827a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:43.795202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6fb28129-4c68-4388-aca9-5204cc5827a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:43.803562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d8c38b9-de94-4e07-bd81-ae6eba230a0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:43.822734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fb28129-4c68-4388-aca9-5204cc5827a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:43.823562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fb28129-4c68-4388-aca9-5204cc5827a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:43.825287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fb28129-4c68-4388-aca9-5204cc5827a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:43.826089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fb28129-4c68-4388-aca9-5204cc5827a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:43.835973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d8c38b9-de94-4e07-bd81-ae6eba230a0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:43.843222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d8c38b9-de94-4e07-bd81-ae6eba230a0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:43.844838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d8c38b9-de94-4e07-bd81-ae6eba230a0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.490750 Jul 25 19:27:43.855676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 163/311] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:27:43.862712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fecf37f6-7574-4b6a-9fa5-cedfb762e73c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:43.862712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fecf37f6-7574-4b6a-9fa5-cedfb762e73c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:43.874334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fecf37f6-7574-4b6a-9fa5-cedfb762e73c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:43.876875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fecf37f6-7574-4b6a-9fa5-cedfb762e73c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:43.878063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fecf37f6-7574-4b6a-9fa5-cedfb762e73c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:43.879053 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fecf37f6-7574-4b6a-9fa5-cedfb762e73c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:44.417159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6fb28129-4c68-4388-aca9-5204cc5827a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:44.445304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6fb28129-4c68-4388-aca9-5204cc5827a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.652129 Jul 25 19:27:44.446815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 149/312] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:43 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:44.458757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0e0dfbce-9cf7-495b-b7f2-604cc694440b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:44.459860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0e0dfbce-9cf7-495b-b7f2-604cc694440b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:44.483731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e0dfbce-9cf7-495b-b7f2-604cc694440b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:44.484475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e0dfbce-9cf7-495b-b7f2-604cc694440b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:44.485846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e0dfbce-9cf7-495b-b7f2-604cc694440b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:44.486160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fecf37f6-7574-4b6a-9fa5-cedfb762e73c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:44.486909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e0dfbce-9cf7-495b-b7f2-604cc694440b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:44.522668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fecf37f6-7574-4b6a-9fa5-cedfb762e73c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.669476 Jul 25 19:27:44.528069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 164/313] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:43 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:44.620849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-7eb32b84-9600-436d-994e-5553aaa86d89 req-d21fbae4-fedd-44c4-8511-d3adb1269aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2586b4-247f-4532-9c19-9a01f3732354", "name": "network-vif-plugged", "status": "completed", "tag": "e5b3607f-3afc-4de1-8b22-93fd905a7c49"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:44.656267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-7eb32b84-9600-436d-994e-5553aaa86d89 req-d21fbae4-fedd-44c4-8511-d3adb1269aa6 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:44.657307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-7eb32b84-9600-436d-994e-5553aaa86d89 req-d21fbae4-fedd-44c4-8511-d3adb1269aa6 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:44.696503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-7eb32b84-9600-436d-994e-5553aaa86d89 req-d21fbae4-fedd-44c4-8511-d3adb1269aa6 service nova] Creating event network-vif-plugged:e5b3607f-3afc-4de1-8b22-93fd905a7c49 for instance 2f2586b4-247f-4532-9c19-9a01f3732354 on hv-cinder-85093 Jul 25 19:27:44.728711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-7eb32b84-9600-436d-994e-5553aaa86d89 req-d21fbae4-fedd-44c4-8511-d3adb1269aa6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114151 Jul 25 19:27:44.734304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 165/314] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:44.767118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:44.768273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:44.796599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:44.797727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:44.800976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:44.802478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:44.891771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:44.892971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:44.893779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lazy-loading 'fault' on Instance uuid 6e9925bc-3de1-46c3-b42d-b93789c0e56a {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:27:45.308793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc63fdeacd514eac8e4a5882190f8d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a092c7d1ac694eab812fe205ccbe5434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:45.323044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd03e56f-3693-46f7-aabb-48c7ceec9514 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 200 len: 1305 microversion: 2.1 time: 0.581081 Jul 25 19:27:45.339544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 166/315] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:44 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 1305 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:45.339544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f13ef37-caff-420b-99ae-6d5d2151283e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:45.339544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f13ef37-caff-420b-99ae-6d5d2151283e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:45.344535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f13ef37-caff-420b-99ae-6d5d2151283e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:45.344778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f13ef37-caff-420b-99ae-6d5d2151283e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:45.346050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f13ef37-caff-420b-99ae-6d5d2151283e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:45.347609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f13ef37-caff-420b-99ae-6d5d2151283e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:45.614492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0e0dfbce-9cf7-495b-b7f2-604cc694440b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:45.630451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0e0dfbce-9cf7-495b-b7f2-604cc694440b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1318 microversion: 2.1 time: 1.181102 Jul 25 19:27:45.631623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 150/316] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:44 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1318 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:45.651886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-af02a6b2-7bcc-4a0a-a23e-9722432e105b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:45.653736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-af02a6b2-7bcc-4a0a-a23e-9722432e105b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:45.668571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af02a6b2-7bcc-4a0a-a23e-9722432e105b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:45.669593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af02a6b2-7bcc-4a0a-a23e-9722432e105b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:45.671268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af02a6b2-7bcc-4a0a-a23e-9722432e105b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:45.672453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af02a6b2-7bcc-4a0a-a23e-9722432e105b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:45.736302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f13ef37-caff-420b-99ae-6d5d2151283e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:45.751674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f13ef37-caff-420b-99ae-6d5d2151283e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:45.756148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f13ef37-caff-420b-99ae-6d5d2151283e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:45.758789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f13ef37-caff-420b-99ae-6d5d2151283e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.432296 Jul 25 19:27:45.760412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 167/317] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:27:45.770804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e66e9c7b-ae06-4c32-b172-8bc9b6ffcf08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:45.772304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e66e9c7b-ae06-4c32-b172-8bc9b6ffcf08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:45.785394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e66e9c7b-ae06-4c32-b172-8bc9b6ffcf08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:45.788115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e66e9c7b-ae06-4c32-b172-8bc9b6ffcf08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:45.789581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e66e9c7b-ae06-4c32-b172-8bc9b6ffcf08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:45.790383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e66e9c7b-ae06-4c32-b172-8bc9b6ffcf08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:46.011820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-af02a6b2-7bcc-4a0a-a23e-9722432e105b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:46.028947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-af02a6b2-7bcc-4a0a-a23e-9722432e105b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.392977 Jul 25 19:27:46.030321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 151/318] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:45 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:46.138235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1149074399", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b6d8d22-cbba-4be4-870a-41dcb5ed33ac"}], "security_groups": [{"name": "tempest-securitygroup--54582481"}], "key_name": "tempest-keypair-1925928688", "user_data": "}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:46.145961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e66e9c7b-ae06-4c32-b172-8bc9b6ffcf08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:46.160283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e66e9c7b-ae06-4c32-b172-8bc9b6ffcf08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.397492 Jul 25 19:27:46.162217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 168/319] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:45 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:46.323564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] validate_networks() for [('5b6d8d22-cbba-4be4-870a-41dcb5ed33ac', None, None, None, None, None)] {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:27:46.356578 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8e5f600a-a5ba-4888-b0cf-8f3fd01fe356 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:46.359655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8e5f600a-a5ba-4888-b0cf-8f3fd01fe356 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] [instance: 6e9925bc-3de1-46c3-b42d-b93789c0e56a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:46.380929 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e5f600a-a5ba-4888-b0cf-8f3fd01fe356 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:46.382106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e5f600a-a5ba-4888-b0cf-8f3fd01fe356 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:46.383767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e5f600a-a5ba-4888-b0cf-8f3fd01fe356 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:46.384572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e5f600a-a5ba-4888-b0cf-8f3fd01fe356 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:46.422674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-8e5f600a-a5ba-4888-b0cf-8f3fd01fe356 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] HTTP exception thrown: Instance 6e9925bc-3de1-46c3-b42d-b93789c0e56a could not be found. Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8e5f600a-a5ba-4888-b0cf-8f3fd01fe356 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Request method failure captured: Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a HTTP/1.1 Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u6INMjB9iaf4ukfQ1oEU1SE5flKn-KZots5--J37ZNSXzz_rsZ2ZiR2Aj1sSzIBcVM9kJCklJnhhjQ-CbUgAw0O8AaN62FMaW0bz3cslFsIDmku3xUdNuDVwMMQgEuPdGxClEv9Gv9yy91AYhj8XIMfZ5nTEjA1_sjIdFh_-JTNHkY Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: a092c7d1ac694eab812fe205ccbe5434 Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-1266514815 Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:27:46.425990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a092c7d1ac694eab812fe205ccbe5434"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a092c7d1ac694eab812fe205ccbe5434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a092c7d1ac694eab812fe205ccbe5434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a092c7d1ac694eab812fe205ccbe5434", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-1266514815 Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: a092c7d1ac694eab812fe205ccbe5434 Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-1266514815 Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-1266514815-project Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: dc63fdeacd514eac8e4a5882190f8d66 Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-1266514815-project Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 6e9925bc-3de1-46c3-b42d-b93789c0e56a could not be found. Jul 25 19:27:46.431501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '6e9925bc-3de1-46c3-b42d-b93789c0e56a'} Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9925bc-3de1-46c3-b42d-b93789c0e56a could not be found. Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:27:46.433256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9925bc-3de1-46c3-b42d-b93789c0e56a could not be found. Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9925bc-3de1-46c3-b42d-b93789c0e56a could not be found. Jul 25 19:27:46.437912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:27:46.442215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8e5f600a-a5ba-4888-b0cf-8f3fd01fe356 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] Returning 404 to user: Instance 6e9925bc-3de1-46c3-b42d-b93789c0e56a could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:27:46.442215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8e5f600a-a5ba-4888-b0cf-8f3fd01fe356 tempest-VolumesNegativeTest-1266514815 tempest-VolumesNegativeTest-1266514815-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a" status: 404 len: 111 microversion: 2.1 time: 0.081451 Jul 25 19:27:46.444344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 169/320] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:46 2022] GET /compute/v2.1/servers/6e9925bc-3de1-46c3-b42d-b93789c0e56a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 19:27:46.682678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c1876a8-4435-4071-b6ea-b6cf5506ba36 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:46.683984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7c1876a8-4435-4071-b6ea-b6cf5506ba36 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:46.694972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c1876a8-4435-4071-b6ea-b6cf5506ba36 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:46.695824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c1876a8-4435-4071-b6ea-b6cf5506ba36 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:46.697552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c1876a8-4435-4071-b6ea-b6cf5506ba36 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:46.699027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c1876a8-4435-4071-b6ea-b6cf5506ba36 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:47.141950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7c1876a8-4435-4071-b6ea-b6cf5506ba36 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:47.184495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c1876a8-4435-4071-b6ea-b6cf5506ba36 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1318 microversion: 2.1 time: 0.507909 Jul 25 19:27:47.186003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 170/321] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:46 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:47.209968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b65409b6-634c-4a1b-a73e-0b720f51a29b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:47.211485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b65409b6-634c-4a1b-a73e-0b720f51a29b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:47.225874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b65409b6-634c-4a1b-a73e-0b720f51a29b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:47.238142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b65409b6-634c-4a1b-a73e-0b720f51a29b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:47.240818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b65409b6-634c-4a1b-a73e-0b720f51a29b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:47.254678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b65409b6-634c-4a1b-a73e-0b720f51a29b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:47.306151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:27:47.308508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:27:47.315097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:27:47.315097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:27:47.315097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:27:47.323871 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:47.325004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:47.325927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:47.326342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:47.356901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:27:47.369468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for user 6ecf34ceee294b53b5be7c1723b42950 and project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:27:47.393494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:27:47.398843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:27:47.504035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f4a27595-bb0c-4928-93dd-eeced92ffb12 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.375040 Jul 25 19:27:47.505752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 152/322] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:27:46 2022] POST /compute/v2.1/servers => generated 400 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 19:27:47.510763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d45198cd-03e8-46b6-8dd3-0546bc0130b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:47.511698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d45198cd-03e8-46b6-8dd3-0546bc0130b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:47.518879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d45198cd-03e8-46b6-8dd3-0546bc0130b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:47.519331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d45198cd-03e8-46b6-8dd3-0546bc0130b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:47.520211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d45198cd-03e8-46b6-8dd3-0546bc0130b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:47.521869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d45198cd-03e8-46b6-8dd3-0546bc0130b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:47.543729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b65409b6-634c-4a1b-a73e-0b720f51a29b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:47.564111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b65409b6-634c-4a1b-a73e-0b720f51a29b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:47.568846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b65409b6-634c-4a1b-a73e-0b720f51a29b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:47.572262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b65409b6-634c-4a1b-a73e-0b720f51a29b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.374021 Jul 25 19:27:47.585711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 171/323] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:27:47.608385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dca06906-c05e-4865-a1ae-116717aa9b8b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:47.613192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dca06906-c05e-4865-a1ae-116717aa9b8b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:47.621686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dca06906-c05e-4865-a1ae-116717aa9b8b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:47.622685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dca06906-c05e-4865-a1ae-116717aa9b8b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:47.624358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dca06906-c05e-4865-a1ae-116717aa9b8b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:47.625022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dca06906-c05e-4865-a1ae-116717aa9b8b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:47.967136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d45198cd-03e8-46b6-8dd3-0546bc0130b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:47.999763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d45198cd-03e8-46b6-8dd3-0546bc0130b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.492506 Jul 25 19:27:48.011551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 153/324] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:47 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:48.011551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6fbb3284-65f7-4e00-812d-50d43b2a835c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:48.011551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6fbb3284-65f7-4e00-812d-50d43b2a835c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:48.022982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dca06906-c05e-4865-a1ae-116717aa9b8b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:48.040123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dca06906-c05e-4865-a1ae-116717aa9b8b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.449430 Jul 25 19:27:48.041729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 172/325] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:47 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:48.130821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6fbb3284-65f7-4e00-812d-50d43b2a835c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:48.147586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6fbb3284-65f7-4e00-812d-50d43b2a835c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1242 microversion: 2.1 time: 0.144976 Jul 25 19:27:48.149020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 154/326] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:48 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1242 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:48.222026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d84f0ed3-0230-47f0-ba26-c7e963482ed8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:48.223045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d84f0ed3-0230-47f0-ba26-c7e963482ed8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:48.241969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d84f0ed3-0230-47f0-ba26-c7e963482ed8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:48.242737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d84f0ed3-0230-47f0-ba26-c7e963482ed8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:48.244134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d84f0ed3-0230-47f0-ba26-c7e963482ed8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:48.245140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d84f0ed3-0230-47f0-ba26-c7e963482ed8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:48.612207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-23261fc0-7105-455e-baaa-153b426604d7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:48.612962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d84f0ed3-0230-47f0-ba26-c7e963482ed8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:48.617330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-23261fc0-7105-455e-baaa-153b426604d7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:48.633199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d84f0ed3-0230-47f0-ba26-c7e963482ed8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1507 microversion: 2.1 time: 0.417572 Jul 25 19:27:48.634266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 173/327] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:48 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:48.637154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23261fc0-7105-455e-baaa-153b426604d7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:48.637154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23261fc0-7105-455e-baaa-153b426604d7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:48.637154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23261fc0-7105-455e-baaa-153b426604d7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:48.642242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23261fc0-7105-455e-baaa-153b426604d7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:48.720288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-9262304c-96cd-4e75-9823-93b8c0e46129 req-664871d5-3f98-4320-8905-e64e66246855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f20ea26-3cf4-4cfd-820d-dc05ed15b079", "name": "network-vif-plugged", "status": "completed", "tag": "1ade161c-f9c0-488a-9248-931d1a9d4469"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:48.768071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-9262304c-96cd-4e75-9823-93b8c0e46129 req-664871d5-3f98-4320-8905-e64e66246855 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:48.769079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-9262304c-96cd-4e75-9823-93b8c0e46129 req-664871d5-3f98-4320-8905-e64e66246855 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:48.804722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-9262304c-96cd-4e75-9823-93b8c0e46129 req-664871d5-3f98-4320-8905-e64e66246855 service nova] Creating event network-vif-plugged:1ade161c-f9c0-488a-9248-931d1a9d4469 for instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 on hv-cinder-85093 Jul 25 19:27:48.814846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-9262304c-96cd-4e75-9823-93b8c0e46129 req-664871d5-3f98-4320-8905-e64e66246855 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105601 Jul 25 19:27:48.831256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 174/328] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:49.052679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cabfc73a-2a73-4c6d-8ff1-08d3611333af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:49.055480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cabfc73a-2a73-4c6d-8ff1-08d3611333af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:49.082593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-23261fc0-7105-455e-baaa-153b426604d7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:49.084380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cabfc73a-2a73-4c6d-8ff1-08d3611333af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:49.085730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cabfc73a-2a73-4c6d-8ff1-08d3611333af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:49.088007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cabfc73a-2a73-4c6d-8ff1-08d3611333af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:49.090856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cabfc73a-2a73-4c6d-8ff1-08d3611333af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:49.109388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-23261fc0-7105-455e-baaa-153b426604d7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:49.121660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-23261fc0-7105-455e-baaa-153b426604d7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:49.124747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-23261fc0-7105-455e-baaa-153b426604d7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.520635 Jul 25 19:27:49.126520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 155/329] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:48 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:27:49.137276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9283ed46-7364-44dd-8365-462eb17cc50d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:49.139222 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9283ed46-7364-44dd-8365-462eb17cc50d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:49.165776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9283ed46-7364-44dd-8365-462eb17cc50d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:49.171113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9283ed46-7364-44dd-8365-462eb17cc50d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:49.179318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9283ed46-7364-44dd-8365-462eb17cc50d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:49.180402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9283ed46-7364-44dd-8365-462eb17cc50d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:49.589351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cabfc73a-2a73-4c6d-8ff1-08d3611333af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:49.628555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cabfc73a-2a73-4c6d-8ff1-08d3611333af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.575862 Jul 25 19:27:49.639336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 175/330] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:49 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:49.663844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d65e329f-b9a0-4210-8a1a-cb05421de4a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:49.669162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d65e329f-b9a0-4210-8a1a-cb05421de4a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:49.692462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d65e329f-b9a0-4210-8a1a-cb05421de4a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:49.693875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d65e329f-b9a0-4210-8a1a-cb05421de4a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:49.696554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d65e329f-b9a0-4210-8a1a-cb05421de4a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:49.697533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d65e329f-b9a0-4210-8a1a-cb05421de4a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:49.739762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9283ed46-7364-44dd-8365-462eb17cc50d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:49.748757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:49.765814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9283ed46-7364-44dd-8365-462eb17cc50d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.635170 Jul 25 19:27:49.772361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 156/331] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:49 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:49.967316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d65e329f-b9a0-4210-8a1a-cb05421de4a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:49.984283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d65e329f-b9a0-4210-8a1a-cb05421de4a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1302 microversion: 2.1 time: 0.338457 Jul 25 19:27:49.985382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 176/332] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:49 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1302 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:50.180987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b56be834-c4c5-407b-8fac-b330bf0af58d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:50.182311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b56be834-c4c5-407b-8fac-b330bf0af58d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:50.194935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b56be834-c4c5-407b-8fac-b330bf0af58d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:50.195741 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b56be834-c4c5-407b-8fac-b330bf0af58d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:50.197060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b56be834-c4c5-407b-8fac-b330bf0af58d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:50.197840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b56be834-c4c5-407b-8fac-b330bf0af58d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:50.471939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b56be834-c4c5-407b-8fac-b330bf0af58d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:50.482854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b56be834-c4c5-407b-8fac-b330bf0af58d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:50.485184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b56be834-c4c5-407b-8fac-b330bf0af58d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:50.488447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b56be834-c4c5-407b-8fac-b330bf0af58d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.317569 Jul 25 19:27:50.489903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 157/333] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:27:50.682358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b3f2a4ed-79ef-4eaf-9517-aa0f5c3a7c2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:50.683551 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b3f2a4ed-79ef-4eaf-9517-aa0f5c3a7c2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:50.696852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3f2a4ed-79ef-4eaf-9517-aa0f5c3a7c2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:50.697834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3f2a4ed-79ef-4eaf-9517-aa0f5c3a7c2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:50.699733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3f2a4ed-79ef-4eaf-9517-aa0f5c3a7c2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:50.700859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3f2a4ed-79ef-4eaf-9517-aa0f5c3a7c2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:50.734423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:50.813976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fdbae6ef-1d25-47f9-910e-a210f3eef089 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:50.815839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fdbae6ef-1d25-47f9-910e-a210f3eef089 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:50.828127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fdbae6ef-1d25-47f9-910e-a210f3eef089 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:50.829287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fdbae6ef-1d25-47f9-910e-a210f3eef089 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:50.830960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fdbae6ef-1d25-47f9-910e-a210f3eef089 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:50.832700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fdbae6ef-1d25-47f9-910e-a210f3eef089 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:51.102557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b3f2a4ed-79ef-4eaf-9517-aa0f5c3a7c2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:51.117356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b3f2a4ed-79ef-4eaf-9517-aa0f5c3a7c2d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1361 microversion: 2.1 time: 0.442123 Jul 25 19:27:51.118574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 177/334] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:50 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1361 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:51.135099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-45d4bb5c-7185-4621-8cdf-65f089100fa1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:51.136170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-45d4bb5c-7185-4621-8cdf-65f089100fa1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:51.149273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d4bb5c-7185-4621-8cdf-65f089100fa1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:51.150002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d4bb5c-7185-4621-8cdf-65f089100fa1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:51.151315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d4bb5c-7185-4621-8cdf-65f089100fa1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:51.152092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d4bb5c-7185-4621-8cdf-65f089100fa1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:51.294720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fdbae6ef-1d25-47f9-910e-a210f3eef089 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:51.300693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-45d4bb5c-7185-4621-8cdf-65f089100fa1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:51.306299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fdbae6ef-1d25-47f9-910e-a210f3eef089 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.497437 Jul 25 19:27:51.307477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 158/335] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:50 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:51.314446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-45d4bb5c-7185-4621-8cdf-65f089100fa1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1300 microversion: 2.1 time: 0.194540 Jul 25 19:27:51.317800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 178/336] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:51 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1300 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:51.536921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0dac974b-7e49-4df8-bef5-2e4641781664 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:51.537914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0dac974b-7e49-4df8-bef5-2e4641781664 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:51.554600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dac974b-7e49-4df8-bef5-2e4641781664 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:51.555326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dac974b-7e49-4df8-bef5-2e4641781664 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:51.556895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dac974b-7e49-4df8-bef5-2e4641781664 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:51.557567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dac974b-7e49-4df8-bef5-2e4641781664 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:52.013808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0dac974b-7e49-4df8-bef5-2e4641781664 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:52.032842 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0dac974b-7e49-4df8-bef5-2e4641781664 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:52.036596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0dac974b-7e49-4df8-bef5-2e4641781664 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:52.038856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0dac974b-7e49-4df8-bef5-2e4641781664 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1724 microversion: 2.20 time: 0.508475 Jul 25 19:27:52.042909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 159/337] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1724 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:27:52.170816 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b9361272-f2b8-401d-9a3c-05fe031ff9ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:52.171818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b9361272-f2b8-401d-9a3c-05fe031ff9ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:52.182582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9361272-f2b8-401d-9a3c-05fe031ff9ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:52.183325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9361272-f2b8-401d-9a3c-05fe031ff9ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:52.184641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9361272-f2b8-401d-9a3c-05fe031ff9ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:52.185633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9361272-f2b8-401d-9a3c-05fe031ff9ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:52.345533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3ae433d8-ca2a-4f63-9b99-c07a853ea1ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:52.349336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3ae433d8-ca2a-4f63-9b99-c07a853ea1ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:52.361945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3ae433d8-ca2a-4f63-9b99-c07a853ea1ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:52.363556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3ae433d8-ca2a-4f63-9b99-c07a853ea1ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:52.366611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3ae433d8-ca2a-4f63-9b99-c07a853ea1ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:52.368267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3ae433d8-ca2a-4f63-9b99-c07a853ea1ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:52.684306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9361272-f2b8-401d-9a3c-05fe031ff9ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:52.700180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b9361272-f2b8-401d-9a3c-05fe031ff9ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1547 microversion: 2.1 time: 0.542306 Jul 25 19:27:52.701060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 179/338] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1547 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:52.709415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4b587567-f2ff-4f09-87f6-7f0405ca12b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:52.710369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4b587567-f2ff-4f09-87f6-7f0405ca12b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:52.721315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b587567-f2ff-4f09-87f6-7f0405ca12b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:52.722161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b587567-f2ff-4f09-87f6-7f0405ca12b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:52.724352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b587567-f2ff-4f09-87f6-7f0405ca12b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:52.725451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b587567-f2ff-4f09-87f6-7f0405ca12b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:52.822612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3ae433d8-ca2a-4f63-9b99-c07a853ea1ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:52.838322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3ae433d8-ca2a-4f63-9b99-c07a853ea1ff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.503001 Jul 25 19:27:52.839760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 160/339] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:52 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:52.849328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0ea0c38e-13ad-4b9e-b25a-97028621b645 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:52.850652 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0ea0c38e-13ad-4b9e-b25a-97028621b645 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:52.858195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:52.864023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ea0c38e-13ad-4b9e-b25a-97028621b645 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:52.865362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ea0c38e-13ad-4b9e-b25a-97028621b645 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:52.867201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ea0c38e-13ad-4b9e-b25a-97028621b645 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:52.868419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ea0c38e-13ad-4b9e-b25a-97028621b645 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:52.884269 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4b587567-f2ff-4f09-87f6-7f0405ca12b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:52.895351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4b587567-f2ff-4f09-87f6-7f0405ca12b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1300 microversion: 2.1 time: 0.192840 Jul 25 19:27:52.896371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 180/340] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:52 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1300 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:53.028470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0ea0c38e-13ad-4b9e-b25a-97028621b645 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186447 Jul 25 19:27:53.031979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 161/341] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Jul 25 19:27:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:53.090587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1a44ce54-8400-4181-9517-074e6911eef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:53.092597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1a44ce54-8400-4181-9517-074e6911eef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:53.122594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a44ce54-8400-4181-9517-074e6911eef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:53.125411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a44ce54-8400-4181-9517-074e6911eef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:53.128006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a44ce54-8400-4181-9517-074e6911eef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:53.129221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a44ce54-8400-4181-9517-074e6911eef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:53.508967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1a44ce54-8400-4181-9517-074e6911eef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:53.527500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1a44ce54-8400-4181-9517-074e6911eef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:53.531774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1a44ce54-8400-4181-9517-074e6911eef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:53.534053 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1a44ce54-8400-4181-9517-074e6911eef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1745 microversion: 2.20 time: 0.455842 Jul 25 19:27:53.547564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 181/342] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1745 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:27:53.886497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e07f11ba-a3de-47be-9189-c1006a4aa321 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:53.887830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e07f11ba-a3de-47be-9189-c1006a4aa321 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:53.901273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e07f11ba-a3de-47be-9189-c1006a4aa321 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:53.902065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e07f11ba-a3de-47be-9189-c1006a4aa321 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:53.903781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e07f11ba-a3de-47be-9189-c1006a4aa321 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:53.904880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e07f11ba-a3de-47be-9189-c1006a4aa321 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:53.936672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-646449d4-a772-47fd-b1e7-9ed3231d5a17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:53.937887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-646449d4-a772-47fd-b1e7-9ed3231d5a17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:53.960600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-646449d4-a772-47fd-b1e7-9ed3231d5a17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:53.961701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-646449d4-a772-47fd-b1e7-9ed3231d5a17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:53.963162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-646449d4-a772-47fd-b1e7-9ed3231d5a17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:53.964315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-646449d4-a772-47fd-b1e7-9ed3231d5a17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:54.396685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-646449d4-a772-47fd-b1e7-9ed3231d5a17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:54.431855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-646449d4-a772-47fd-b1e7-9ed3231d5a17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 0.505715 Jul 25 19:27:54.433264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 182/343] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:53 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:54.550650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e07f11ba-a3de-47be-9189-c1006a4aa321 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:54.568391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dd82549a-353e-481b-a92f-2351dbab21b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:54.569227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dd82549a-353e-481b-a92f-2351dbab21b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:54.582729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd82549a-353e-481b-a92f-2351dbab21b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:54.587167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e07f11ba-a3de-47be-9189-c1006a4aa321 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.717031 Jul 25 19:27:54.588301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd82549a-353e-481b-a92f-2351dbab21b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:54.589684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd82549a-353e-481b-a92f-2351dbab21b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:54.589850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 162/344] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:53 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:54.590548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd82549a-353e-481b-a92f-2351dbab21b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:55.121299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd82549a-353e-481b-a92f-2351dbab21b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:55.146645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd82549a-353e-481b-a92f-2351dbab21b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:55.151404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd82549a-353e-481b-a92f-2351dbab21b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:55.154183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dd82549a-353e-481b-a92f-2351dbab21b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1745 microversion: 2.20 time: 0.590705 Jul 25 19:27:55.167594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 183/345] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1745 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:27:55.479070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8719f983-a6ce-4cd5-807a-31f2c863bbfa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:55.480272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8719f983-a6ce-4cd5-807a-31f2c863bbfa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:55.492569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8719f983-a6ce-4cd5-807a-31f2c863bbfa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:55.496123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8719f983-a6ce-4cd5-807a-31f2c863bbfa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:55.497371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8719f983-a6ce-4cd5-807a-31f2c863bbfa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:55.497820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8719f983-a6ce-4cd5-807a-31f2c863bbfa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:55.563528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-529e5d28-0201-468c-bb14-95cef57b77d3 req-008f56d9-5f19-4766-b3bd-15c0b5e28f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f20ea26-3cf4-4cfd-820d-dc05ed15b079", "tag": "1ade161c-f9c0-488a-9248-931d1a9d4469"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:55.591317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-529e5d28-0201-468c-bb14-95cef57b77d3 req-008f56d9-5f19-4766-b3bd-15c0b5e28f0d service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:55.593099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-529e5d28-0201-468c-bb14-95cef57b77d3 req-008f56d9-5f19-4766-b3bd-15c0b5e28f0d service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:55.621122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-529e5d28-0201-468c-bb14-95cef57b77d3 req-008f56d9-5f19-4766-b3bd-15c0b5e28f0d service nova] Creating event network-changed:1ade161c-f9c0-488a-9248-931d1a9d4469 for instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 on hv-cinder-85093 Jul 25 19:27:55.629893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-529e5d28-0201-468c-bb14-95cef57b77d3 req-008f56d9-5f19-4766-b3bd-15c0b5e28f0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071071 Jul 25 19:27:55.631465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 184/346] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:55.644694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d582e307-9ca2-4370-a1f1-802dfd77c065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:55.648363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d582e307-9ca2-4370-a1f1-802dfd77c065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:55.673923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d582e307-9ca2-4370-a1f1-802dfd77c065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:55.674653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d582e307-9ca2-4370-a1f1-802dfd77c065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:55.676218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d582e307-9ca2-4370-a1f1-802dfd77c065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:55.677579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d582e307-9ca2-4370-a1f1-802dfd77c065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:56.835881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8719f983-a6ce-4cd5-807a-31f2c863bbfa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:56.874642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8719f983-a6ce-4cd5-807a-31f2c863bbfa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 1.404100 Jul 25 19:27:56.878573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 163/347] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:55 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:56.894998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf67db6a-07d8-44d1-aab7-4af6c3294e9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:56.899582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cf67db6a-07d8-44d1-aab7-4af6c3294e9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:56.908032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d582e307-9ca2-4370-a1f1-802dfd77c065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:56.916867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf67db6a-07d8-44d1-aab7-4af6c3294e9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:56.918394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf67db6a-07d8-44d1-aab7-4af6c3294e9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:56.920649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf67db6a-07d8-44d1-aab7-4af6c3294e9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:56.921830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf67db6a-07d8-44d1-aab7-4af6c3294e9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:56.937716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d582e307-9ca2-4370-a1f1-802dfd77c065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 1.300839 Jul 25 19:27:56.939013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 185/348] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:55 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:57.279954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-39951b22-14a4-404b-afcf-f0802f997ed3 req-ba024ea6-759e-47d8-b616-3b0f00fb32f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1007369a-dd3c-4837-95f4-e8326d600031", "name": "network-vif-plugged", "status": "completed", "tag": "33faefb9-12a5-4e86-b189-357d316c5553"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:57.306708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-39951b22-14a4-404b-afcf-f0802f997ed3 req-ba024ea6-759e-47d8-b616-3b0f00fb32f7 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:57.308834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-39951b22-14a4-404b-afcf-f0802f997ed3 req-ba024ea6-759e-47d8-b616-3b0f00fb32f7 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:57.335989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:57.344715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-39951b22-14a4-404b-afcf-f0802f997ed3 req-ba024ea6-759e-47d8-b616-3b0f00fb32f7 service nova] Creating event network-vif-plugged:33faefb9-12a5-4e86-b189-357d316c5553 for instance 1007369a-dd3c-4837-95f4-e8326d600031 on hv-cinder-85093 Jul 25 19:27:57.359855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-39951b22-14a4-404b-afcf-f0802f997ed3 req-ba024ea6-759e-47d8-b616-3b0f00fb32f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090935 Jul 25 19:27:57.360977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 186/349] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:57.490132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-4cb24a0b-7613-4197-8d51-c2edeee68abc req-b759b8e7-0674-49fd-8dc9-65dc8afa490c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25205dc-2b73-4c21-b5c9-ee7b365ac47d", "tag": "8f9b0ab5-6735-4140-9ebc-beecce6a3499"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:57.508973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf67db6a-07d8-44d1-aab7-4af6c3294e9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:57.553476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf67db6a-07d8-44d1-aab7-4af6c3294e9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:57.554057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-4cb24a0b-7613-4197-8d51-c2edeee68abc req-b759b8e7-0674-49fd-8dc9-65dc8afa490c service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:57.554835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-4cb24a0b-7613-4197-8d51-c2edeee68abc req-b759b8e7-0674-49fd-8dc9-65dc8afa490c service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:57.559135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf67db6a-07d8-44d1-aab7-4af6c3294e9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:57.562319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cf67db6a-07d8-44d1-aab7-4af6c3294e9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1745 microversion: 2.20 time: 0.679855 Jul 25 19:27:57.567591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 164/350] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:56 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1745 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:27:57.621146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-4cb24a0b-7613-4197-8d51-c2edeee68abc req-b759b8e7-0674-49fd-8dc9-65dc8afa490c service nova] Creating event network-changed:8f9b0ab5-6735-4140-9ebc-beecce6a3499 for instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d on hv-cinder-85093 Jul 25 19:27:57.638130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-4cb24a0b-7613-4197-8d51-c2edeee68abc req-b759b8e7-0674-49fd-8dc9-65dc8afa490c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170428 Jul 25 19:27:57.640087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 187/351] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:57.908935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-714aafd3-f798-4a0f-b3fc-6271348d4d6f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:57.916375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-714aafd3-f798-4a0f-b3fc-6271348d4d6f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:57.923003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714aafd3-f798-4a0f-b3fc-6271348d4d6f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:57.923739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714aafd3-f798-4a0f-b3fc-6271348d4d6f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:57.924780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714aafd3-f798-4a0f-b3fc-6271348d4d6f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:57.925414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714aafd3-f798-4a0f-b3fc-6271348d4d6f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:57.982785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd5adb91-5ebd-497c-a6bb-2391b6c189f1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:57.983683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd5adb91-5ebd-497c-a6bb-2391b6c189f1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:58.004797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd5adb91-5ebd-497c-a6bb-2391b6c189f1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:58.005425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd5adb91-5ebd-497c-a6bb-2391b6c189f1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:58.006710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd5adb91-5ebd-497c-a6bb-2391b6c189f1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:58.007315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd5adb91-5ebd-497c-a6bb-2391b6c189f1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:58.145972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=8 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:58.794607 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd5adb91-5ebd-497c-a6bb-2391b6c189f1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:58.826505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd5adb91-5ebd-497c-a6bb-2391b6c189f1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1500 microversion: 2.1 time: 0.845066 Jul 25 19:27:58.841479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 188/352] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:57 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1500 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:27:58.914461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-698f523e-df72-4806-8896-0fbb220dbad4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:58.916022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-698f523e-df72-4806-8896-0fbb220dbad4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:58.943416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-714aafd3-f798-4a0f-b3fc-6271348d4d6f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:27:58.947989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-698f523e-df72-4806-8896-0fbb220dbad4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:58.949095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-698f523e-df72-4806-8896-0fbb220dbad4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:58.955001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-698f523e-df72-4806-8896-0fbb220dbad4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:58.956848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-698f523e-df72-4806-8896-0fbb220dbad4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:58.962595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-714aafd3-f798-4a0f-b3fc-6271348d4d6f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 1.060448 Jul 25 19:27:58.976573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 165/353] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:57 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:27:58.990014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3df00a3b-f331-4b2f-b9bc-9b34d273c4e7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b04f13c-4cdd-4c8d-bd81-d189141e6fd3"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:58.994303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3df00a3b-f331-4b2f-b9bc-9b34d273c4e7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:59.021130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3df00a3b-f331-4b2f-b9bc-9b34d273c4e7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:59.024049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3df00a3b-f331-4b2f-b9bc-9b34d273c4e7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:59.030944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3df00a3b-f331-4b2f-b9bc-9b34d273c4e7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:59.032575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3df00a3b-f331-4b2f-b9bc-9b34d273c4e7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:59.146549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-3df00a3b-f331-4b2f-b9bc-9b34d273c4e7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] HTTP exception thrown: Cannot 'attach_volume' instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a while it is in vm_state rescued Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3df00a3b-f331-4b2f-b9bc-9b34d273c4e7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Request method failure captured: Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: POST /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a/os-volume_attachments HTTP/1.1 Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 74 Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u4RwW5XrdAmalLWu-UjzkASXjpbGu2tZCZNseD7o5gCL2MvafO83Ceyp8CzD6VSawdixpEu6Te-06ubcjM_akZE1w84nOz0pRGBVicrlyIKvweTflnG8JsSYE8lePqoD0UzsngGHIDlSlc_98FrrRZ7hUprBHShVFnl4VqzxdpY0uk Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 1df108d610134859919e6bf8903f6190 Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1334671139 Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 19:27:59.166042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1df108d610134859919e6bf8903f6190"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1df108d610134859919e6bf8903f6190"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1df108d610134859919e6bf8903f6190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1df108d610134859919e6bf8903f6190", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1334671139 Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 1df108d610134859919e6bf8903f6190 Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1334671139 Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-ServerRescueNegativeTestJSON-1334671139-project Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 0ed3ed6183d34c73ba40d13af037f838 Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1334671139-project Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {"volumeAttachment": {"volumeId": "2b04f13c-4cdd-4c8d-bd81-d189141e6fd3"}} Jul 25 19:27:59.168734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Cannot 'attach_volume' instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a while it is in vm_state rescued Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'server_id': '3e4c5ca9-5dfe-4ed1-895e-a0db055e690a', 'body': {'volumeAttachment': {'volumeId': '2b04f13c-4cdd-4c8d-bd81-d189141e6fd3'}}} Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:27:59.170195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a while it is in vm_state rescued Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:27:59.172577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:27:59.174694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:27:59.174694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:27:59.174694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a while it is in vm_state rescued Jul 25 19:27:59.174694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:27:59.185690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3df00a3b-f331-4b2f-b9bc-9b34d273c4e7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Returning 409 to user: Cannot 'attach_volume' instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a while it is in vm_state rescued {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:27:59.187775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3df00a3b-f331-4b2f-b9bc-9b34d273c4e7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "POST /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.217439 Jul 25 19:27:59.189070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 166/354] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 19:27:58 2022] POST /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a/os-volume_attachments => generated 152 bytes in 220 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 19:27:59.208442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8e3e3b8b-63a0-4c9e-bc78-99fafe703ef5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:59.214308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8e3e3b8b-63a0-4c9e-bc78-99fafe703ef5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:59.239577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e3e3b8b-63a0-4c9e-bc78-99fafe703ef5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:59.240574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e3e3b8b-63a0-4c9e-bc78-99fafe703ef5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:59.242113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e3e3b8b-63a0-4c9e-bc78-99fafe703ef5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:59.243114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e3e3b8b-63a0-4c9e-bc78-99fafe703ef5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:59.597087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8e3e3b8b-63a0-4c9e-bc78-99fafe703ef5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "POST /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a/action" status: 202 len: 0 microversion: 2.1 time: 0.398238 Jul 25 19:27:59.616864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 167/355] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 19:27:59 2022] POST /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:27:59.665148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5ce436fe-f809-4f9b-9e6c-c1b389defcd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:59.674020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5ce436fe-f809-4f9b-9e6c-c1b389defcd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:59.685273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:59.720573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ce436fe-f809-4f9b-9e6c-c1b389defcd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:59.725175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ce436fe-f809-4f9b-9e6c-c1b389defcd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:59.729540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ce436fe-f809-4f9b-9e6c-c1b389defcd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:59.731740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ce436fe-f809-4f9b-9e6c-c1b389defcd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:01.093754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-698f523e-df72-4806-8896-0fbb220dbad4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:01.133268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-698f523e-df72-4806-8896-0fbb220dbad4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:01.138577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-698f523e-df72-4806-8896-0fbb220dbad4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:01.142777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-698f523e-df72-4806-8896-0fbb220dbad4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 2.297889 Jul 25 19:28:01.147905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 189/356] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:27:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 2306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:01.204937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-782c2717-3f8b-4111-9210-9ed53bbd1995 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:01.206892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-782c2717-3f8b-4111-9210-9ed53bbd1995 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:01.242316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-782c2717-3f8b-4111-9210-9ed53bbd1995 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:01.245881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-782c2717-3f8b-4111-9210-9ed53bbd1995 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:01.252878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-782c2717-3f8b-4111-9210-9ed53bbd1995 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:01.256474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-782c2717-3f8b-4111-9210-9ed53bbd1995 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:01.271560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5ce436fe-f809-4f9b-9e6c-c1b389defcd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:01.310402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5ce436fe-f809-4f9b-9e6c-c1b389defcd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1508 microversion: 2.1 time: 1.687320 Jul 25 19:28:01.319852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 168/357] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:27:59 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1508 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:02.208997 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-782c2717-3f8b-4111-9210-9ed53bbd1995 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:02.210902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5ce5dad1-3b44-4010-9bd3-753fae2bd9b8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:02.211599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5ce5dad1-3b44-4010-9bd3-753fae2bd9b8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:02.236846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ce5dad1-3b44-4010-9bd3-753fae2bd9b8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:02.237608 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ce5dad1-3b44-4010-9bd3-753fae2bd9b8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:02.240843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ce5dad1-3b44-4010-9bd3-753fae2bd9b8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:02.241376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ce5dad1-3b44-4010-9bd3-753fae2bd9b8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:02.246443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-782c2717-3f8b-4111-9210-9ed53bbd1995 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 1.095618 Jul 25 19:28:02.253166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 190/358] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:01 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:02.358984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2d48d159-a1b7-4b54-a22f-a005b38d09e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:02.369280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2d48d159-a1b7-4b54-a22f-a005b38d09e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:02.387733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d48d159-a1b7-4b54-a22f-a005b38d09e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:02.392250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d48d159-a1b7-4b54-a22f-a005b38d09e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:02.393608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d48d159-a1b7-4b54-a22f-a005b38d09e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:02.394293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d48d159-a1b7-4b54-a22f-a005b38d09e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:03.495015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5ce5dad1-3b44-4010-9bd3-753fae2bd9b8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:03.530128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5ce5dad1-3b44-4010-9bd3-753fae2bd9b8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:03.535310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5ce5dad1-3b44-4010-9bd3-753fae2bd9b8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:03.541411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5ce5dad1-3b44-4010-9bd3-753fae2bd9b8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 1.333059 Jul 25 19:28:03.543604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 169/359] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:28:03.569268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a60fcc7f-0eda-4ccc-8d60-76a2726d08d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:03.574779 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a60fcc7f-0eda-4ccc-8d60-76a2726d08d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:03.616049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2d48d159-a1b7-4b54-a22f-a005b38d09e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:03.633809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a60fcc7f-0eda-4ccc-8d60-76a2726d08d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:03.648895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a60fcc7f-0eda-4ccc-8d60-76a2726d08d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:03.652420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a60fcc7f-0eda-4ccc-8d60-76a2726d08d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:03.659164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a60fcc7f-0eda-4ccc-8d60-76a2726d08d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:03.663897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2d48d159-a1b7-4b54-a22f-a005b38d09e5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1508 microversion: 2.1 time: 1.316067 Jul 25 19:28:03.685743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 191/360] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:02 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1508 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:04.208236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a60fcc7f-0eda-4ccc-8d60-76a2726d08d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:04.227890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a60fcc7f-0eda-4ccc-8d60-76a2726d08d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 0.673439 Jul 25 19:28:04.250352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 170/361] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:03 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:04.590548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f2d5c143-4e96-488b-b0b0-9edf0cd961e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:04.591849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f2d5c143-4e96-488b-b0b0-9edf0cd961e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:04.615393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2d5c143-4e96-488b-b0b0-9edf0cd961e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:04.618427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2d5c143-4e96-488b-b0b0-9edf0cd961e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:04.625465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2d5c143-4e96-488b-b0b0-9edf0cd961e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:04.626493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2d5c143-4e96-488b-b0b0-9edf0cd961e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:04.731756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-99a65ef8-2cc5-4c78-8427-81f3a07b9d08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:04.733059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-99a65ef8-2cc5-4c78-8427-81f3a07b9d08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:04.781609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99a65ef8-2cc5-4c78-8427-81f3a07b9d08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:04.789306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99a65ef8-2cc5-4c78-8427-81f3a07b9d08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:04.790848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99a65ef8-2cc5-4c78-8427-81f3a07b9d08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:04.798342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99a65ef8-2cc5-4c78-8427-81f3a07b9d08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:05.221466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2d5c143-4e96-488b-b0b0-9edf0cd961e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:05.237211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2d5c143-4e96-488b-b0b0-9edf0cd961e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:05.239547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2d5c143-4e96-488b-b0b0-9edf0cd961e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:05.245681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f2d5c143-4e96-488b-b0b0-9edf0cd961e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.659121 Jul 25 19:28:05.275671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-99a65ef8-2cc5-4c78-8427-81f3a07b9d08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:05.280944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 192/362] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:05.291324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-42abbe7c-e90d-414d-a064-69656fbfc1ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:05.291705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-99a65ef8-2cc5-4c78-8427-81f3a07b9d08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1508 microversion: 2.1 time: 0.571416 Jul 25 19:28:05.292788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 171/363] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:04 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1508 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:05.293996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-42abbe7c-e90d-414d-a064-69656fbfc1ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:05.304710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42abbe7c-e90d-414d-a064-69656fbfc1ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:05.305841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42abbe7c-e90d-414d-a064-69656fbfc1ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:05.307568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42abbe7c-e90d-414d-a064-69656fbfc1ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:05.308808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42abbe7c-e90d-414d-a064-69656fbfc1ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:05.742182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-42abbe7c-e90d-414d-a064-69656fbfc1ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:05.795807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-42abbe7c-e90d-414d-a064-69656fbfc1ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 0.510843 Jul 25 19:28:05.819346 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 193/364] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:05 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:06.290486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3b7ac42c-148d-493c-b487-55ec419c2283 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:06.291886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3b7ac42c-148d-493c-b487-55ec419c2283 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:06.319937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b7ac42c-148d-493c-b487-55ec419c2283 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:06.321068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b7ac42c-148d-493c-b487-55ec419c2283 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:06.323536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b7ac42c-148d-493c-b487-55ec419c2283 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:06.323536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b7ac42c-148d-493c-b487-55ec419c2283 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:06.325896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-baea0ccc-9b77-4fd8-b2c2-159dc905346d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:06.328789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-baea0ccc-9b77-4fd8-b2c2-159dc905346d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:06.344918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baea0ccc-9b77-4fd8-b2c2-159dc905346d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:06.345914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baea0ccc-9b77-4fd8-b2c2-159dc905346d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:06.347553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baea0ccc-9b77-4fd8-b2c2-159dc905346d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:06.349823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baea0ccc-9b77-4fd8-b2c2-159dc905346d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:06.807797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b7ac42c-148d-493c-b487-55ec419c2283 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:06.839796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b7ac42c-148d-493c-b487-55ec419c2283 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:06.843247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b7ac42c-148d-493c-b487-55ec419c2283 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:06.845667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3b7ac42c-148d-493c-b487-55ec419c2283 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.565094 Jul 25 19:28:06.856844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 172/365] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:06.903742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7afde7a3-b422-4530-9959-1d81ecf16369 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:06.905423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7afde7a3-b422-4530-9959-1d81ecf16369 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:06.934186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7afde7a3-b422-4530-9959-1d81ecf16369 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:06.935775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7afde7a3-b422-4530-9959-1d81ecf16369 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:06.939947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7afde7a3-b422-4530-9959-1d81ecf16369 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:06.945342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7afde7a3-b422-4530-9959-1d81ecf16369 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:06.971305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:06.979631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-baea0ccc-9b77-4fd8-b2c2-159dc905346d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:07.003769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-baea0ccc-9b77-4fd8-b2c2-159dc905346d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1508 microversion: 2.1 time: 0.691271 Jul 25 19:28:07.006770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 194/366] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:06 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1508 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:07.393626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7afde7a3-b422-4530-9959-1d81ecf16369 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:07.418716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7afde7a3-b422-4530-9959-1d81ecf16369 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 0.549273 Jul 25 19:28:07.421143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 173/367] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:06 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:07.910218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5e5e8f07-2820-4623-a81d-7b57d8038194 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:07.914068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5e5e8f07-2820-4623-a81d-7b57d8038194 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:07.951343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e5e8f07-2820-4623-a81d-7b57d8038194 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:07.952671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e5e8f07-2820-4623-a81d-7b57d8038194 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:07.955171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e5e8f07-2820-4623-a81d-7b57d8038194 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:07.956555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e5e8f07-2820-4623-a81d-7b57d8038194 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:08.049472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4eeb245e-9c86-43ad-b886-8753bf86c334 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:08.050448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4eeb245e-9c86-43ad-b886-8753bf86c334 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:08.069071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4eeb245e-9c86-43ad-b886-8753bf86c334 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:08.069595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4eeb245e-9c86-43ad-b886-8753bf86c334 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:08.073884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4eeb245e-9c86-43ad-b886-8753bf86c334 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:08.074535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4eeb245e-9c86-43ad-b886-8753bf86c334 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:08.517209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4eeb245e-9c86-43ad-b886-8753bf86c334 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:08.533507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4eeb245e-9c86-43ad-b886-8753bf86c334 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1508 microversion: 2.1 time: 0.490103 Jul 25 19:28:08.548481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 174/368] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:08 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1508 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:08.560321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-db694150-86eb-454e-a4ee-de9a1131876f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:08.561222 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-db694150-86eb-454e-a4ee-de9a1131876f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:08.584086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db694150-86eb-454e-a4ee-de9a1131876f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:08.587256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db694150-86eb-454e-a4ee-de9a1131876f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:08.590099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db694150-86eb-454e-a4ee-de9a1131876f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:08.594518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db694150-86eb-454e-a4ee-de9a1131876f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:08.608692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5e5e8f07-2820-4623-a81d-7b57d8038194 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:08.632966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5e5e8f07-2820-4623-a81d-7b57d8038194 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:08.636304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5e5e8f07-2820-4623-a81d-7b57d8038194 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:08.638216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5e5e8f07-2820-4623-a81d-7b57d8038194 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.735729 Jul 25 19:28:08.639497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 195/369] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:09.323763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-db694150-86eb-454e-a4ee-de9a1131876f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:09.344989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-db694150-86eb-454e-a4ee-de9a1131876f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 0.794489 Jul 25 19:28:09.348926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 175/370] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:08 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:09.562765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-225942bf-f7df-4dbf-a9d5-802269d06e18 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:09.563827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-225942bf-f7df-4dbf-a9d5-802269d06e18 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:09.573671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-225942bf-f7df-4dbf-a9d5-802269d06e18 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:09.574182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-225942bf-f7df-4dbf-a9d5-802269d06e18 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:09.576149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-225942bf-f7df-4dbf-a9d5-802269d06e18 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:09.576848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-225942bf-f7df-4dbf-a9d5-802269d06e18 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:09.591580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:09.670974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-073d8ab5-8c4a-4953-9e55-3934b8fc40ff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:09.672988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-073d8ab5-8c4a-4953-9e55-3934b8fc40ff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:09.688746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-073d8ab5-8c4a-4953-9e55-3934b8fc40ff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:09.691826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-073d8ab5-8c4a-4953-9e55-3934b8fc40ff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:09.696300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-073d8ab5-8c4a-4953-9e55-3934b8fc40ff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:09.700113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-073d8ab5-8c4a-4953-9e55-3934b8fc40ff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:10.289314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-225942bf-f7df-4dbf-a9d5-802269d06e18 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:10.303118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-225942bf-f7df-4dbf-a9d5-802269d06e18 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1514 microversion: 2.1 time: 0.746570 Jul 25 19:28:10.308645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 196/371] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:09 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1514 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:10.400028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1a525189-2ae9-4849-af31-1cdf2a24acb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:10.400852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1a525189-2ae9-4849-af31-1cdf2a24acb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:10.429876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-073d8ab5-8c4a-4953-9e55-3934b8fc40ff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:10.433352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a525189-2ae9-4849-af31-1cdf2a24acb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:10.435063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a525189-2ae9-4849-af31-1cdf2a24acb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:10.437027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a525189-2ae9-4849-af31-1cdf2a24acb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:10.438293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a525189-2ae9-4849-af31-1cdf2a24acb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:10.453310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-073d8ab5-8c4a-4953-9e55-3934b8fc40ff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:10.456573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-073d8ab5-8c4a-4953-9e55-3934b8fc40ff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:10.465772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-073d8ab5-8c4a-4953-9e55-3934b8fc40ff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.797949 Jul 25 19:28:10.466868 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 176/372] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:10.970889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1a525189-2ae9-4849-af31-1cdf2a24acb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:10.987445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a245e7cd-1434-47d5-ad5b-818bca431f3d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eff0ae7b-cde4-4c8d-b0dc-7d01c64fea5c", "device": "/dev/sdb"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:10.991910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a245e7cd-1434-47d5-ad5b-818bca431f3d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:10.998440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1a525189-2ae9-4849-af31-1cdf2a24acb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 0.605197 Jul 25 19:28:11.004459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 197/373] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:10 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:11.009358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a245e7cd-1434-47d5-ad5b-818bca431f3d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.009358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a245e7cd-1434-47d5-ad5b-818bca431f3d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.009358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a245e7cd-1434-47d5-ad5b-818bca431f3d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.009358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a245e7cd-1434-47d5-ad5b-818bca431f3d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.523882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a1ca800e-46db-4cb3-aec6-87b02643bbfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:11.523882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a1ca800e-46db-4cb3-aec6-87b02643bbfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:11.562912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1ca800e-46db-4cb3-aec6-87b02643bbfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.563707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1ca800e-46db-4cb3-aec6-87b02643bbfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.565132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1ca800e-46db-4cb3-aec6-87b02643bbfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.592723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1ca800e-46db-4cb3-aec6-87b02643bbfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.864199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a245e7cd-1434-47d5-ad5b-818bca431f3d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "POST /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880436 Jul 25 19:28:11.866653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 177/374] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 19:28:10 2022] POST /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:28:12.055822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-75d1c4d6-6ed3-48ca-a321-c1502e73d326 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:12.069963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-75d1c4d6-6ed3-48ca-a321-c1502e73d326 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:12.106619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75d1c4d6-6ed3-48ca-a321-c1502e73d326 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:12.107484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75d1c4d6-6ed3-48ca-a321-c1502e73d326 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:12.116046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75d1c4d6-6ed3-48ca-a321-c1502e73d326 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:12.117004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75d1c4d6-6ed3-48ca-a321-c1502e73d326 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:12.290980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1ca800e-46db-4cb3-aec6-87b02643bbfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:12.315159 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1ca800e-46db-4cb3-aec6-87b02643bbfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:12.347995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1ca800e-46db-4cb3-aec6-87b02643bbfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:12.350306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a1ca800e-46db-4cb3-aec6-87b02643bbfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.837304 Jul 25 19:28:12.365149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 198/375] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:12.737231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-36d2ea1a-8023-4f61-a452-9078366f2c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Action: 'create', calling method: .version_select at 0x7feb08532940>, body: {"keypair": {"name": "tempest-keypair-616138224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO01b5QbUXwVz+M7ZnDa+ZxKjkqev39ZqT+mFZsQ1Hy6j+eUahA7cRQ9gNNnspk5B5h/HmkSwKFBZcorNfoRTSNXHYg4ovOnNiMAlRa1QQ0inQh1XRkFp6b3ZO0eXuHi4Q=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:12.812023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-36d2ea1a-8023-4f61-a452-9078366f2c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Getting quotas for project 1df108d610134859919e6bf8903f6190. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:28:12.829998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-36d2ea1a-8023-4f61-a452-9078366f2c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Getting quotas for user 0ed3ed6183d34c73ba40d13af037f838 and project 1df108d610134859919e6bf8903f6190. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:28:12.859437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:12.932396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-36d2ea1a-8023-4f61-a452-9078366f2c72 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.203011 Jul 25 19:28:12.947653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 199/376] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Jul 25 19:28:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:28:13.008838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-2e789aa0-8db2-4d1c-ba8d-f3e4ff1be4fb req-40953e32-c94c-4de7-b3da-503d8612fd53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25205dc-2b73-4c21-b5c9-ee7b365ac47d", "name": "network-vif-plugged", "status": "completed", "tag": "8f9b0ab5-6735-4140-9ebc-beecce6a3499"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:13.050399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-2e789aa0-8db2-4d1c-ba8d-f3e4ff1be4fb req-40953e32-c94c-4de7-b3da-503d8612fd53 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:13.064723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-2e789aa0-8db2-4d1c-ba8d-f3e4ff1be4fb req-40953e32-c94c-4de7-b3da-503d8612fd53 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:13.094912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-2e789aa0-8db2-4d1c-ba8d-f3e4ff1be4fb req-40953e32-c94c-4de7-b3da-503d8612fd53 service nova] Creating event network-vif-plugged:8f9b0ab5-6735-4140-9ebc-beecce6a3499 for instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d on hv-cinder-85093 Jul 25 19:28:13.119216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-2e789aa0-8db2-4d1c-ba8d-f3e4ff1be4fb req-40953e32-c94c-4de7-b3da-503d8612fd53 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118178 Jul 25 19:28:13.121260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 200/377] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:28:13.416775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5565dbf6-32ca-4a18-953c-88ee4ac17f73 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:13.428345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5565dbf6-32ca-4a18-953c-88ee4ac17f73 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:13.467092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5565dbf6-32ca-4a18-953c-88ee4ac17f73 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:13.474122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5565dbf6-32ca-4a18-953c-88ee4ac17f73 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:13.482769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5565dbf6-32ca-4a18-953c-88ee4ac17f73 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:13.488507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5565dbf6-32ca-4a18-953c-88ee4ac17f73 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:13.986677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-75d1c4d6-6ed3-48ca-a321-c1502e73d326 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:14.020525 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-75d1c4d6-6ed3-48ca-a321-c1502e73d326 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 1.979563 Jul 25 19:28:14.027393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 178/378] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:12 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:14.826644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5565dbf6-32ca-4a18-953c-88ee4ac17f73 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:14.890792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5565dbf6-32ca-4a18-953c-88ee4ac17f73 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:14.916988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5565dbf6-32ca-4a18-953c-88ee4ac17f73 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:14.920225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5565dbf6-32ca-4a18-953c-88ee4ac17f73 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 1.515482 Jul 25 19:28:14.921648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 201/379] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:28:15.073984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fe81d147-d4d0-44fc-a8ae-c3eeb0a840a8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:15.076402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fe81d147-d4d0-44fc-a8ae-c3eeb0a840a8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:15.093734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fe81d147-d4d0-44fc-a8ae-c3eeb0a840a8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:15.095122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fe81d147-d4d0-44fc-a8ae-c3eeb0a840a8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:15.096969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fe81d147-d4d0-44fc-a8ae-c3eeb0a840a8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:15.098699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fe81d147-d4d0-44fc-a8ae-c3eeb0a840a8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:15.993549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-45d088b0-74a6-4966-acd7-764cf232c801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:16.000612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-45d088b0-74a6-4966-acd7-764cf232c801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:16.025331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d088b0-74a6-4966-acd7-764cf232c801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:16.031826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d088b0-74a6-4966-acd7-764cf232c801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:16.034717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d088b0-74a6-4966-acd7-764cf232c801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:16.040399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d088b0-74a6-4966-acd7-764cf232c801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:16.411600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fe81d147-d4d0-44fc-a8ae-c3eeb0a840a8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:16.443536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fe81d147-d4d0-44fc-a8ae-c3eeb0a840a8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 1.379625 Jul 25 19:28:16.468151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 179/380] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:15 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:16.641083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-45d088b0-74a6-4966-acd7-764cf232c801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:16.690085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-45d088b0-74a6-4966-acd7-764cf232c801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:16.698963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-45d088b0-74a6-4966-acd7-764cf232c801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:16.709649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-45d088b0-74a6-4966-acd7-764cf232c801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.739571 Jul 25 19:28:16.714225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 202/381] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:28:17.496865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-92950bc2-7dcf-4377-9093-fd0c47dfc2f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:17.499926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-92950bc2-7dcf-4377-9093-fd0c47dfc2f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:17.523068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92950bc2-7dcf-4377-9093-fd0c47dfc2f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:17.537466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92950bc2-7dcf-4377-9093-fd0c47dfc2f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:17.544351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92950bc2-7dcf-4377-9093-fd0c47dfc2f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:17.548460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92950bc2-7dcf-4377-9093-fd0c47dfc2f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:17.759867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d577de9-9f5d-4d91-b7d2-93488d187a72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:17.761438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d577de9-9f5d-4d91-b7d2-93488d187a72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:17.798971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d577de9-9f5d-4d91-b7d2-93488d187a72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:17.808253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d577de9-9f5d-4d91-b7d2-93488d187a72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:17.813547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d577de9-9f5d-4d91-b7d2-93488d187a72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:17.815876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d577de9-9f5d-4d91-b7d2-93488d187a72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:19.024060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-92950bc2-7dcf-4377-9093-fd0c47dfc2f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:19.033185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-92950bc2-7dcf-4377-9093-fd0c47dfc2f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1366 microversion: 2.1 time: 1.546530 Jul 25 19:28:19.050533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 180/382] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:17 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1366 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:19.059312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1335700540", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e5d12de-dfa3-4a0c-81d4-ecb6cbcb6f1d"}], "security_groups": [{"name": "tempest-securitygroup--931006090"}], "key_name": "tempest-keypair-616138224", "user_data": "}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:19.259703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d577de9-9f5d-4d91-b7d2-93488d187a72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:19.277348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d577de9-9f5d-4d91-b7d2-93488d187a72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:19.283005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d577de9-9f5d-4d91-b7d2-93488d187a72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:19.287817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d577de9-9f5d-4d91-b7d2-93488d187a72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 1.536927 Jul 25 19:28:19.291920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 203/383] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:28:19.490265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] validate_networks() for [('2e5d12de-dfa3-4a0c-81d4-ecb6cbcb6f1d', None, None, None, None, None)] {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:28:20.064004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b766fb47-3957-40dd-ba89-c643581c1e17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:20.065743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b766fb47-3957-40dd-ba89-c643581c1e17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:20.080535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b766fb47-3957-40dd-ba89-c643581c1e17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:20.081915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b766fb47-3957-40dd-ba89-c643581c1e17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:20.084541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b766fb47-3957-40dd-ba89-c643581c1e17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:20.085759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b766fb47-3957-40dd-ba89-c643581c1e17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:21.591408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b766fb47-3957-40dd-ba89-c643581c1e17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:21.619960 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b766fb47-3957-40dd-ba89-c643581c1e17 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1555 microversion: 2.1 time: 1.564335 Jul 25 19:28:21.647767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 204/384] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:20 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1555 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:21.687765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-42b1f26d-0560-4ffb-b62e-a6e19ef1b867 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:21.689143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-42b1f26d-0560-4ffb-b62e-a6e19ef1b867 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:21.725358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42b1f26d-0560-4ffb-b62e-a6e19ef1b867 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:21.726134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42b1f26d-0560-4ffb-b62e-a6e19ef1b867 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:21.730061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42b1f26d-0560-4ffb-b62e-a6e19ef1b867 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:21.735153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42b1f26d-0560-4ffb-b62e-a6e19ef1b867 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:22.624046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-42b1f26d-0560-4ffb-b62e-a6e19ef1b867 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:22.644953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-42b1f26d-0560-4ffb-b62e-a6e19ef1b867 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:22.649610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-42b1f26d-0560-4ffb-b62e-a6e19ef1b867 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:22.652632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-42b1f26d-0560-4ffb-b62e-a6e19ef1b867 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 1.002393 Jul 25 19:28:22.654529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 205/385] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:22.665646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f0a12b86-ff97-4685-a0cd-b15a77e58168 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:22.667054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f0a12b86-ff97-4685-a0cd-b15a77e58168 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:22.679322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0a12b86-ff97-4685-a0cd-b15a77e58168 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:22.680774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0a12b86-ff97-4685-a0cd-b15a77e58168 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:22.682788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0a12b86-ff97-4685-a0cd-b15a77e58168 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:22.684147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0a12b86-ff97-4685-a0cd-b15a77e58168 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:22.716007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:28:22.718193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:28:22.720067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:28:22.722653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:28:22.723963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:28:22.745575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:22.746986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:22.749242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:22.750405 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:22.812629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Getting quotas for project 1df108d610134859919e6bf8903f6190. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:28:22.823829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Getting quotas for user 0ed3ed6183d34c73ba40d13af037f838 and project 1df108d610134859919e6bf8903f6190. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:28:22.861284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:28:22.867499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:28:22.883344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:23.002137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-70cff66f-de35-4a1c-9eab-9156c9a68357 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.948717 Jul 25 19:28:23.004861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 181/386] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:28:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 3953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:28:23.016058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f0a12b86-ff97-4685-a0cd-b15a77e58168 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.358919 Jul 25 19:28:23.017702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 206/387] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Jul 25 19:28:22 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d/os-interface => generated 284 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:28:23.031498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8564e441-1aae-41fa-9d35-1a2a836bd39e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:23.032104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8564e441-1aae-41fa-9d35-1a2a836bd39e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:23.301528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8564e441-1aae-41fa-9d35-1a2a836bd39e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:23.339764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8564e441-1aae-41fa-9d35-1a2a836bd39e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1245 microversion: 2.1 time: 0.320657 Jul 25 19:28:23.345070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 182/388] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:23 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1245 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:23.703551 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c8afbe98-af26-470c-9337-f1baa9c2cdaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:23.705323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c8afbe98-af26-470c-9337-f1baa9c2cdaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:23.727205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8afbe98-af26-470c-9337-f1baa9c2cdaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:23.736512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8afbe98-af26-470c-9337-f1baa9c2cdaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:23.744819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8afbe98-af26-470c-9337-f1baa9c2cdaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:23.746242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8afbe98-af26-470c-9337-f1baa9c2cdaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:24.155867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c8afbe98-af26-470c-9337-f1baa9c2cdaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:24.186216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c8afbe98-af26-470c-9337-f1baa9c2cdaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:24.190181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c8afbe98-af26-470c-9337-f1baa9c2cdaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:24.193333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c8afbe98-af26-470c-9337-f1baa9c2cdaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.497503 Jul 25 19:28:24.195342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 207/389] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:24.388629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9079e8bf-1846-40f6-b482-ee947d3bd53a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:24.392626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9079e8bf-1846-40f6-b482-ee947d3bd53a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:24.426387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9079e8bf-1846-40f6-b482-ee947d3bd53a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:24.428149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9079e8bf-1846-40f6-b482-ee947d3bd53a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:24.432144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9079e8bf-1846-40f6-b482-ee947d3bd53a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:24.434589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9079e8bf-1846-40f6-b482-ee947d3bd53a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:24.580639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9079e8bf-1846-40f6-b482-ee947d3bd53a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:24.599110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9079e8bf-1846-40f6-b482-ee947d3bd53a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1249 microversion: 2.1 time: 0.217399 Jul 25 19:28:24.604931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 183/390] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:24 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1249 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:25.247342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b2e7c5b7-ae01-499b-bdac-4cf772a784a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:25.251535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b2e7c5b7-ae01-499b-bdac-4cf772a784a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:25.319809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2e7c5b7-ae01-499b-bdac-4cf772a784a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:25.327437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2e7c5b7-ae01-499b-bdac-4cf772a784a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:25.333028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2e7c5b7-ae01-499b-bdac-4cf772a784a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:25.333954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2e7c5b7-ae01-499b-bdac-4cf772a784a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:25.417009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-cfa8524e-716d-4322-994a-5e095d8ea32b req-24b60122-f298-4bf6-928d-395ebb15af77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25205dc-2b73-4c21-b5c9-ee7b365ac47d", "tag": "8f9b0ab5-6735-4140-9ebc-beecce6a3499"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:25.457313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-cfa8524e-716d-4322-994a-5e095d8ea32b req-24b60122-f298-4bf6-928d-395ebb15af77 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:25.462820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-cfa8524e-716d-4322-994a-5e095d8ea32b req-24b60122-f298-4bf6-928d-395ebb15af77 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:25.493390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-cfa8524e-716d-4322-994a-5e095d8ea32b req-24b60122-f298-4bf6-928d-395ebb15af77 service nova] Creating event network-changed:8f9b0ab5-6735-4140-9ebc-beecce6a3499 for instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d on hv-cinder-85093 Jul 25 19:28:25.506929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-cfa8524e-716d-4322-994a-5e095d8ea32b req-24b60122-f298-4bf6-928d-395ebb15af77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094871 Jul 25 19:28:25.520259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 184/391] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:28:25.655563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-914cf99b-fb7d-4e30-b53b-c27bc4efeb52 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:25.657900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-914cf99b-fb7d-4e30-b53b-c27bc4efeb52 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:25.683133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-914cf99b-fb7d-4e30-b53b-c27bc4efeb52 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:25.693364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-914cf99b-fb7d-4e30-b53b-c27bc4efeb52 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:25.696535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-914cf99b-fb7d-4e30-b53b-c27bc4efeb52 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:25.698020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-914cf99b-fb7d-4e30-b53b-c27bc4efeb52 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:25.844788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2e7c5b7-ae01-499b-bdac-4cf772a784a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:25.864446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2e7c5b7-ae01-499b-bdac-4cf772a784a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:25.868332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2e7c5b7-ae01-499b-bdac-4cf772a784a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:25.869712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b2e7c5b7-ae01-499b-bdac-4cf772a784a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.633706 Jul 25 19:28:25.872959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 208/392] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:26.056258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-914cf99b-fb7d-4e30-b53b-c27bc4efeb52 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:26.090012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-914cf99b-fb7d-4e30-b53b-c27bc4efeb52 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1249 microversion: 2.1 time: 0.441198 Jul 25 19:28:26.094900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 185/393] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:25 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1249 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:26.920023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-440e3eef-6694-4a38-9d5f-55888b79d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:26.928063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-440e3eef-6694-4a38-9d5f-55888b79d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:26.971401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-440e3eef-6694-4a38-9d5f-55888b79d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:26.981104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-440e3eef-6694-4a38-9d5f-55888b79d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:26.982934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-440e3eef-6694-4a38-9d5f-55888b79d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:26.992187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-440e3eef-6694-4a38-9d5f-55888b79d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:27.140659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f29f1dd7-3dca-4831-af84-6de65fcd4857 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:27.145077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f29f1dd7-3dca-4831-af84-6de65fcd4857 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:27.182825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f29f1dd7-3dca-4831-af84-6de65fcd4857 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:27.189646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f29f1dd7-3dca-4831-af84-6de65fcd4857 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:27.191689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f29f1dd7-3dca-4831-af84-6de65fcd4857 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:27.195341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f29f1dd7-3dca-4831-af84-6de65fcd4857 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:27.539325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f29f1dd7-3dca-4831-af84-6de65fcd4857 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:27.575820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f29f1dd7-3dca-4831-af84-6de65fcd4857 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1241 microversion: 2.1 time: 0.435996 Jul 25 19:28:27.599765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 186/394] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:27 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1241 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:27.999169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-440e3eef-6694-4a38-9d5f-55888b79d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:28.060592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-440e3eef-6694-4a38-9d5f-55888b79d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:28.064327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-440e3eef-6694-4a38-9d5f-55888b79d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:28.076024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-440e3eef-6694-4a38-9d5f-55888b79d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 1.162670 Jul 25 19:28:28.077954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 209/395] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:28.619380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f98deb3a-43e0-4271-8d22-419c1b81732a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:28.623648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f98deb3a-43e0-4271-8d22-419c1b81732a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:28.658369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f98deb3a-43e0-4271-8d22-419c1b81732a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:28.659364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f98deb3a-43e0-4271-8d22-419c1b81732a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:28.666065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f98deb3a-43e0-4271-8d22-419c1b81732a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:28.673142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f98deb3a-43e0-4271-8d22-419c1b81732a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:29.049661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f98deb3a-43e0-4271-8d22-419c1b81732a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:29.070137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f98deb3a-43e0-4271-8d22-419c1b81732a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1315 microversion: 2.1 time: 0.458831 Jul 25 19:28:29.071582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 187/396] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:28 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:29.123648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c63e9907-abfa-4209-a260-dcadc35f2052 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:29.126690 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c63e9907-abfa-4209-a260-dcadc35f2052 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:29.148401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c63e9907-abfa-4209-a260-dcadc35f2052 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:29.149206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c63e9907-abfa-4209-a260-dcadc35f2052 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:29.150331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c63e9907-abfa-4209-a260-dcadc35f2052 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:29.150801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c63e9907-abfa-4209-a260-dcadc35f2052 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:29.931940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c63e9907-abfa-4209-a260-dcadc35f2052 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:29.976479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c63e9907-abfa-4209-a260-dcadc35f2052 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:29.979794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c63e9907-abfa-4209-a260-dcadc35f2052 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:29.982109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c63e9907-abfa-4209-a260-dcadc35f2052 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.862259 Jul 25 19:28:29.983167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 210/397] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:29 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:30.115090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c1e2109b-3d71-4afa-98c7-e519beb8ed3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:30.116085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c1e2109b-3d71-4afa-98c7-e519beb8ed3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:30.119929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:30.146910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1e2109b-3d71-4afa-98c7-e519beb8ed3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:30.147906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1e2109b-3d71-4afa-98c7-e519beb8ed3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:30.149012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1e2109b-3d71-4afa-98c7-e519beb8ed3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:30.149685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1e2109b-3d71-4afa-98c7-e519beb8ed3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:30.342494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c1e2109b-3d71-4afa-98c7-e519beb8ed3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:30.362354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c1e2109b-3d71-4afa-98c7-e519beb8ed3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1303 microversion: 2.1 time: 0.251814 Jul 25 19:28:30.364881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 188/398] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:30 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:31.012907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df6779a8-91c9-46a7-bd65-674dc2631bee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:31.017873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-df6779a8-91c9-46a7-bd65-674dc2631bee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:31.028230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df6779a8-91c9-46a7-bd65-674dc2631bee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:31.029010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df6779a8-91c9-46a7-bd65-674dc2631bee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:31.030151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df6779a8-91c9-46a7-bd65-674dc2631bee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:31.030710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df6779a8-91c9-46a7-bd65-674dc2631bee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:31.306329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df6779a8-91c9-46a7-bd65-674dc2631bee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:31.319931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df6779a8-91c9-46a7-bd65-674dc2631bee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:31.324013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df6779a8-91c9-46a7-bd65-674dc2631bee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:31.325959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df6779a8-91c9-46a7-bd65-674dc2631bee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.317210 Jul 25 19:28:31.326862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 211/399] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:31.409512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6ac3dfed-5b76-4b04-b0c7-5ecb2ee2efc9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:31.410593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6ac3dfed-5b76-4b04-b0c7-5ecb2ee2efc9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:31.424518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ac3dfed-5b76-4b04-b0c7-5ecb2ee2efc9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:31.425925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ac3dfed-5b76-4b04-b0c7-5ecb2ee2efc9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:31.427440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ac3dfed-5b76-4b04-b0c7-5ecb2ee2efc9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:31.428261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ac3dfed-5b76-4b04-b0c7-5ecb2ee2efc9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:31.517591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6ac3dfed-5b76-4b04-b0c7-5ecb2ee2efc9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:31.532057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6ac3dfed-5b76-4b04-b0c7-5ecb2ee2efc9 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1303 microversion: 2.1 time: 0.133242 Jul 25 19:28:31.533169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 189/400] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:31 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:32.004482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f646449-3f05-4720-91c0-3c01bccd0687 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Action: 'create', calling method: .version_select at 0x7feb085b9280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1963016785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGObQF5PRPi7USO7cEUEcICNT/OyYK1jj/Zcr6zvyBYJQYgX7nhEDB26dsYnPoyxWVxa2hAVVfrxoLI4S5wgfv4ibkr6a/P1eTqk48GK5fLt7a8FhkkUISb3fauKEYJInw=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:32.036631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-2f646449-3f05-4720-91c0-3c01bccd0687 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Getting quotas for project 9166cf61c5d944fd9f1e2174c6544faa. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:28:32.045351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-2f646449-3f05-4720-91c0-3c01bccd0687 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Getting quotas for user 574d0113dce74ab199c0162abe26934b and project 9166cf61c5d944fd9f1e2174c6544faa. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:28:32.111457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2f646449-3f05-4720-91c0-3c01bccd0687 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.410802 Jul 25 19:28:32.113456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 212/401] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Jul 25 19:28:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:28:32.359742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c4e9d184-523c-4a4c-865b-11810e508e44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:32.361419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c4e9d184-523c-4a4c-865b-11810e508e44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:32.382480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4e9d184-523c-4a4c-865b-11810e508e44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:32.382945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4e9d184-523c-4a4c-865b-11810e508e44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:32.385561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4e9d184-523c-4a4c-865b-11810e508e44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:32.387251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4e9d184-523c-4a4c-865b-11810e508e44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:32.564886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6435169e-da4b-4223-b0cf-af755847056a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:32.567476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6435169e-da4b-4223-b0cf-af755847056a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:32.580922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6435169e-da4b-4223-b0cf-af755847056a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:32.582450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6435169e-da4b-4223-b0cf-af755847056a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:32.584300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6435169e-da4b-4223-b0cf-af755847056a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:32.586063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6435169e-da4b-4223-b0cf-af755847056a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:32.626263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c4e9d184-523c-4a4c-865b-11810e508e44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:32.630540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:32.649301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c4e9d184-523c-4a4c-865b-11810e508e44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:32.654438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c4e9d184-523c-4a4c-865b-11810e508e44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:32.658232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c4e9d184-523c-4a4c-865b-11810e508e44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1740 microversion: 2.20 time: 0.307487 Jul 25 19:28:32.660569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 190/402] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:32 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:28:32.727230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6435169e-da4b-4223-b0cf-af755847056a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:32.746861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6435169e-da4b-4223-b0cf-af755847056a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1303 microversion: 2.1 time: 0.189662 Jul 25 19:28:32.772580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 213/403] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:32 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1303 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:33.702748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a88644a2-9ae5-4d6d-afef-8f92eb987121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:33.703573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a88644a2-9ae5-4d6d-afef-8f92eb987121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:33.753653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:33.760386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=8 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:33.773895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a88644a2-9ae5-4d6d-afef-8f92eb987121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:33.775785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a88644a2-9ae5-4d6d-afef-8f92eb987121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:33.785054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a88644a2-9ae5-4d6d-afef-8f92eb987121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:33.786044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a88644a2-9ae5-4d6d-afef-8f92eb987121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:33.787636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b3a3c2c9-e50a-4395-bd0d-06ef31e9a217 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:33.788623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b3a3c2c9-e50a-4395-bd0d-06ef31e9a217 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:33.824818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3a3c2c9-e50a-4395-bd0d-06ef31e9a217 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:33.828033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3a3c2c9-e50a-4395-bd0d-06ef31e9a217 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:33.834318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3a3c2c9-e50a-4395-bd0d-06ef31e9a217 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:33.844923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3a3c2c9-e50a-4395-bd0d-06ef31e9a217 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:34.151069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b3a3c2c9-e50a-4395-bd0d-06ef31e9a217 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:34.180666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b3a3c2c9-e50a-4395-bd0d-06ef31e9a217 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1303 microversion: 2.1 time: 0.399593 Jul 25 19:28:34.183403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 214/404] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:33 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1303 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:35.035550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a88644a2-9ae5-4d6d-afef-8f92eb987121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:35.049908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a88644a2-9ae5-4d6d-afef-8f92eb987121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:35.054751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a88644a2-9ae5-4d6d-afef-8f92eb987121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:35.056653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a88644a2-9ae5-4d6d-afef-8f92eb987121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1722 microversion: 2.20 time: 1.361411 Jul 25 19:28:35.063635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 191/405] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1722 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:35.212819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-00e805f5-2404-4445-a4f7-4551ce0f0fbe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:35.214283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-00e805f5-2404-4445-a4f7-4551ce0f0fbe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:35.228491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00e805f5-2404-4445-a4f7-4551ce0f0fbe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:35.229146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00e805f5-2404-4445-a4f7-4551ce0f0fbe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:35.231916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00e805f5-2404-4445-a4f7-4551ce0f0fbe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:35.232946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00e805f5-2404-4445-a4f7-4551ce0f0fbe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:35.683484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-00e805f5-2404-4445-a4f7-4551ce0f0fbe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:35.691124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:35.718825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-00e805f5-2404-4445-a4f7-4551ce0f0fbe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.513546 Jul 25 19:28:35.720257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 215/406] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:35 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:36.087403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b35bc751-5688-4b1a-b9fc-9c84c3781907 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:36.088591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b35bc751-5688-4b1a-b9fc-9c84c3781907 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:36.121022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b35bc751-5688-4b1a-b9fc-9c84c3781907 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:36.131701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b35bc751-5688-4b1a-b9fc-9c84c3781907 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:36.132642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b35bc751-5688-4b1a-b9fc-9c84c3781907 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:36.133097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b35bc751-5688-4b1a-b9fc-9c84c3781907 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:36.371493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b35bc751-5688-4b1a-b9fc-9c84c3781907 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:36.385269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b35bc751-5688-4b1a-b9fc-9c84c3781907 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:36.387851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b35bc751-5688-4b1a-b9fc-9c84c3781907 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:36.389385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b35bc751-5688-4b1a-b9fc-9c84c3781907 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1722 microversion: 2.20 time: 0.309664 Jul 25 19:28:36.390309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 192/407] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:36.758417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dd074200-f4a1-49d0-838d-baca9304f3fd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:36.759410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dd074200-f4a1-49d0-838d-baca9304f3fd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:36.767978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd074200-f4a1-49d0-838d-baca9304f3fd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:36.768484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd074200-f4a1-49d0-838d-baca9304f3fd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:36.770064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd074200-f4a1-49d0-838d-baca9304f3fd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:36.770547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd074200-f4a1-49d0-838d-baca9304f3fd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:36.943000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd074200-f4a1-49d0-838d-baca9304f3fd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:36.951639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dd074200-f4a1-49d0-838d-baca9304f3fd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.198173 Jul 25 19:28:36.952285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 216/408] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:36 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:37.420654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3c798006-e4ac-4644-8479-c01136c9c6b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:37.421502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3c798006-e4ac-4644-8479-c01136c9c6b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:37.431756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c798006-e4ac-4644-8479-c01136c9c6b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:37.432882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c798006-e4ac-4644-8479-c01136c9c6b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:37.434286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c798006-e4ac-4644-8479-c01136c9c6b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:37.435182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c798006-e4ac-4644-8479-c01136c9c6b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:37.662817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3c798006-e4ac-4644-8479-c01136c9c6b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:37.673244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3c798006-e4ac-4644-8479-c01136c9c6b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:37.674902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3c798006-e4ac-4644-8479-c01136c9c6b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:37.677279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3c798006-e4ac-4644-8479-c01136c9c6b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1722 microversion: 2.20 time: 0.261304 Jul 25 19:28:37.677974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 193/409] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:37.986447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2d71ea86-a8e2-4ce4-b9bd-e14989c54aca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:37.987446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2d71ea86-a8e2-4ce4-b9bd-e14989c54aca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:37.998918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d71ea86-a8e2-4ce4-b9bd-e14989c54aca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:37.999717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d71ea86-a8e2-4ce4-b9bd-e14989c54aca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:38.000709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d71ea86-a8e2-4ce4-b9bd-e14989c54aca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:38.001263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d71ea86-a8e2-4ce4-b9bd-e14989c54aca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:38.199622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2d71ea86-a8e2-4ce4-b9bd-e14989c54aca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:38.211094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2d71ea86-a8e2-4ce4-b9bd-e14989c54aca tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.229777 Jul 25 19:28:38.211885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 217/410] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:37 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:38.690113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-fb0694a5-dbd1-4a4b-a0b7-13088cd230bd req-da81c479-05e8-41e3-9331-4e8b8cdcdee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1007369a-dd3c-4837-95f4-e8326d600031", "name": "network-vif-unplugged", "status": "completed", "tag": "33faefb9-12a5-4e86-b189-357d316c5553"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:38.708237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-fb0694a5-dbd1-4a4b-a0b7-13088cd230bd req-da81c479-05e8-41e3-9331-4e8b8cdcdee2 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:38.709670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-fb0694a5-dbd1-4a4b-a0b7-13088cd230bd req-da81c479-05e8-41e3-9331-4e8b8cdcdee2 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:38.726793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-fb0694a5-dbd1-4a4b-a0b7-13088cd230bd req-da81c479-05e8-41e3-9331-4e8b8cdcdee2 service nova] Creating event network-vif-unplugged:33faefb9-12a5-4e86-b189-357d316c5553 for instance 1007369a-dd3c-4837-95f4-e8326d600031 on hv-cinder-85093 Jul 25 19:28:38.736220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-fb0694a5-dbd1-4a4b-a0b7-13088cd230bd req-da81c479-05e8-41e3-9331-4e8b8cdcdee2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051846 Jul 25 19:28:38.738852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 194/411] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:28:38.740532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ab6dce26-929c-49c7-bd8a-d3643c95285c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:38.744693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ab6dce26-929c-49c7-bd8a-d3643c95285c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:38.758615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab6dce26-929c-49c7-bd8a-d3643c95285c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:38.759867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab6dce26-929c-49c7-bd8a-d3643c95285c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:38.762231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab6dce26-929c-49c7-bd8a-d3643c95285c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:38.763340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab6dce26-929c-49c7-bd8a-d3643c95285c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:39.240743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b3df9892-0581-4657-81a3-bf8af03c0e95 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:39.242187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b3df9892-0581-4657-81a3-bf8af03c0e95 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:39.254748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3df9892-0581-4657-81a3-bf8af03c0e95 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:39.255695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3df9892-0581-4657-81a3-bf8af03c0e95 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:39.257158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3df9892-0581-4657-81a3-bf8af03c0e95 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:39.257952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3df9892-0581-4657-81a3-bf8af03c0e95 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:39.510985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ab6dce26-929c-49c7-bd8a-d3643c95285c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:39.525075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ab6dce26-929c-49c7-bd8a-d3643c95285c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:39.528285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ab6dce26-929c-49c7-bd8a-d3643c95285c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:39.530518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ab6dce26-929c-49c7-bd8a-d3643c95285c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1722 microversion: 2.20 time: 0.820254 Jul 25 19:28:39.531589 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 218/412] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:38 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1722 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:39.682305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b3df9892-0581-4657-81a3-bf8af03c0e95 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:39.699136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b3df9892-0581-4657-81a3-bf8af03c0e95 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.466897 Jul 25 19:28:39.704109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 195/413] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:39 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:40.328969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-92a725aa-555a-49d4-bb09-66b0c7c8f6cf req-370f9d65-1e7e-422d-be4c-065a0dd7d958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2db0a6-d453-4feb-b067-466e50a5f44b", "tag": "4aa6797e-a79e-4609-b7d0-c3826276bcc6"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:40.350022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-92a725aa-555a-49d4-bb09-66b0c7c8f6cf req-370f9d65-1e7e-422d-be4c-065a0dd7d958 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:40.350788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-92a725aa-555a-49d4-bb09-66b0c7c8f6cf req-370f9d65-1e7e-422d-be4c-065a0dd7d958 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:40.389772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-92a725aa-555a-49d4-bb09-66b0c7c8f6cf req-370f9d65-1e7e-422d-be4c-065a0dd7d958 service nova] Creating event network-changed:4aa6797e-a79e-4609-b7d0-c3826276bcc6 for instance 6d2db0a6-d453-4feb-b067-466e50a5f44b on hv-cinder-85093 Jul 25 19:28:40.396641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-92a725aa-555a-49d4-bb09-66b0c7c8f6cf req-370f9d65-1e7e-422d-be4c-065a0dd7d958 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071818 Jul 25 19:28:40.397260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 219/414] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:28:40.575967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f3e8c760-92cf-4bc6-b7c8-36cf55569b5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:40.576538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f3e8c760-92cf-4bc6-b7c8-36cf55569b5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:40.598923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3e8c760-92cf-4bc6-b7c8-36cf55569b5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:40.599784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3e8c760-92cf-4bc6-b7c8-36cf55569b5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:40.601278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3e8c760-92cf-4bc6-b7c8-36cf55569b5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:40.602111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3e8c760-92cf-4bc6-b7c8-36cf55569b5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:40.745084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7ee3c1a7-cea8-4e39-be76-fcee216f80f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:40.747058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7ee3c1a7-cea8-4e39-be76-fcee216f80f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:40.759189 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ee3c1a7-cea8-4e39-be76-fcee216f80f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:40.760056 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ee3c1a7-cea8-4e39-be76-fcee216f80f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:40.762128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ee3c1a7-cea8-4e39-be76-fcee216f80f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:40.762369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ee3c1a7-cea8-4e39-be76-fcee216f80f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:40.864475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3e8c760-92cf-4bc6-b7c8-36cf55569b5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:40.881272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3e8c760-92cf-4bc6-b7c8-36cf55569b5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:40.885852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3e8c760-92cf-4bc6-b7c8-36cf55569b5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:40.888988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f3e8c760-92cf-4bc6-b7c8-36cf55569b5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1722 microversion: 2.20 time: 0.319176 Jul 25 19:28:40.897346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 196/415] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:28:41.018680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7ee3c1a7-cea8-4e39-be76-fcee216f80f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:41.033121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7ee3c1a7-cea8-4e39-be76-fcee216f80f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.296212 Jul 25 19:28:41.034125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 220/416] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:40 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:41.938597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-907151b8-2f00-4056-a1a0-4db817562a05 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:41.939499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-907151b8-2f00-4056-a1a0-4db817562a05 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:41.953734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-907151b8-2f00-4056-a1a0-4db817562a05 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:41.954251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-907151b8-2f00-4056-a1a0-4db817562a05 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:41.955313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-907151b8-2f00-4056-a1a0-4db817562a05 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:41.955896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-907151b8-2f00-4056-a1a0-4db817562a05 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:42.069101 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6b65e7a3-49a7-44ad-aafa-1fe5d944dbb6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:42.069900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6b65e7a3-49a7-44ad-aafa-1fe5d944dbb6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:42.073601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:42.080865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b65e7a3-49a7-44ad-aafa-1fe5d944dbb6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:42.081364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b65e7a3-49a7-44ad-aafa-1fe5d944dbb6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:42.082766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b65e7a3-49a7-44ad-aafa-1fe5d944dbb6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:42.083135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b65e7a3-49a7-44ad-aafa-1fe5d944dbb6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:42.250073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-907151b8-2f00-4056-a1a0-4db817562a05 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:42.280348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-907151b8-2f00-4056-a1a0-4db817562a05 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:42.282053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-907151b8-2f00-4056-a1a0-4db817562a05 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:42.283474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-907151b8-2f00-4056-a1a0-4db817562a05 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1722 microversion: 2.20 time: 0.352090 Jul 25 19:28:42.284114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 197/417] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:42.395257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6b65e7a3-49a7-44ad-aafa-1fe5d944dbb6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:42.413093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6b65e7a3-49a7-44ad-aafa-1fe5d944dbb6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.349310 Jul 25 19:28:42.414203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 221/418] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:42 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:43.263622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bf9cdd17-3bdb-4a5f-bd6f-e7f7026ee09f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:43.264197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bf9cdd17-3bdb-4a5f-bd6f-e7f7026ee09f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:43.274013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf9cdd17-3bdb-4a5f-bd6f-e7f7026ee09f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:43.274563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf9cdd17-3bdb-4a5f-bd6f-e7f7026ee09f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:43.275718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf9cdd17-3bdb-4a5f-bd6f-e7f7026ee09f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:43.276180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf9cdd17-3bdb-4a5f-bd6f-e7f7026ee09f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:43.319471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd3fdea2-d96a-4d22-b9be-e4196c7989b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:43.320595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd3fdea2-d96a-4d22-b9be-e4196c7989b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:43.324130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:43.337588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd3fdea2-d96a-4d22-b9be-e4196c7989b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:43.339153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd3fdea2-d96a-4d22-b9be-e4196c7989b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:43.341782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd3fdea2-d96a-4d22-b9be-e4196c7989b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:43.342047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd3fdea2-d96a-4d22-b9be-e4196c7989b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:43.491669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-bf9cdd17-3bdb-4a5f-bd6f-e7f7026ee09f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lazy-loading 'services' on Instance uuid 2f2586b4-247f-4532-9c19-9a01f3732354 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:28:43.630680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd3fdea2-d96a-4d22-b9be-e4196c7989b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:43.652130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd3fdea2-d96a-4d22-b9be-e4196c7989b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:43.656845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd3fdea2-d96a-4d22-b9be-e4196c7989b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:43.662055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd3fdea2-d96a-4d22-b9be-e4196c7989b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1722 microversion: 2.20 time: 0.345181 Jul 25 19:28:43.668615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 222/419] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:28:43.681341 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb701b91-53da-4afb-a763-9205192d66a5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:43.683237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb701b91-53da-4afb-a763-9205192d66a5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:43.715400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb701b91-53da-4afb-a763-9205192d66a5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:43.718231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb701b91-53da-4afb-a763-9205192d66a5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:43.719824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb701b91-53da-4afb-a763-9205192d66a5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:43.720561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb701b91-53da-4afb-a763-9205192d66a5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:43.788017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bf9cdd17-3bdb-4a5f-bd6f-e7f7026ee09f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354/os-volume_attachments/eff0ae7b-cde4-4c8d-b0dc-7d01c64fea5c" status: 202 len: 0 microversion: 2.1 time: 0.523793 Jul 25 19:28:43.790722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 198/420] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 19:28:43 2022] DELETE /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354/os-volume_attachments/eff0ae7b-cde4-4c8d-b0dc-7d01c64fea5c => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 19:28:44.134408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb701b91-53da-4afb-a763-9205192d66a5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:44.149506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb701b91-53da-4afb-a763-9205192d66a5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.478222 Jul 25 19:28:44.150380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 223/421] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:43 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:44.717754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-794a99e2-8e84-4917-b2ea-75e28eb39087 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:44.718915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-794a99e2-8e84-4917-b2ea-75e28eb39087 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:44.729130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-794a99e2-8e84-4917-b2ea-75e28eb39087 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:44.729900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-794a99e2-8e84-4917-b2ea-75e28eb39087 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:44.731345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-794a99e2-8e84-4917-b2ea-75e28eb39087 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:44.732046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-794a99e2-8e84-4917-b2ea-75e28eb39087 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:44.980348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-794a99e2-8e84-4917-b2ea-75e28eb39087 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:44.997908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-794a99e2-8e84-4917-b2ea-75e28eb39087 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:45.001313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-794a99e2-8e84-4917-b2ea-75e28eb39087 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:45.003714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-794a99e2-8e84-4917-b2ea-75e28eb39087 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1725 microversion: 2.20 time: 0.292460 Jul 25 19:28:45.004810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 199/422] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:28:45.039159 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-27f19de8-55a5-4230-8ce1-af7256625472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceb03705-2541-4b1a-9f7a-a2a9a3ab13fc"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:45.041967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-27f19de8-55a5-4230-8ce1-af7256625472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:45.049520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27f19de8-55a5-4230-8ce1-af7256625472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:45.049971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27f19de8-55a5-4230-8ce1-af7256625472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:45.051474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27f19de8-55a5-4230-8ce1-af7256625472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:45.052162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27f19de8-55a5-4230-8ce1-af7256625472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:45.183690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-073fe660-3f71-4040-9365-3b6f6621bc61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:45.185426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-073fe660-3f71-4040-9365-3b6f6621bc61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:45.198752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-073fe660-3f71-4040-9365-3b6f6621bc61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:45.203316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-073fe660-3f71-4040-9365-3b6f6621bc61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:45.204774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-073fe660-3f71-4040-9365-3b6f6621bc61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:45.205738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-073fe660-3f71-4040-9365-3b6f6621bc61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:45.570712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-073fe660-3f71-4040-9365-3b6f6621bc61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:45.590715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-073fe660-3f71-4040-9365-3b6f6621bc61 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.416509 Jul 25 19:28:45.605042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 200/423] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:45 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:45.700733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-27f19de8-55a5-4230-8ce1-af7256625472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "POST /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.663951 Jul 25 19:28:45.700733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 224/424] 10.222.0.18 () {62 vars in 1364 bytes} [Mon Jul 25 19:28:45 2022] POST /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 188 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:28:45.914411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f06c50ff-d4c9-431b-8c8d-d185468afdc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:45.915278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f06c50ff-d4c9-431b-8c8d-d185468afdc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:45.923094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f06c50ff-d4c9-431b-8c8d-d185468afdc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:45.923697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f06c50ff-d4c9-431b-8c8d-d185468afdc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:45.924647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f06c50ff-d4c9-431b-8c8d-d185468afdc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:45.925686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f06c50ff-d4c9-431b-8c8d-d185468afdc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:46.170058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f06c50ff-d4c9-431b-8c8d-d185468afdc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "POST /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/action" status: 202 len: 0 microversion: 2.20 time: 0.261072 Jul 25 19:28:46.171265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 201/425] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Jul 25 19:28:45 2022] POST /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:28:46.187789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1c99debd-4e83-4e4c-8b39-11c53ef4ad0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:46.189449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1c99debd-4e83-4e4c-8b39-11c53ef4ad0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:46.403830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c99debd-4e83-4e4c-8b39-11c53ef4ad0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:46.404524 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c99debd-4e83-4e4c-8b39-11c53ef4ad0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:46.405792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c99debd-4e83-4e4c-8b39-11c53ef4ad0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:46.406748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c99debd-4e83-4e4c-8b39-11c53ef4ad0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:46.654758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b5c4a9da-3ad0-4b63-930d-761ee5583b10 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:46.655764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b5c4a9da-3ad0-4b63-930d-761ee5583b10 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:46.669673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b5c4a9da-3ad0-4b63-930d-761ee5583b10 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:46.671077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b5c4a9da-3ad0-4b63-930d-761ee5583b10 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:46.672974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b5c4a9da-3ad0-4b63-930d-761ee5583b10 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:46.674247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b5c4a9da-3ad0-4b63-930d-761ee5583b10 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:46.754791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1c99debd-4e83-4e4c-8b39-11c53ef4ad0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:46.773823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1c99debd-4e83-4e4c-8b39-11c53ef4ad0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:46.777280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1c99debd-4e83-4e4c-8b39-11c53ef4ad0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:46.779704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1c99debd-4e83-4e4c-8b39-11c53ef4ad0b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1751 microversion: 2.20 time: 0.598297 Jul 25 19:28:46.781007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 225/426] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1751 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:46.934022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b5c4a9da-3ad0-4b63-930d-761ee5583b10 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:46.944703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b5c4a9da-3ad0-4b63-930d-761ee5583b10 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.303488 Jul 25 19:28:46.945340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 202/427] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:46 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:47.312704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0bb514e6-b5fc-4344-ab44-141cf60a2619 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:47.313290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0bb514e6-b5fc-4344-ab44-141cf60a2619 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:47.321177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bb514e6-b5fc-4344-ab44-141cf60a2619 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:47.321703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bb514e6-b5fc-4344-ab44-141cf60a2619 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:47.322567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bb514e6-b5fc-4344-ab44-141cf60a2619 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:47.323002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bb514e6-b5fc-4344-ab44-141cf60a2619 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:47.354457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0bb514e6-b5fc-4344-ab44-141cf60a2619 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:28:47.492629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0bb514e6-b5fc-4344-ab44-141cf60a2619 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 204 len: 0 microversion: 2.1 time: 0.183779 Jul 25 19:28:47.493743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 226/428] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:28:47 2022] DELETE /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:28:47.508881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6e6096d4-853a-43b5-b926-683a4f8ffe04 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:47.509388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6e6096d4-853a-43b5-b926-683a4f8ffe04 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:47.517411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e6096d4-853a-43b5-b926-683a4f8ffe04 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:47.517906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e6096d4-853a-43b5-b926-683a4f8ffe04 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:47.519284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e6096d4-853a-43b5-b926-683a4f8ffe04 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:47.520148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e6096d4-853a-43b5-b926-683a4f8ffe04 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:47.806476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6e6096d4-853a-43b5-b926-683a4f8ffe04 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:47.822336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6e6096d4-853a-43b5-b926-683a4f8ffe04 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1513 microversion: 2.1 time: 0.320653 Jul 25 19:28:47.824011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 203/429] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:47 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1513 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:47.824806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-26e29d46-982b-445a-adc3-fdb7bf357d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:47.825977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-26e29d46-982b-445a-adc3-fdb7bf357d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:47.834569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26e29d46-982b-445a-adc3-fdb7bf357d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:47.835018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26e29d46-982b-445a-adc3-fdb7bf357d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:47.836751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26e29d46-982b-445a-adc3-fdb7bf357d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:47.837196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26e29d46-982b-445a-adc3-fdb7bf357d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:47.973354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2a28321f-d260-43e5-b1ae-ed7e88d43d9b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:47.974819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2a28321f-d260-43e5-b1ae-ed7e88d43d9b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:47.985323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2a28321f-d260-43e5-b1ae-ed7e88d43d9b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:47.985323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2a28321f-d260-43e5-b1ae-ed7e88d43d9b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:47.985807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2a28321f-d260-43e5-b1ae-ed7e88d43d9b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:47.986119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2a28321f-d260-43e5-b1ae-ed7e88d43d9b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:48.140338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26e29d46-982b-445a-adc3-fdb7bf357d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:48.161612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26e29d46-982b-445a-adc3-fdb7bf357d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:48.162813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26e29d46-982b-445a-adc3-fdb7bf357d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:48.168348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-26e29d46-982b-445a-adc3-fdb7bf357d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1751 microversion: 2.20 time: 0.345589 Jul 25 19:28:48.168348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 227/430] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1751 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:28:48.218624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2a28321f-d260-43e5-b1ae-ed7e88d43d9b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:48.240116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2a28321f-d260-43e5-b1ae-ed7e88d43d9b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.271925 Jul 25 19:28:48.241166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 204/431] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:47 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:48.866169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6754b01a-23c7-425f-a154-d741a51e91cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:48.867372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6754b01a-23c7-425f-a154-d741a51e91cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:48.879760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6754b01a-23c7-425f-a154-d741a51e91cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:48.880616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6754b01a-23c7-425f-a154-d741a51e91cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:48.882953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6754b01a-23c7-425f-a154-d741a51e91cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:48.883958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6754b01a-23c7-425f-a154-d741a51e91cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:49.067911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6754b01a-23c7-425f-a154-d741a51e91cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:49.070831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:49.081324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6754b01a-23c7-425f-a154-d741a51e91cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1513 microversion: 2.1 time: 0.220625 Jul 25 19:28:49.082077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 228/432] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:48 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:49.192088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4f22b6ee-cf5d-478a-8017-f5ce8aff9972 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:49.192870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4f22b6ee-cf5d-478a-8017-f5ce8aff9972 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:49.201296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f22b6ee-cf5d-478a-8017-f5ce8aff9972 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:49.201802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f22b6ee-cf5d-478a-8017-f5ce8aff9972 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:49.202693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f22b6ee-cf5d-478a-8017-f5ce8aff9972 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:49.203427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f22b6ee-cf5d-478a-8017-f5ce8aff9972 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:49.275384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ddbc24f-56e1-46c4-ace9-08c8edcf895a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:49.276334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ddbc24f-56e1-46c4-ace9-08c8edcf895a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:49.287070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ddbc24f-56e1-46c4-ace9-08c8edcf895a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:49.287951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ddbc24f-56e1-46c4-ace9-08c8edcf895a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:49.289232 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ddbc24f-56e1-46c4-ace9-08c8edcf895a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:49.289939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ddbc24f-56e1-46c4-ace9-08c8edcf895a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:49.429878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f22b6ee-cf5d-478a-8017-f5ce8aff9972 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:49.440073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f22b6ee-cf5d-478a-8017-f5ce8aff9972 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:49.442892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f22b6ee-cf5d-478a-8017-f5ce8aff9972 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:49.447501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4f22b6ee-cf5d-478a-8017-f5ce8aff9972 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1751 microversion: 2.20 time: 0.258962 Jul 25 19:28:49.448263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 205/433] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1751 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:49.543617 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0ddbc24f-56e1-46c4-ace9-08c8edcf895a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:49.559613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ddbc24f-56e1-46c4-ace9-08c8edcf895a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.281933 Jul 25 19:28:49.559613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 229/434] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:49 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:50.118813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6f3130c2-4128-43d9-94b2-c9add4070d49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:50.119716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6f3130c2-4128-43d9-94b2-c9add4070d49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:50.126731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f3130c2-4128-43d9-94b2-c9add4070d49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:50.127168 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f3130c2-4128-43d9-94b2-c9add4070d49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:50.129314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f3130c2-4128-43d9-94b2-c9add4070d49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:50.130247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f3130c2-4128-43d9-94b2-c9add4070d49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:50.158046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:50.366795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6f3130c2-4128-43d9-94b2-c9add4070d49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:50.383405 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6f3130c2-4128-43d9-94b2-c9add4070d49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1513 microversion: 2.1 time: 0.270004 Jul 25 19:28:50.384411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 206/435] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:50 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:50.480918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ba8ea798-ac2b-4ac6-bd23-849f53231c90 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:50.482027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ba8ea798-ac2b-4ac6-bd23-849f53231c90 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:50.491635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba8ea798-ac2b-4ac6-bd23-849f53231c90 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:50.492136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba8ea798-ac2b-4ac6-bd23-849f53231c90 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:50.493045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba8ea798-ac2b-4ac6-bd23-849f53231c90 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:50.493481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba8ea798-ac2b-4ac6-bd23-849f53231c90 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:50.585842 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-da4b4aa6-c59e-47d8-9fa0-dc7ab54e802a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:50.586984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-da4b4aa6-c59e-47d8-9fa0-dc7ab54e802a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:50.620060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da4b4aa6-c59e-47d8-9fa0-dc7ab54e802a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:50.620855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da4b4aa6-c59e-47d8-9fa0-dc7ab54e802a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:50.622835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da4b4aa6-c59e-47d8-9fa0-dc7ab54e802a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:50.623448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da4b4aa6-c59e-47d8-9fa0-dc7ab54e802a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:50.765937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba8ea798-ac2b-4ac6-bd23-849f53231c90 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:50.786104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba8ea798-ac2b-4ac6-bd23-849f53231c90 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:50.789813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba8ea798-ac2b-4ac6-bd23-849f53231c90 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:50.792574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ba8ea798-ac2b-4ac6-bd23-849f53231c90 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1751 microversion: 2.20 time: 0.315964 Jul 25 19:28:50.793659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 230/436] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1751 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:28:50.891698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da4b4aa6-c59e-47d8-9fa0-dc7ab54e802a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:50.902095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-da4b4aa6-c59e-47d8-9fa0-dc7ab54e802a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.324376 Jul 25 19:28:50.903139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 207/437] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:50 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:51.420473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f7872f6-63a4-4bc0-8b0d-d897466499d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:51.421130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9f7872f6-63a4-4bc0-8b0d-d897466499d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:51.429141 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f7872f6-63a4-4bc0-8b0d-d897466499d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:51.429449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f7872f6-63a4-4bc0-8b0d-d897466499d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:51.430341 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f7872f6-63a4-4bc0-8b0d-d897466499d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:51.430707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f7872f6-63a4-4bc0-8b0d-d897466499d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:51.649099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9f7872f6-63a4-4bc0-8b0d-d897466499d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:51.661652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9f7872f6-63a4-4bc0-8b0d-d897466499d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1513 microversion: 2.1 time: 0.245798 Jul 25 19:28:51.662863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 231/438] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:51 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:51.824472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6830d86b-c4d8-4768-bcab-a37108a1eb4e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:51.825252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6830d86b-c4d8-4768-bcab-a37108a1eb4e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:51.835478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6830d86b-c4d8-4768-bcab-a37108a1eb4e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:51.836341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6830d86b-c4d8-4768-bcab-a37108a1eb4e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:51.837800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6830d86b-c4d8-4768-bcab-a37108a1eb4e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:51.838605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6830d86b-c4d8-4768-bcab-a37108a1eb4e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:51.939971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-256b1b78-245e-42dc-b439-4b3590b0546b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:51.941921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-256b1b78-245e-42dc-b439-4b3590b0546b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:51.950765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-256b1b78-245e-42dc-b439-4b3590b0546b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:51.951685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-256b1b78-245e-42dc-b439-4b3590b0546b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:51.952696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-256b1b78-245e-42dc-b439-4b3590b0546b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:51.954995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-256b1b78-245e-42dc-b439-4b3590b0546b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:52.078843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6830d86b-c4d8-4768-bcab-a37108a1eb4e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:52.089428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6830d86b-c4d8-4768-bcab-a37108a1eb4e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:52.091824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6830d86b-c4d8-4768-bcab-a37108a1eb4e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:52.093045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6830d86b-c4d8-4768-bcab-a37108a1eb4e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1753 microversion: 2.20 time: 0.273006 Jul 25 19:28:52.093696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 208/439] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1753 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:52.141149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-256b1b78-245e-42dc-b439-4b3590b0546b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:52.150816 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-256b1b78-245e-42dc-b439-4b3590b0546b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.216343 Jul 25 19:28:52.151467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 232/440] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:51 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:52.701119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-48bc1b5e-ff0a-47b1-bce9-3db777f0b321 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:52.701913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-48bc1b5e-ff0a-47b1-bce9-3db777f0b321 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:52.711367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48bc1b5e-ff0a-47b1-bce9-3db777f0b321 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:52.711873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48bc1b5e-ff0a-47b1-bce9-3db777f0b321 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:52.712674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48bc1b5e-ff0a-47b1-bce9-3db777f0b321 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:52.713166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48bc1b5e-ff0a-47b1-bce9-3db777f0b321 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:52.819463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-48bc1b5e-ff0a-47b1-bce9-3db777f0b321 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:52.829358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-48bc1b5e-ff0a-47b1-bce9-3db777f0b321 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1471 microversion: 2.1 time: 0.133426 Jul 25 19:28:52.830482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 209/441] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:52 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1471 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:52.852986 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-4268f31f-8b42-48a9-928b-ae09e1495081 req-914df4e8-4c54-4b11-8807-91f0a6a8e6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2586b4-247f-4532-9c19-9a01f3732354", "name": "network-vif-deleted", "tag": "e5b3607f-3afc-4de1-8b22-93fd905a7c49"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:52.867682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-4268f31f-8b42-48a9-928b-ae09e1495081 req-914df4e8-4c54-4b11-8807-91f0a6a8e6bf service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:52.868417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-4268f31f-8b42-48a9-928b-ae09e1495081 req-914df4e8-4c54-4b11-8807-91f0a6a8e6bf service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:52.883411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-4268f31f-8b42-48a9-928b-ae09e1495081 req-914df4e8-4c54-4b11-8807-91f0a6a8e6bf service nova] Creating event network-vif-deleted:e5b3607f-3afc-4de1-8b22-93fd905a7c49 for instance 2f2586b4-247f-4532-9c19-9a01f3732354 on hv-cinder-85093 Jul 25 19:28:52.888641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-4268f31f-8b42-48a9-928b-ae09e1495081 req-914df4e8-4c54-4b11-8807-91f0a6a8e6bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040912 Jul 25 19:28:52.889259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 233/442] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:28:53.119890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e7d778fe-2634-499b-987e-a27266468bbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:53.120567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e7d778fe-2634-499b-987e-a27266468bbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:53.129113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7d778fe-2634-499b-987e-a27266468bbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:53.130350 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7d778fe-2634-499b-987e-a27266468bbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:53.131135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7d778fe-2634-499b-987e-a27266468bbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:53.131577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7d778fe-2634-499b-987e-a27266468bbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:53.187236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6696b021-33f7-4b4d-954a-6a99fc323c76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:53.188607 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6696b021-33f7-4b4d-954a-6a99fc323c76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:53.205718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6696b021-33f7-4b4d-954a-6a99fc323c76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:53.206629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6696b021-33f7-4b4d-954a-6a99fc323c76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:53.211835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6696b021-33f7-4b4d-954a-6a99fc323c76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:53.214666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6696b021-33f7-4b4d-954a-6a99fc323c76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:53.404620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e7d778fe-2634-499b-987e-a27266468bbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:53.417935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e7d778fe-2634-499b-987e-a27266468bbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:53.419967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e7d778fe-2634-499b-987e-a27266468bbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:53.421232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e7d778fe-2634-499b-987e-a27266468bbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1753 microversion: 2.20 time: 0.305898 Jul 25 19:28:53.422354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 210/443] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1753 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:53.442810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6696b021-33f7-4b4d-954a-6a99fc323c76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:53.460060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6696b021-33f7-4b4d-954a-6a99fc323c76 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.279315 Jul 25 19:28:53.472007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 234/444] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:53 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:53.529483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-0677d363-bbd4-4ccb-903e-041157c725dd req-5d2b623e-6673-4d28-8a72-5878d27258ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2db0a6-d453-4feb-b067-466e50a5f44b", "name": "network-vif-plugged", "status": "completed", "tag": "4aa6797e-a79e-4609-b7d0-c3826276bcc6"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:53.546992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-0677d363-bbd4-4ccb-903e-041157c725dd req-5d2b623e-6673-4d28-8a72-5878d27258ce service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:53.547925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-0677d363-bbd4-4ccb-903e-041157c725dd req-5d2b623e-6673-4d28-8a72-5878d27258ce service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:53.572502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-0677d363-bbd4-4ccb-903e-041157c725dd req-5d2b623e-6673-4d28-8a72-5878d27258ce service nova] Creating event network-vif-plugged:4aa6797e-a79e-4609-b7d0-c3826276bcc6 for instance 6d2db0a6-d453-4feb-b067-466e50a5f44b on hv-cinder-85093 Jul 25 19:28:53.582014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-0677d363-bbd4-4ccb-903e-041157c725dd req-5d2b623e-6673-4d28-8a72-5878d27258ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057135 Jul 25 19:28:53.583847 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 211/445] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:28:53.860207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:53.861034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:53.873776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:53.874554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:53.876177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:53.876991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:53.925964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:53.926794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:53.927572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lazy-loading 'fault' on Instance uuid 2f2586b4-247f-4532-9c19-9a01f3732354 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:28:53.990835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:54.002791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7898e606-80f0-4323-8e6c-bf81491cc520 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 200 len: 1308 microversion: 2.1 time: 0.150292 Jul 25 19:28:54.003452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 235/446] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:53 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 1308 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:54.454516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9a0deb4f-b045-4b6a-a046-525e9a4785af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:54.455227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9a0deb4f-b045-4b6a-a046-525e9a4785af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:54.463635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a0deb4f-b045-4b6a-a046-525e9a4785af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:54.464102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a0deb4f-b045-4b6a-a046-525e9a4785af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:54.465181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a0deb4f-b045-4b6a-a046-525e9a4785af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:54.465628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a0deb4f-b045-4b6a-a046-525e9a4785af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:54.490594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-421a9845-d32b-4d94-92c9-82f2c7b0557b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:54.491770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-421a9845-d32b-4d94-92c9-82f2c7b0557b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:54.503997 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-421a9845-d32b-4d94-92c9-82f2c7b0557b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:54.505793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-421a9845-d32b-4d94-92c9-82f2c7b0557b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:54.507259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-421a9845-d32b-4d94-92c9-82f2c7b0557b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:54.508281 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-421a9845-d32b-4d94-92c9-82f2c7b0557b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:54.695174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9a0deb4f-b045-4b6a-a046-525e9a4785af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:54.710942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9a0deb4f-b045-4b6a-a046-525e9a4785af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:54.714000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9a0deb4f-b045-4b6a-a046-525e9a4785af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:54.716371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9a0deb4f-b045-4b6a-a046-525e9a4785af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.269147 Jul 25 19:28:54.717331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 212/447] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:54.735855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-421a9845-d32b-4d94-92c9-82f2c7b0557b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:54.749675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-421a9845-d32b-4d94-92c9-82f2c7b0557b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.267390 Jul 25 19:28:54.751074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 236/448] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:54 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:55.026772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ccf87317-c656-413d-a295-a2667524428b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:55.027369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ccf87317-c656-413d-a295-a2667524428b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: 2f2586b4-247f-4532-9c19-9a01f3732354] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:55.034016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf87317-c656-413d-a295-a2667524428b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:55.034464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf87317-c656-413d-a295-a2667524428b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:55.035328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf87317-c656-413d-a295-a2667524428b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:55.035807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf87317-c656-413d-a295-a2667524428b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:55.052784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-ccf87317-c656-413d-a295-a2667524428b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] HTTP exception thrown: Instance 2f2586b4-247f-4532-9c19-9a01f3732354 could not be found. Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ccf87317-c656-413d-a295-a2667524428b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Request method failure captured: Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 HTTP/1.1 Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u6T5C8He6CStrqmlyDl-YP4QcYi_cXPhJz0ErQMWUPS7hCSJSFY9Xp2dBtodhQd2YBTHGfKJxGlXeJS6IBLiM7lcKMx0z-ZlYjVJhQL6o6V0Y3ivXn35tPel-t7PaYn45tlD_1Z_FUt9RfSTUzPcCAAtuyfA_vbAGRgre8t11bdSyc Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 19:28:55.055267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_43cfdd0ba7de4e46a17d4c0d698159cf", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 324738dd872e445ba845a101f45fa595 Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 2f2586b4-247f-4532-9c19-9a01f3732354 could not be found. Jul 25 19:28:55.057853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '2f2586b4-247f-4532-9c19-9a01f3732354'} Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f2586b4-247f-4532-9c19-9a01f3732354 could not be found. Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:28:55.059178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f2586b4-247f-4532-9c19-9a01f3732354 could not be found. Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f2586b4-247f-4532-9c19-9a01f3732354 could not be found. Jul 25 19:28:55.060846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:28:55.062898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ccf87317-c656-413d-a295-a2667524428b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Returning 404 to user: Instance 2f2586b4-247f-4532-9c19-9a01f3732354 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:28:55.062898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ccf87317-c656-413d-a295-a2667524428b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354" status: 404 len: 111 microversion: 2.1 time: 0.034999 Jul 25 19:28:55.062898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 213/449] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:55 2022] GET /compute/v2.1/servers/2f2586b4-247f-4532-9c19-9a01f3732354 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:28:55.760260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-749288d6-fdc5-49f4-b60a-a5f403cd9131 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:55.761127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-749288d6-fdc5-49f4-b60a-a5f403cd9131 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:55.771108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-749288d6-fdc5-49f4-b60a-a5f403cd9131 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:55.771728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-749288d6-fdc5-49f4-b60a-a5f403cd9131 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:55.772549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-749288d6-fdc5-49f4-b60a-a5f403cd9131 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:55.772992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-749288d6-fdc5-49f4-b60a-a5f403cd9131 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:55.783295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b0e9e4f7-8c39-462d-bb22-cbe4c0f475e4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:55.783295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b0e9e4f7-8c39-462d-bb22-cbe4c0f475e4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:55.795393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b0e9e4f7-8c39-462d-bb22-cbe4c0f475e4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:55.796499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b0e9e4f7-8c39-462d-bb22-cbe4c0f475e4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:55.798009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b0e9e4f7-8c39-462d-bb22-cbe4c0f475e4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:55.798806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b0e9e4f7-8c39-462d-bb22-cbe4c0f475e4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:56.084630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-749288d6-fdc5-49f4-b60a-a5f403cd9131 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:56.096583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b0e9e4f7-8c39-462d-bb22-cbe4c0f475e4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:56.100876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-749288d6-fdc5-49f4-b60a-a5f403cd9131 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:56.102758 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-749288d6-fdc5-49f4-b60a-a5f403cd9131 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:56.104129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-749288d6-fdc5-49f4-b60a-a5f403cd9131 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.349474 Jul 25 19:28:56.104850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 237/450] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:56.109943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b0e9e4f7-8c39-462d-bb22-cbe4c0f475e4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.339064 Jul 25 19:28:56.110530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 214/451] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:55 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:57.135956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b8facdc-76fe-46ee-a710-b90286fc333d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:57.136614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b8facdc-76fe-46ee-a710-b90286fc333d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:57.147263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8facdc-76fe-46ee-a710-b90286fc333d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:57.147579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df88d49d-61b1-454b-8dc4-201911eba496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:57.148185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8facdc-76fe-46ee-a710-b90286fc333d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:57.148346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df88d49d-61b1-454b-8dc4-201911eba496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:57.148835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8facdc-76fe-46ee-a710-b90286fc333d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:57.149533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8facdc-76fe-46ee-a710-b90286fc333d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:57.155333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df88d49d-61b1-454b-8dc4-201911eba496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:57.155818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df88d49d-61b1-454b-8dc4-201911eba496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:57.156624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df88d49d-61b1-454b-8dc4-201911eba496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:57.157049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df88d49d-61b1-454b-8dc4-201911eba496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:57.407192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b8facdc-76fe-46ee-a710-b90286fc333d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:57.408119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df88d49d-61b1-454b-8dc4-201911eba496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:57.418939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df88d49d-61b1-454b-8dc4-201911eba496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:57.420559 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df88d49d-61b1-454b-8dc4-201911eba496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:57.421861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df88d49d-61b1-454b-8dc4-201911eba496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.279173 Jul 25 19:28:57.422443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 215/452] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:57.423145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b8facdc-76fe-46ee-a710-b90286fc333d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.291363 Jul 25 19:28:57.424141 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 238/453] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:57 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:28:58.449469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-786d82bd-99e8-4b1d-b4fc-9c052b380e0f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:58.450844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-786d82bd-99e8-4b1d-b4fc-9c052b380e0f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:58.455534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-334eb93f-cab0-4a26-95ca-4261d57018b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:58.457339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-334eb93f-cab0-4a26-95ca-4261d57018b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:58.465021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-786d82bd-99e8-4b1d-b4fc-9c052b380e0f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:58.466075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-786d82bd-99e8-4b1d-b4fc-9c052b380e0f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:58.467481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-786d82bd-99e8-4b1d-b4fc-9c052b380e0f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:58.468138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-334eb93f-cab0-4a26-95ca-4261d57018b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:58.468331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-786d82bd-99e8-4b1d-b4fc-9c052b380e0f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:58.468767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-334eb93f-cab0-4a26-95ca-4261d57018b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:58.470018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-334eb93f-cab0-4a26-95ca-4261d57018b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:58.470598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-334eb93f-cab0-4a26-95ca-4261d57018b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:58.844663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-334eb93f-cab0-4a26-95ca-4261d57018b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:58.853364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-786d82bd-99e8-4b1d-b4fc-9c052b380e0f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:58.856097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-334eb93f-cab0-4a26-95ca-4261d57018b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:58.862242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-334eb93f-cab0-4a26-95ca-4261d57018b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:58.862242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-334eb93f-cab0-4a26-95ca-4261d57018b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.412645 Jul 25 19:28:58.862242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 239/454] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:28:58.870587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-786d82bd-99e8-4b1d-b4fc-9c052b380e0f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.426214 Jul 25 19:28:58.883556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 216/455] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:58 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:59.896911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3490f494-6979-4fa2-b337-936f470e819e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:59.897902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3490f494-6979-4fa2-b337-936f470e819e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:59.904785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3490f494-6979-4fa2-b337-936f470e819e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:59.905236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3490f494-6979-4fa2-b337-936f470e819e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:59.906046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3490f494-6979-4fa2-b337-936f470e819e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:59.906492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3490f494-6979-4fa2-b337-936f470e819e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:59.909374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fc4fc415-7731-4662-830b-5a00ad697e73 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:59.910520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fc4fc415-7731-4662-830b-5a00ad697e73 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:59.923194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc4fc415-7731-4662-830b-5a00ad697e73 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:59.924007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc4fc415-7731-4662-830b-5a00ad697e73 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:59.925450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc4fc415-7731-4662-830b-5a00ad697e73 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:59.926823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc4fc415-7731-4662-830b-5a00ad697e73 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:00.183549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3490f494-6979-4fa2-b337-936f470e819e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:00.195067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3490f494-6979-4fa2-b337-936f470e819e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:00.196745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3490f494-6979-4fa2-b337-936f470e819e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:00.197972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3490f494-6979-4fa2-b337-936f470e819e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.305552 Jul 25 19:29:00.198554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 240/456] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:28:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:00.198778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fc4fc415-7731-4662-830b-5a00ad697e73 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:00.208544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fc4fc415-7731-4662-830b-5a00ad697e73 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.303545 Jul 25 19:29:00.209319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 217/457] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:59 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:01.240168 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-19a59d6a-b2f7-4edc-89f9-c65a7798a0a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:01.242570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-19a59d6a-b2f7-4edc-89f9-c65a7798a0a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:01.247034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7ba25ac3-e40c-4fb2-91dc-c3f6d70fd10c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:01.249199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7ba25ac3-e40c-4fb2-91dc-c3f6d70fd10c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:01.256499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=62 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:01.256823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19a59d6a-b2f7-4edc-89f9-c65a7798a0a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:01.257995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19a59d6a-b2f7-4edc-89f9-c65a7798a0a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:01.259272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19a59d6a-b2f7-4edc-89f9-c65a7798a0a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:01.260459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19a59d6a-b2f7-4edc-89f9-c65a7798a0a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:01.273359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ba25ac3-e40c-4fb2-91dc-c3f6d70fd10c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:01.273984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ba25ac3-e40c-4fb2-91dc-c3f6d70fd10c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:01.274947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ba25ac3-e40c-4fb2-91dc-c3f6d70fd10c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:01.275476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ba25ac3-e40c-4fb2-91dc-c3f6d70fd10c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:01.708949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-19a59d6a-b2f7-4edc-89f9-c65a7798a0a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:01.727123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7ba25ac3-e40c-4fb2-91dc-c3f6d70fd10c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:01.730571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-19a59d6a-b2f7-4edc-89f9-c65a7798a0a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:01.734126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-19a59d6a-b2f7-4edc-89f9-c65a7798a0a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:01.736461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-19a59d6a-b2f7-4edc-89f9-c65a7798a0a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.504186 Jul 25 19:29:01.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 241/458] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:01 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:01.739331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7ba25ac3-e40c-4fb2-91dc-c3f6d70fd10c tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1370 microversion: 2.1 time: 0.499890 Jul 25 19:29:01.740562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 218/459] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:01 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1370 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:02.772539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3724fbed-6b98-45e5-8576-9b9f9d177189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:02.773394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3724fbed-6b98-45e5-8576-9b9f9d177189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:02.780219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8486479c-f07e-4eab-9652-ea0fec55b239 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:02.780954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3724fbed-6b98-45e5-8576-9b9f9d177189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:02.781152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3724fbed-6b98-45e5-8576-9b9f9d177189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:02.781935 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3724fbed-6b98-45e5-8576-9b9f9d177189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:02.782368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3724fbed-6b98-45e5-8576-9b9f9d177189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:02.782534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8486479c-f07e-4eab-9652-ea0fec55b239 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:02.792714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8486479c-f07e-4eab-9652-ea0fec55b239 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:02.793461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8486479c-f07e-4eab-9652-ea0fec55b239 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:02.794712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8486479c-f07e-4eab-9652-ea0fec55b239 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:02.795797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8486479c-f07e-4eab-9652-ea0fec55b239 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:03.357712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3724fbed-6b98-45e5-8576-9b9f9d177189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:03.371772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3724fbed-6b98-45e5-8576-9b9f9d177189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:03.374400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3724fbed-6b98-45e5-8576-9b9f9d177189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:03.375913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3724fbed-6b98-45e5-8576-9b9f9d177189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.609665 Jul 25 19:29:03.376774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 242/460] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:03.388172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8486479c-f07e-4eab-9652-ea0fec55b239 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:03.405681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8486479c-f07e-4eab-9652-ea0fec55b239 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1564 microversion: 2.1 time: 0.630162 Jul 25 19:29:03.419685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 219/461] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:02 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1564 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:03.435253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e4160f37-fbd3-4efc-b57c-a341e0b4bd78 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:03.436055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e4160f37-fbd3-4efc-b57c-a341e0b4bd78 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:03.447089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e4160f37-fbd3-4efc-b57c-a341e0b4bd78 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:03.447829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e4160f37-fbd3-4efc-b57c-a341e0b4bd78 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:03.448844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e4160f37-fbd3-4efc-b57c-a341e0b4bd78 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:03.449416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e4160f37-fbd3-4efc-b57c-a341e0b4bd78 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:03.670010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e4160f37-fbd3-4efc-b57c-a341e0b4bd78 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.239536 Jul 25 19:29:03.670925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 243/462] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Jul 25 19:29:03 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:04.419664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bf9dddc3-714c-4187-964e-d6d24a410112 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:04.423154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bf9dddc3-714c-4187-964e-d6d24a410112 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:04.432120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf9dddc3-714c-4187-964e-d6d24a410112 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:04.432856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf9dddc3-714c-4187-964e-d6d24a410112 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:04.433937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf9dddc3-714c-4187-964e-d6d24a410112 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:04.434567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf9dddc3-714c-4187-964e-d6d24a410112 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:04.643424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bf9dddc3-714c-4187-964e-d6d24a410112 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:04.659129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bf9dddc3-714c-4187-964e-d6d24a410112 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:04.663378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bf9dddc3-714c-4187-964e-d6d24a410112 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:04.665764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bf9dddc3-714c-4187-964e-d6d24a410112 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.250961 Jul 25 19:29:04.666755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 220/463] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:05.589860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-cd98bb1e-d47a-4c20-90ea-18d437501974 req-addd0c84-bf79-4998-8a45-7fb784eded07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2db0a6-d453-4feb-b067-466e50a5f44b", "tag": "4aa6797e-a79e-4609-b7d0-c3826276bcc6"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:05.614260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-cd98bb1e-d47a-4c20-90ea-18d437501974 req-addd0c84-bf79-4998-8a45-7fb784eded07 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:05.615729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-cd98bb1e-d47a-4c20-90ea-18d437501974 req-addd0c84-bf79-4998-8a45-7fb784eded07 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:05.641411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-cd98bb1e-d47a-4c20-90ea-18d437501974 req-addd0c84-bf79-4998-8a45-7fb784eded07 service nova] Creating event network-changed:4aa6797e-a79e-4609-b7d0-c3826276bcc6 for instance 6d2db0a6-d453-4feb-b067-466e50a5f44b on hv-cinder-85093 Jul 25 19:29:05.652351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-cd98bb1e-d47a-4c20-90ea-18d437501974 req-addd0c84-bf79-4998-8a45-7fb784eded07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072478 Jul 25 19:29:05.653686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 244/464] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:05.696494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bccdd3a0-cc52-42af-b3d5-70df32dda9c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:05.697387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bccdd3a0-cc52-42af-b3d5-70df32dda9c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:05.704805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bccdd3a0-cc52-42af-b3d5-70df32dda9c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:05.705254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bccdd3a0-cc52-42af-b3d5-70df32dda9c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:05.706395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bccdd3a0-cc52-42af-b3d5-70df32dda9c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:05.707541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bccdd3a0-cc52-42af-b3d5-70df32dda9c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:05.948796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bccdd3a0-cc52-42af-b3d5-70df32dda9c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:05.968911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bccdd3a0-cc52-42af-b3d5-70df32dda9c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:05.972966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bccdd3a0-cc52-42af-b3d5-70df32dda9c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:05.976424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bccdd3a0-cc52-42af-b3d5-70df32dda9c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.284593 Jul 25 19:29:05.977530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 221/465] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:07.009711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2cc58b81-05df-419a-a71a-71340b782b96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:07.010849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2cc58b81-05df-419a-a71a-71340b782b96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:07.021512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cc58b81-05df-419a-a71a-71340b782b96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:07.022292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cc58b81-05df-419a-a71a-71340b782b96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:07.023964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cc58b81-05df-419a-a71a-71340b782b96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:07.024655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cc58b81-05df-419a-a71a-71340b782b96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:07.253472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2cc58b81-05df-419a-a71a-71340b782b96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:07.270433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2cc58b81-05df-419a-a71a-71340b782b96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:07.274104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2cc58b81-05df-419a-a71a-71340b782b96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:07.276374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2cc58b81-05df-419a-a71a-71340b782b96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.273111 Jul 25 19:29:07.277401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 245/466] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:08.319885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bdf55856-5445-46d0-90e5-6b338b41be34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:08.321281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bdf55856-5445-46d0-90e5-6b338b41be34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:08.330765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bdf55856-5445-46d0-90e5-6b338b41be34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:08.331643 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bdf55856-5445-46d0-90e5-6b338b41be34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:08.333303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bdf55856-5445-46d0-90e5-6b338b41be34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:08.333863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bdf55856-5445-46d0-90e5-6b338b41be34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:08.735474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bdf55856-5445-46d0-90e5-6b338b41be34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:08.761209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bdf55856-5445-46d0-90e5-6b338b41be34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:08.764456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bdf55856-5445-46d0-90e5-6b338b41be34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:08.766627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bdf55856-5445-46d0-90e5-6b338b41be34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.452899 Jul 25 19:29:08.767691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 222/467] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:08.887567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-5900950", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "networks": [{"uuid": "b42ccee9-c8ef-49d3-8102-8319595ff383"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:08.984224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] validate_networks() for [('b42ccee9-c8ef-49d3-8102-8319595ff383', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:29:09.603131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:29:09.603721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:29:09.604423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:29:09.605087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:29:09.605716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:29:09.620797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:09.621446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:09.623197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:09.624047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:09.663445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Getting quotas for project 43cfdd0ba7de4e46a17d4c0d698159cf. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:29:09.670412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Getting quotas for user 324738dd872e445ba845a101f45fa595 and project 43cfdd0ba7de4e46a17d4c0d698159cf. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:29:09.694406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:29:09.696814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:29:09.798157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c60f611f-794b-4b87-9165-fd1033a08913 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916960 Jul 25 19:29:09.799600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 246/468] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:29:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:29:09.809451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5d1348ad-590e-4281-8700-033a46b2b70f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:09.811481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5d1348ad-590e-4281-8700-033a46b2b70f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:09.819362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-68bcf616-5716-443b-998e-5b490dd6941d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:09.820632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-68bcf616-5716-443b-998e-5b490dd6941d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:09.820775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d1348ad-590e-4281-8700-033a46b2b70f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:09.821349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d1348ad-590e-4281-8700-033a46b2b70f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:09.822239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d1348ad-590e-4281-8700-033a46b2b70f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:09.822753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d1348ad-590e-4281-8700-033a46b2b70f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:09.958890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-68bcf616-5716-443b-998e-5b490dd6941d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:09.976090 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-68bcf616-5716-443b-998e-5b490dd6941d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1216 microversion: 2.1 time: 0.163631 Jul 25 19:29:09.976990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 247/469] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:09 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:10.056520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-908256776", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1963016785", "security_groups": [{"name": "tempest-secgroup-smoke-2042671642"}], "networks": [{"uuid": "f2157abc-31f6-4ca6-b4a0-6e3b885ef7a6"}], "block_device_mapping_v2": [{"uuid": "547a6cbb-af45-4778-85a6-a4a1fc36213d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:10.221418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5d1348ad-590e-4281-8700-033a46b2b70f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:10.240392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5d1348ad-590e-4281-8700-033a46b2b70f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:10.243706 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5d1348ad-590e-4281-8700-033a46b2b70f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:10.245991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5d1348ad-590e-4281-8700-033a46b2b70f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.442351 Jul 25 19:29:10.247335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 223/470] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:10.348682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] validate_networks() for [('f2157abc-31f6-4ca6-b4a0-6e3b885ef7a6', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:29:11.012729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-26e7ea4d-3819-4c52-b317-6c77d4281c46 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:11.013848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-26e7ea4d-3819-4c52-b317-6c77d4281c46 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:11.031794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26e7ea4d-3819-4c52-b317-6c77d4281c46 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:11.032952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26e7ea4d-3819-4c52-b317-6c77d4281c46 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:11.034580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26e7ea4d-3819-4c52-b317-6c77d4281c46 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:11.036300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26e7ea4d-3819-4c52-b317-6c77d4281c46 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:11.077055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:11.091818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:29:11.092963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:29:11.093239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:29:11.093927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:29:11.094604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:29:11.111089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:11.111089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:11.111089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:11.111089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:11.132086 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Getting quotas for project 9166cf61c5d944fd9f1e2174c6544faa. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:29:11.137666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Getting quotas for user 574d0113dce74ab199c0162abe26934b and project 9166cf61c5d944fd9f1e2174c6544faa. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:29:11.162863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-26e7ea4d-3819-4c52-b317-6c77d4281c46 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:11.178541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-26e7ea4d-3819-4c52-b317-6c77d4281c46 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.174978 Jul 25 19:29:11.190546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 224/471] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:11 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:11.237157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:29:11.240420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='547a6cbb-af45-4778-85a6-a4a1fc36213d',volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:29:11.291921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1b6427ab-4d87-4460-a5bd-55eb86079392 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:11.292632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1b6427ab-4d87-4460-a5bd-55eb86079392 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:11.305050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b6427ab-4d87-4460-a5bd-55eb86079392 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:11.305667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b6427ab-4d87-4460-a5bd-55eb86079392 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:11.307119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b6427ab-4d87-4460-a5bd-55eb86079392 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:11.307848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b6427ab-4d87-4460-a5bd-55eb86079392 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:11.522536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fda647d1-38b8-495c-8414-75db755d09a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.473608 Jul 25 19:29:11.527575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 248/472] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:29:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:29:11.541739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6ac8a5c3-7923-423d-8840-bd86f87e80d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:11.542280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ac8a5c3-7923-423d-8840-bd86f87e80d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:11.581897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1b6427ab-4d87-4460-a5bd-55eb86079392 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:11.610819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1b6427ab-4d87-4460-a5bd-55eb86079392 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:11.614246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1b6427ab-4d87-4460-a5bd-55eb86079392 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:11.616829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1b6427ab-4d87-4460-a5bd-55eb86079392 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.328978 Jul 25 19:29:11.617841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 225/473] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:11.684564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6ac8a5c3-7923-423d-8840-bd86f87e80d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:11.699479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6ac8a5c3-7923-423d-8840-bd86f87e80d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1088 microversion: 2.1 time: 0.165154 Jul 25 19:29:11.700378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 249/474] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:11 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1088 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:12.220748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7fe2029e-fa1a-4a74-b0c3-1018c02427ca tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:12.221886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7fe2029e-fa1a-4a74-b0c3-1018c02427ca tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:12.235702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe2029e-fa1a-4a74-b0c3-1018c02427ca tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:12.236511 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe2029e-fa1a-4a74-b0c3-1018c02427ca tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:12.238053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe2029e-fa1a-4a74-b0c3-1018c02427ca tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:12.239346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe2029e-fa1a-4a74-b0c3-1018c02427ca tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:12.326656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7fe2029e-fa1a-4a74-b0c3-1018c02427ca tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:12.338798 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7fe2029e-fa1a-4a74-b0c3-1018c02427ca tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.125829 Jul 25 19:29:12.339746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 226/475] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:12 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:12.652284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-92b9c879-fb5f-440e-a6fc-d20f633fb6ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:12.656088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-92b9c879-fb5f-440e-a6fc-d20f633fb6ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:12.669439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92b9c879-fb5f-440e-a6fc-d20f633fb6ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:12.670234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92b9c879-fb5f-440e-a6fc-d20f633fb6ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:12.671804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92b9c879-fb5f-440e-a6fc-d20f633fb6ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:12.672598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92b9c879-fb5f-440e-a6fc-d20f633fb6ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:12.682926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:12.808256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-76211e82-4366-492b-9d1a-85dd53eafa57 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:12.808880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-76211e82-4366-492b-9d1a-85dd53eafa57 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:12.815744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76211e82-4366-492b-9d1a-85dd53eafa57 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:12.816783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76211e82-4366-492b-9d1a-85dd53eafa57 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:12.817602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76211e82-4366-492b-9d1a-85dd53eafa57 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:12.818055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76211e82-4366-492b-9d1a-85dd53eafa57 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:12.901567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-92b9c879-fb5f-440e-a6fc-d20f633fb6ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:12.921445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-92b9c879-fb5f-440e-a6fc-d20f633fb6ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:12.927040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-92b9c879-fb5f-440e-a6fc-d20f633fb6ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:12.930613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-92b9c879-fb5f-440e-a6fc-d20f633fb6ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.286746 Jul 25 19:29:12.932257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 250/476] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:12.946832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-76211e82-4366-492b-9d1a-85dd53eafa57 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:12.968356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-76211e82-4366-492b-9d1a-85dd53eafa57 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.163609 Jul 25 19:29:12.969135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 227/477] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:12 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:13.376894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4a0e942d-c668-4f00-a5b0-08b18bf27867 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:13.377521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4a0e942d-c668-4f00-a5b0-08b18bf27867 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:13.380749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:13.389210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a0e942d-c668-4f00-a5b0-08b18bf27867 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:13.389706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a0e942d-c668-4f00-a5b0-08b18bf27867 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:13.390607 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a0e942d-c668-4f00-a5b0-08b18bf27867 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:13.391069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a0e942d-c668-4f00-a5b0-08b18bf27867 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:13.469433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4a0e942d-c668-4f00-a5b0-08b18bf27867 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:13.481959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4a0e942d-c668-4f00-a5b0-08b18bf27867 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.108495 Jul 25 19:29:13.482894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 251/478] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:13 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:13.981594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f259fed9-997c-41c2-a70d-14236e624438 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:13.982656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f259fed9-997c-41c2-a70d-14236e624438 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:13.995462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f259fed9-997c-41c2-a70d-14236e624438 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:13.996275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6229453a-a553-4e6c-851c-a4108778c84a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:13.996819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f259fed9-997c-41c2-a70d-14236e624438 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:13.997242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6229453a-a553-4e6c-851c-a4108778c84a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:13.997664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f259fed9-997c-41c2-a70d-14236e624438 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:13.998443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f259fed9-997c-41c2-a70d-14236e624438 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:14.007755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6229453a-a553-4e6c-851c-a4108778c84a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:14.008270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6229453a-a553-4e6c-851c-a4108778c84a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:14.009590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6229453a-a553-4e6c-851c-a4108778c84a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:14.010272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6229453a-a553-4e6c-851c-a4108778c84a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:14.142794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6229453a-a553-4e6c-851c-a4108778c84a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:14.152685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6229453a-a553-4e6c-851c-a4108778c84a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.162416 Jul 25 19:29:14.153458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 252/479] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:13 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:14.281288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f259fed9-997c-41c2-a70d-14236e624438 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:14.292111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f259fed9-997c-41c2-a70d-14236e624438 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:14.293683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f259fed9-997c-41c2-a70d-14236e624438 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:14.294910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f259fed9-997c-41c2-a70d-14236e624438 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.321234 Jul 25 19:29:14.295501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 228/480] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:14.511421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5f1636ab-c0ee-4b26-b054-fdf71578a406 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:14.512660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5f1636ab-c0ee-4b26-b054-fdf71578a406 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:14.525390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f1636ab-c0ee-4b26-b054-fdf71578a406 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:14.526039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f1636ab-c0ee-4b26-b054-fdf71578a406 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:14.527367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f1636ab-c0ee-4b26-b054-fdf71578a406 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:14.528133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f1636ab-c0ee-4b26-b054-fdf71578a406 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:14.649203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5f1636ab-c0ee-4b26-b054-fdf71578a406 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:14.659439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5f1636ab-c0ee-4b26-b054-fdf71578a406 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.155750 Jul 25 19:29:14.661140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 253/481] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:14 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:15.187198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4cdceda3-8caa-4bcc-a190-01c50e6ef26d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:15.189349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4cdceda3-8caa-4bcc-a190-01c50e6ef26d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:15.201765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cdceda3-8caa-4bcc-a190-01c50e6ef26d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:15.202838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cdceda3-8caa-4bcc-a190-01c50e6ef26d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:15.204433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cdceda3-8caa-4bcc-a190-01c50e6ef26d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:15.205413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cdceda3-8caa-4bcc-a190-01c50e6ef26d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:15.289926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4cdceda3-8caa-4bcc-a190-01c50e6ef26d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:15.304437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4cdceda3-8caa-4bcc-a190-01c50e6ef26d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.129335 Jul 25 19:29:15.305477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 229/482] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:15 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:15.325695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0d5d64dc-4b5a-48d8-afad-5d3978d4a937 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:15.326829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0d5d64dc-4b5a-48d8-afad-5d3978d4a937 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:15.338874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d5d64dc-4b5a-48d8-afad-5d3978d4a937 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:15.339746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d5d64dc-4b5a-48d8-afad-5d3978d4a937 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:15.341595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d5d64dc-4b5a-48d8-afad-5d3978d4a937 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:15.342369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d5d64dc-4b5a-48d8-afad-5d3978d4a937 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:15.596531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0d5d64dc-4b5a-48d8-afad-5d3978d4a937 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:15.607763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0d5d64dc-4b5a-48d8-afad-5d3978d4a937 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:15.609367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0d5d64dc-4b5a-48d8-afad-5d3978d4a937 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:15.610585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0d5d64dc-4b5a-48d8-afad-5d3978d4a937 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.292549 Jul 25 19:29:15.611275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 254/483] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:15.687108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-004781a2-7291-4193-a475-3d812360b014 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:15.690067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-004781a2-7291-4193-a475-3d812360b014 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:15.704323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-004781a2-7291-4193-a475-3d812360b014 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:15.705675 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-004781a2-7291-4193-a475-3d812360b014 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:15.708696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-004781a2-7291-4193-a475-3d812360b014 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:15.710536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-004781a2-7291-4193-a475-3d812360b014 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:15.820108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-004781a2-7291-4193-a475-3d812360b014 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:15.835064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-004781a2-7291-4193-a475-3d812360b014 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.155612 Jul 25 19:29:15.836306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 230/484] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:15 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:16.333979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b29b9430-5dff-4754-98a4-86a7c3d6d5c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:16.334898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b29b9430-5dff-4754-98a4-86a7c3d6d5c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:16.345523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29b9430-5dff-4754-98a4-86a7c3d6d5c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:16.346229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29b9430-5dff-4754-98a4-86a7c3d6d5c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:16.347558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29b9430-5dff-4754-98a4-86a7c3d6d5c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:16.348314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29b9430-5dff-4754-98a4-86a7c3d6d5c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:16.464886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b29b9430-5dff-4754-98a4-86a7c3d6d5c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:16.482146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b29b9430-5dff-4754-98a4-86a7c3d6d5c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.153846 Jul 25 19:29:16.483154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 255/485] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:16 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:16.636651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-53098e8b-d368-4da7-bdf0-44998640f27e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:16.637515 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-53098e8b-d368-4da7-bdf0-44998640f27e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:16.645110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53098e8b-d368-4da7-bdf0-44998640f27e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:16.645819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53098e8b-d368-4da7-bdf0-44998640f27e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:16.646697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53098e8b-d368-4da7-bdf0-44998640f27e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:16.647202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53098e8b-d368-4da7-bdf0-44998640f27e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:16.866685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-53098e8b-d368-4da7-bdf0-44998640f27e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:16.869458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6735b0ac-db26-44dd-8f6e-1d5026d9ce05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:16.870936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6735b0ac-db26-44dd-8f6e-1d5026d9ce05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:16.882727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6735b0ac-db26-44dd-8f6e-1d5026d9ce05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:16.884247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6735b0ac-db26-44dd-8f6e-1d5026d9ce05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:16.884957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-53098e8b-d368-4da7-bdf0-44998640f27e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:16.885591 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6735b0ac-db26-44dd-8f6e-1d5026d9ce05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:16.886374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6735b0ac-db26-44dd-8f6e-1d5026d9ce05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:16.887884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-53098e8b-d368-4da7-bdf0-44998640f27e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:16.889957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-53098e8b-d368-4da7-bdf0-44998640f27e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.257214 Jul 25 19:29:16.890900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 231/486] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:17.002705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6735b0ac-db26-44dd-8f6e-1d5026d9ce05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:17.020892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6735b0ac-db26-44dd-8f6e-1d5026d9ce05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.157761 Jul 25 19:29:17.022567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 256/487] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:16 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:17.519322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-03a07d81-889c-4deb-ae9d-5eb898de13ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:17.520690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-03a07d81-889c-4deb-ae9d-5eb898de13ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:17.528051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03a07d81-889c-4deb-ae9d-5eb898de13ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:17.528518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03a07d81-889c-4deb-ae9d-5eb898de13ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:17.529322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03a07d81-889c-4deb-ae9d-5eb898de13ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:17.529761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03a07d81-889c-4deb-ae9d-5eb898de13ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:17.614904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-03a07d81-889c-4deb-ae9d-5eb898de13ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:17.631046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-03a07d81-889c-4deb-ae9d-5eb898de13ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.115832 Jul 25 19:29:17.635259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 232/488] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:17 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:17.929817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5bfb1c9f-ca3c-4a84-a5c2-2738de1fa334 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:17.930800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5bfb1c9f-ca3c-4a84-a5c2-2738de1fa334 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:17.939185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bfb1c9f-ca3c-4a84-a5c2-2738de1fa334 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:17.939723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bfb1c9f-ca3c-4a84-a5c2-2738de1fa334 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:17.940641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bfb1c9f-ca3c-4a84-a5c2-2738de1fa334 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:17.941124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bfb1c9f-ca3c-4a84-a5c2-2738de1fa334 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:18.052088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-76e2ef61-1b99-43c3-a011-ad831ec4ba1c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:18.053389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-76e2ef61-1b99-43c3-a011-ad831ec4ba1c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:18.064783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e2ef61-1b99-43c3-a011-ad831ec4ba1c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:18.065602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e2ef61-1b99-43c3-a011-ad831ec4ba1c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:18.067667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e2ef61-1b99-43c3-a011-ad831ec4ba1c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:18.068454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e2ef61-1b99-43c3-a011-ad831ec4ba1c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:18.205509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-76e2ef61-1b99-43c3-a011-ad831ec4ba1c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:18.218324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5bfb1c9f-ca3c-4a84-a5c2-2738de1fa334 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:18.218835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-76e2ef61-1b99-43c3-a011-ad831ec4ba1c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.174430 Jul 25 19:29:18.219542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 233/489] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:18 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:18.230365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5bfb1c9f-ca3c-4a84-a5c2-2738de1fa334 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:18.232555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5bfb1c9f-ca3c-4a84-a5c2-2738de1fa334 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:18.234863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5bfb1c9f-ca3c-4a84-a5c2-2738de1fa334 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.309396 Jul 25 19:29:18.235687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 257/490] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:18.664730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1e764ab8-a2aa-4b21-9e40-001e5d55ff90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:18.665426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1e764ab8-a2aa-4b21-9e40-001e5d55ff90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:18.674333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e764ab8-a2aa-4b21-9e40-001e5d55ff90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:18.674925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e764ab8-a2aa-4b21-9e40-001e5d55ff90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:18.676773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e764ab8-a2aa-4b21-9e40-001e5d55ff90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:18.677346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e764ab8-a2aa-4b21-9e40-001e5d55ff90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:18.790252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1e764ab8-a2aa-4b21-9e40-001e5d55ff90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:18.798922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1e764ab8-a2aa-4b21-9e40-001e5d55ff90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.138891 Jul 25 19:29:18.799754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 234/491] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:18 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:19.248425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b6db0992-4942-4190-b48e-89fd790a5ad3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:19.250962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b6db0992-4942-4190-b48e-89fd790a5ad3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:19.270192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6db0992-4942-4190-b48e-89fd790a5ad3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:19.271447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6db0992-4942-4190-b48e-89fd790a5ad3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:19.273370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6db0992-4942-4190-b48e-89fd790a5ad3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:19.277311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-141ceac3-f8a9-4c88-bb62-df73baea65c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:19.279467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-141ceac3-f8a9-4c88-bb62-df73baea65c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:19.280664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6db0992-4942-4190-b48e-89fd790a5ad3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:19.297783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-141ceac3-f8a9-4c88-bb62-df73baea65c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:19.298906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-141ceac3-f8a9-4c88-bb62-df73baea65c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:19.301105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-141ceac3-f8a9-4c88-bb62-df73baea65c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:19.302442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-141ceac3-f8a9-4c88-bb62-df73baea65c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:19.419203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b6db0992-4942-4190-b48e-89fd790a5ad3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:19.432249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b6db0992-4942-4190-b48e-89fd790a5ad3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.191189 Jul 25 19:29:19.433066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 258/492] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:19 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:19.571941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-141ceac3-f8a9-4c88-bb62-df73baea65c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:19.587606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-141ceac3-f8a9-4c88-bb62-df73baea65c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:19.590688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-141ceac3-f8a9-4c88-bb62-df73baea65c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:19.593191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-141ceac3-f8a9-4c88-bb62-df73baea65c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.333468 Jul 25 19:29:19.594221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 235/493] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:19.822421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4c69f6f-2040-40c6-9ee3-7033f715189d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:19.823117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f4c69f6f-2040-40c6-9ee3-7033f715189d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:19.830041 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4c69f6f-2040-40c6-9ee3-7033f715189d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:19.830547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4c69f6f-2040-40c6-9ee3-7033f715189d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:19.831376 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4c69f6f-2040-40c6-9ee3-7033f715189d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:19.832033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4c69f6f-2040-40c6-9ee3-7033f715189d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:19.945432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4c69f6f-2040-40c6-9ee3-7033f715189d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:19.957384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4c69f6f-2040-40c6-9ee3-7033f715189d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.137704 Jul 25 19:29:19.958558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 259/494] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:19 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:20.460816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b8b70e3d-47fe-46f0-83b0-43cc97cce727 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:20.461672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b8b70e3d-47fe-46f0-83b0-43cc97cce727 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:20.473862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8b70e3d-47fe-46f0-83b0-43cc97cce727 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:20.474604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8b70e3d-47fe-46f0-83b0-43cc97cce727 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:20.475951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8b70e3d-47fe-46f0-83b0-43cc97cce727 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:20.476640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8b70e3d-47fe-46f0-83b0-43cc97cce727 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:20.556791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b8b70e3d-47fe-46f0-83b0-43cc97cce727 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:20.566907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b8b70e3d-47fe-46f0-83b0-43cc97cce727 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.113240 Jul 25 19:29:20.567728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 236/495] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:20 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:20.633893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dcfa2605-8900-4853-9455-f27176f007ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:20.639034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dcfa2605-8900-4853-9455-f27176f007ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:20.649702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcfa2605-8900-4853-9455-f27176f007ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:20.650265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcfa2605-8900-4853-9455-f27176f007ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:20.651183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcfa2605-8900-4853-9455-f27176f007ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:20.651766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcfa2605-8900-4853-9455-f27176f007ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:20.852129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dcfa2605-8900-4853-9455-f27176f007ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:20.866595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dcfa2605-8900-4853-9455-f27176f007ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:20.868498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dcfa2605-8900-4853-9455-f27176f007ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:20.870288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dcfa2605-8900-4853-9455-f27176f007ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.250457 Jul 25 19:29:20.871245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 260/496] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:20.984670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ad74d146-d08b-46dc-9bb0-dcebd95ff1c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:20.985792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ad74d146-d08b-46dc-9bb0-dcebd95ff1c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:20.997920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad74d146-d08b-46dc-9bb0-dcebd95ff1c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:20.998508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad74d146-d08b-46dc-9bb0-dcebd95ff1c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:20.999489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad74d146-d08b-46dc-9bb0-dcebd95ff1c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:21.000067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad74d146-d08b-46dc-9bb0-dcebd95ff1c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:21.100548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ad74d146-d08b-46dc-9bb0-dcebd95ff1c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:21.109375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ad74d146-d08b-46dc-9bb0-dcebd95ff1c9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.131820 Jul 25 19:29:21.109963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 237/497] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:20 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:21.607308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1bc4f03f-44ae-4a5c-8286-8afbfa3e2e03 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:21.608409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1bc4f03f-44ae-4a5c-8286-8afbfa3e2e03 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:21.614026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:21.623335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bc4f03f-44ae-4a5c-8286-8afbfa3e2e03 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:21.624061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bc4f03f-44ae-4a5c-8286-8afbfa3e2e03 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:21.625472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bc4f03f-44ae-4a5c-8286-8afbfa3e2e03 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:21.626248 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bc4f03f-44ae-4a5c-8286-8afbfa3e2e03 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:21.692165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=16 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:21.729552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1bc4f03f-44ae-4a5c-8286-8afbfa3e2e03 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:21.737884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1bc4f03f-44ae-4a5c-8286-8afbfa3e2e03 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.137917 Jul 25 19:29:21.740125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 261/498] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:21 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:21.903914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-adb5b800-3031-4715-9049-c6fc78329991 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:21.903914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-adb5b800-3031-4715-9049-c6fc78329991 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:21.912547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adb5b800-3031-4715-9049-c6fc78329991 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:21.912991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adb5b800-3031-4715-9049-c6fc78329991 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:21.913863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adb5b800-3031-4715-9049-c6fc78329991 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:21.914236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adb5b800-3031-4715-9049-c6fc78329991 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:22.118896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-adb5b800-3031-4715-9049-c6fc78329991 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:22.130073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-adb5b800-3031-4715-9049-c6fc78329991 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:22.131882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-adb5b800-3031-4715-9049-c6fc78329991 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:22.133221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-adb5b800-3031-4715-9049-c6fc78329991 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.240777 Jul 25 19:29:22.133866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 238/499] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:22.145237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-67651195-be74-4784-8ec6-d2b15d855160 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:22.146186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-67651195-be74-4784-8ec6-d2b15d855160 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:22.153437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67651195-be74-4784-8ec6-d2b15d855160 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:22.154174 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67651195-be74-4784-8ec6-d2b15d855160 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:22.155208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67651195-be74-4784-8ec6-d2b15d855160 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:22.155832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67651195-be74-4784-8ec6-d2b15d855160 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:22.294177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-67651195-be74-4784-8ec6-d2b15d855160 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:22.306013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-67651195-be74-4784-8ec6-d2b15d855160 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.165821 Jul 25 19:29:22.306924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 262/500] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:22 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:22.776266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-07445921-57a6-4e36-a03d-1cd292971d86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:22.777353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-07445921-57a6-4e36-a03d-1cd292971d86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:22.787699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07445921-57a6-4e36-a03d-1cd292971d86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:22.788445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07445921-57a6-4e36-a03d-1cd292971d86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:22.789756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07445921-57a6-4e36-a03d-1cd292971d86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:22.790344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07445921-57a6-4e36-a03d-1cd292971d86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:22.868210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-07445921-57a6-4e36-a03d-1cd292971d86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:22.877880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-07445921-57a6-4e36-a03d-1cd292971d86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.108104 Jul 25 19:29:22.879880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 239/501] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:22 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:23.178904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5bbf8cb-25a5-4ad7-96da-fe4ed25c4468 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:23.181309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d5bbf8cb-25a5-4ad7-96da-fe4ed25c4468 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:23.195163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5bbf8cb-25a5-4ad7-96da-fe4ed25c4468 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:23.196493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5bbf8cb-25a5-4ad7-96da-fe4ed25c4468 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:23.198786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5bbf8cb-25a5-4ad7-96da-fe4ed25c4468 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:23.200260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5bbf8cb-25a5-4ad7-96da-fe4ed25c4468 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:23.336441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fa0c2e3a-0518-46f8-aa53-ac06c860564f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:23.337526 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fa0c2e3a-0518-46f8-aa53-ac06c860564f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:23.353300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa0c2e3a-0518-46f8-aa53-ac06c860564f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:23.354013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa0c2e3a-0518-46f8-aa53-ac06c860564f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:23.355040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa0c2e3a-0518-46f8-aa53-ac06c860564f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:23.355590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa0c2e3a-0518-46f8-aa53-ac06c860564f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:23.490386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fa0c2e3a-0518-46f8-aa53-ac06c860564f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:23.498164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5bbf8cb-25a5-4ad7-96da-fe4ed25c4468 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:23.499367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fa0c2e3a-0518-46f8-aa53-ac06c860564f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.171442 Jul 25 19:29:23.500030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 240/502] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:23 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:23.514957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5bbf8cb-25a5-4ad7-96da-fe4ed25c4468 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:23.518575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5bbf8cb-25a5-4ad7-96da-fe4ed25c4468 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:23.522098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d5bbf8cb-25a5-4ad7-96da-fe4ed25c4468 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.348430 Jul 25 19:29:23.534432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 263/503] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:23.905793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-329a056c-0b04-46f3-b53d-3549c4bed84f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:23.907019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-329a056c-0b04-46f3-b53d-3549c4bed84f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:23.916602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-329a056c-0b04-46f3-b53d-3549c4bed84f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:23.917660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-329a056c-0b04-46f3-b53d-3549c4bed84f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:23.918678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-329a056c-0b04-46f3-b53d-3549c4bed84f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:23.919256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-329a056c-0b04-46f3-b53d-3549c4bed84f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:23.922850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:24.003023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-329a056c-0b04-46f3-b53d-3549c4bed84f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:24.012844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-329a056c-0b04-46f3-b53d-3549c4bed84f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.111826 Jul 25 19:29:24.013506 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 241/504] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:23 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:24.533980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-91c1a2fb-b08b-400f-ada8-627fd4847396 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:24.534793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-91c1a2fb-b08b-400f-ada8-627fd4847396 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:24.548082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91c1a2fb-b08b-400f-ada8-627fd4847396 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:24.548962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91c1a2fb-b08b-400f-ada8-627fd4847396 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:24.550435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91c1a2fb-b08b-400f-ada8-627fd4847396 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:24.551309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91c1a2fb-b08b-400f-ada8-627fd4847396 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:24.561595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-19572a8a-157f-4712-996c-2ab87c9324ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:24.565752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-19572a8a-157f-4712-996c-2ab87c9324ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:24.578099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-19572a8a-157f-4712-996c-2ab87c9324ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:24.578863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-19572a8a-157f-4712-996c-2ab87c9324ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:24.580327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-19572a8a-157f-4712-996c-2ab87c9324ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:24.581136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-19572a8a-157f-4712-996c-2ab87c9324ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:24.653584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-91c1a2fb-b08b-400f-ada8-627fd4847396 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:24.663113 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-91c1a2fb-b08b-400f-ada8-627fd4847396 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.133484 Jul 25 19:29:24.663753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 264/505] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:24 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:24.820788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-19572a8a-157f-4712-996c-2ab87c9324ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:24.839233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-19572a8a-157f-4712-996c-2ab87c9324ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:24.843001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-19572a8a-157f-4712-996c-2ab87c9324ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:24.845503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-19572a8a-157f-4712-996c-2ab87c9324ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.291243 Jul 25 19:29:24.846743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 242/506] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:25.040306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e8b9b68d-d2a5-479b-92df-335b89106249 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:25.041243 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e8b9b68d-d2a5-479b-92df-335b89106249 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:25.056653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8b9b68d-d2a5-479b-92df-335b89106249 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:25.057313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8b9b68d-d2a5-479b-92df-335b89106249 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:25.058587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8b9b68d-d2a5-479b-92df-335b89106249 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:25.059256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8b9b68d-d2a5-479b-92df-335b89106249 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:25.171126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e8b9b68d-d2a5-479b-92df-335b89106249 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:25.180844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e8b9b68d-d2a5-479b-92df-335b89106249 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.146675 Jul 25 19:29:25.181593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 265/507] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:25 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:25.688184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6dfd553a-db10-4d05-84f9-4bd62884aeaf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:25.689202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6dfd553a-db10-4d05-84f9-4bd62884aeaf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:25.699333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6dfd553a-db10-4d05-84f9-4bd62884aeaf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:25.699966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6dfd553a-db10-4d05-84f9-4bd62884aeaf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:25.700814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6dfd553a-db10-4d05-84f9-4bd62884aeaf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:25.701297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6dfd553a-db10-4d05-84f9-4bd62884aeaf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:25.780739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6dfd553a-db10-4d05-84f9-4bd62884aeaf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:25.796568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6dfd553a-db10-4d05-84f9-4bd62884aeaf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.114274 Jul 25 19:29:25.805420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 243/508] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:25 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:25.885142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-79fe0c14-bc0e-4df6-978c-c2a1db35ebfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:25.886085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-79fe0c14-bc0e-4df6-978c-c2a1db35ebfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:25.894488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79fe0c14-bc0e-4df6-978c-c2a1db35ebfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:25.896397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79fe0c14-bc0e-4df6-978c-c2a1db35ebfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:25.897308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79fe0c14-bc0e-4df6-978c-c2a1db35ebfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:25.898140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79fe0c14-bc0e-4df6-978c-c2a1db35ebfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:26.140229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-79fe0c14-bc0e-4df6-978c-c2a1db35ebfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:26.142566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:26.152098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-79fe0c14-bc0e-4df6-978c-c2a1db35ebfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:26.153798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-79fe0c14-bc0e-4df6-978c-c2a1db35ebfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:26.155084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-79fe0c14-bc0e-4df6-978c-c2a1db35ebfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.276013 Jul 25 19:29:26.155869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 266/509] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:26.190436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d8a3e2ef-ec0d-4940-9290-11a68821f7c1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:26.191140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d8a3e2ef-ec0d-4940-9290-11a68821f7c1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:26.202523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8a3e2ef-ec0d-4940-9290-11a68821f7c1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:26.203165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8a3e2ef-ec0d-4940-9290-11a68821f7c1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:26.204415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8a3e2ef-ec0d-4940-9290-11a68821f7c1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:26.205064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8a3e2ef-ec0d-4940-9290-11a68821f7c1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:26.207832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6782a363-de5d-44f8-84c6-30ddb3f06c3a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:26.209117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6782a363-de5d-44f8-84c6-30ddb3f06c3a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:26.220179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6782a363-de5d-44f8-84c6-30ddb3f06c3a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:26.220965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6782a363-de5d-44f8-84c6-30ddb3f06c3a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:26.222338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6782a363-de5d-44f8-84c6-30ddb3f06c3a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:26.223733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6782a363-de5d-44f8-84c6-30ddb3f06c3a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:26.244065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d8a3e2ef-ec0d-4940-9290-11a68821f7c1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/ips" status: 200 len: 145 microversion: 2.1 time: 0.059938 Jul 25 19:29:26.245007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 244/510] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Jul 25 19:29:26 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/ips => generated 145 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:26.328991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6782a363-de5d-44f8-84c6-30ddb3f06c3a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:26.340016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6782a363-de5d-44f8-84c6-30ddb3f06c3a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.139848 Jul 25 19:29:26.340967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 267/511] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:26 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:26.834449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aee932c5-aeb7-497a-9197-36f668b9e00a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:26.835580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aee932c5-aeb7-497a-9197-36f668b9e00a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:26.845250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee932c5-aeb7-497a-9197-36f668b9e00a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:26.845808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee932c5-aeb7-497a-9197-36f668b9e00a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:26.846626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee932c5-aeb7-497a-9197-36f668b9e00a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:26.847062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee932c5-aeb7-497a-9197-36f668b9e00a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:26.950405 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-aee932c5-aeb7-497a-9197-36f668b9e00a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:26.963797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aee932c5-aeb7-497a-9197-36f668b9e00a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.134398 Jul 25 19:29:26.964841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 245/512] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:26 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:27.192485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b81c255-c85f-4166-8ead-23fffed7946d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:27.193523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b81c255-c85f-4166-8ead-23fffed7946d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:27.203792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b81c255-c85f-4166-8ead-23fffed7946d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:27.204514 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b81c255-c85f-4166-8ead-23fffed7946d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:27.205617 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b81c255-c85f-4166-8ead-23fffed7946d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:27.206251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b81c255-c85f-4166-8ead-23fffed7946d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:27.375721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-74dddf44-e705-4dc3-8ff0-366ed27f4457 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:27.376343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-74dddf44-e705-4dc3-8ff0-366ed27f4457 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:27.383709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74dddf44-e705-4dc3-8ff0-366ed27f4457 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:27.384156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74dddf44-e705-4dc3-8ff0-366ed27f4457 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:27.385199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74dddf44-e705-4dc3-8ff0-366ed27f4457 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:27.385639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74dddf44-e705-4dc3-8ff0-366ed27f4457 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:27.408026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b81c255-c85f-4166-8ead-23fffed7946d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:27.426380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b81c255-c85f-4166-8ead-23fffed7946d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:27.429879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b81c255-c85f-4166-8ead-23fffed7946d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:27.432247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b81c255-c85f-4166-8ead-23fffed7946d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.246549 Jul 25 19:29:27.433296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 268/513] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:27.463185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-74dddf44-e705-4dc3-8ff0-366ed27f4457 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:27.479047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-74dddf44-e705-4dc3-8ff0-366ed27f4457 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1220 microversion: 2.1 time: 0.107311 Jul 25 19:29:27.480194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 246/514] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:27 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:28.002280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3c4e79ce-7275-496a-b36d-0436a6085291 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:28.003331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3c4e79ce-7275-496a-b36d-0436a6085291 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:28.013659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c4e79ce-7275-496a-b36d-0436a6085291 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:28.014290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c4e79ce-7275-496a-b36d-0436a6085291 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:28.015672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c4e79ce-7275-496a-b36d-0436a6085291 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:28.016201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c4e79ce-7275-496a-b36d-0436a6085291 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:28.104877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3c4e79ce-7275-496a-b36d-0436a6085291 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:28.118373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3c4e79ce-7275-496a-b36d-0436a6085291 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1138 microversion: 2.1 time: 0.123224 Jul 25 19:29:28.119352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 269/515] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:27 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1138 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:28.462175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fd42f03e-2c74-4619-bc6f-d58fd5ebe3d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:28.462852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fd42f03e-2c74-4619-bc6f-d58fd5ebe3d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:28.469801 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fd42f03e-2c74-4619-bc6f-d58fd5ebe3d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:28.471150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fd42f03e-2c74-4619-bc6f-d58fd5ebe3d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:28.471150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fd42f03e-2c74-4619-bc6f-d58fd5ebe3d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:28.471846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fd42f03e-2c74-4619-bc6f-d58fd5ebe3d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:28.517140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6702f81b-9c40-4113-83e5-fcd1b8f1db05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:28.518180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6702f81b-9c40-4113-83e5-fcd1b8f1db05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:28.527430 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6702f81b-9c40-4113-83e5-fcd1b8f1db05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:28.528020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6702f81b-9c40-4113-83e5-fcd1b8f1db05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:28.528869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6702f81b-9c40-4113-83e5-fcd1b8f1db05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:28.529461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6702f81b-9c40-4113-83e5-fcd1b8f1db05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:28.663296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6702f81b-9c40-4113-83e5-fcd1b8f1db05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:28.677371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6702f81b-9c40-4113-83e5-fcd1b8f1db05 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1212 microversion: 2.1 time: 0.164563 Jul 25 19:29:28.678437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 270/516] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:28 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1212 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:28.748418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fd42f03e-2c74-4619-bc6f-d58fd5ebe3d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:28.761404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fd42f03e-2c74-4619-bc6f-d58fd5ebe3d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:28.763050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fd42f03e-2c74-4619-bc6f-d58fd5ebe3d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:28.764310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fd42f03e-2c74-4619-bc6f-d58fd5ebe3d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.307881 Jul 25 19:29:28.764894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 247/517] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:29.158734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51df9012-6ad7-4a55-b993-285118fde02b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:29.159870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51df9012-6ad7-4a55-b993-285118fde02b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:29.172970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51df9012-6ad7-4a55-b993-285118fde02b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:29.173768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51df9012-6ad7-4a55-b993-285118fde02b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:29.175136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51df9012-6ad7-4a55-b993-285118fde02b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:29.176606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51df9012-6ad7-4a55-b993-285118fde02b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:29.274130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51df9012-6ad7-4a55-b993-285118fde02b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:29.282416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51df9012-6ad7-4a55-b993-285118fde02b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1130 microversion: 2.1 time: 0.130864 Jul 25 19:29:29.283011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 271/518] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:29 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1130 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:29.714942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d784182e-55c3-46b1-bb88-91d61c621359 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:29.717308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d784182e-55c3-46b1-bb88-91d61c621359 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:29.729370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d784182e-55c3-46b1-bb88-91d61c621359 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:29.730655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d784182e-55c3-46b1-bb88-91d61c621359 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:29.732335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d784182e-55c3-46b1-bb88-91d61c621359 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:29.733379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d784182e-55c3-46b1-bb88-91d61c621359 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:29.795698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-10cf21b6-c322-441c-b775-c56f128b1912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:29.796859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-10cf21b6-c322-441c-b775-c56f128b1912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:29.814724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10cf21b6-c322-441c-b775-c56f128b1912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:29.815856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10cf21b6-c322-441c-b775-c56f128b1912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:29.818427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10cf21b6-c322-441c-b775-c56f128b1912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:29.819315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10cf21b6-c322-441c-b775-c56f128b1912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:29.851189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d784182e-55c3-46b1-bb88-91d61c621359 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:29.866227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d784182e-55c3-46b1-bb88-91d61c621359 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1212 microversion: 2.1 time: 0.155587 Jul 25 19:29:29.867352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 248/519] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:29 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1212 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:30.069650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10cf21b6-c322-441c-b775-c56f128b1912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:30.080171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10cf21b6-c322-441c-b775-c56f128b1912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:30.082194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10cf21b6-c322-441c-b775-c56f128b1912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:30.084083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-10cf21b6-c322-441c-b775-c56f128b1912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.295572 Jul 25 19:29:30.084773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 272/520] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:29 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:30.310874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4cbb8076-4a24-4080-a559-9ab484b027ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:30.312195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4cbb8076-4a24-4080-a559-9ab484b027ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:30.325014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cbb8076-4a24-4080-a559-9ab484b027ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:30.325769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cbb8076-4a24-4080-a559-9ab484b027ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:30.329400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cbb8076-4a24-4080-a559-9ab484b027ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:30.329400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cbb8076-4a24-4080-a559-9ab484b027ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:30.428127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4cbb8076-4a24-4080-a559-9ab484b027ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:30.439417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4cbb8076-4a24-4080-a559-9ab484b027ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1186 microversion: 2.1 time: 0.136123 Jul 25 19:29:30.442540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 249/521] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:30 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1186 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:30.904731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eebf075c-1357-462d-82cd-5eca96aad440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:30.905879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eebf075c-1357-462d-82cd-5eca96aad440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:30.918634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eebf075c-1357-462d-82cd-5eca96aad440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:30.919389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eebf075c-1357-462d-82cd-5eca96aad440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:30.920827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eebf075c-1357-462d-82cd-5eca96aad440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:30.921523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eebf075c-1357-462d-82cd-5eca96aad440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:31.017169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eebf075c-1357-462d-82cd-5eca96aad440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:31.028443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eebf075c-1357-462d-82cd-5eca96aad440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1268 microversion: 2.1 time: 0.130827 Jul 25 19:29:31.029359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 273/522] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:30 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1268 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:31.124167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-71edd447-03bf-4737-b10e-0c2560abc717 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:31.125181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-71edd447-03bf-4737-b10e-0c2560abc717 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:31.135606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71edd447-03bf-4737-b10e-0c2560abc717 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:31.135606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71edd447-03bf-4737-b10e-0c2560abc717 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:31.135606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71edd447-03bf-4737-b10e-0c2560abc717 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:31.136202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71edd447-03bf-4737-b10e-0c2560abc717 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:31.335038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-71edd447-03bf-4737-b10e-0c2560abc717 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:31.346577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-71edd447-03bf-4737-b10e-0c2560abc717 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:31.348576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-71edd447-03bf-4737-b10e-0c2560abc717 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:31.349807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-71edd447-03bf-4737-b10e-0c2560abc717 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.230089 Jul 25 19:29:31.350762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 250/523] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:31.477150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a76a5ba7-c82f-4599-9da2-67b9f63c817b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:31.478593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a76a5ba7-c82f-4599-9da2-67b9f63c817b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:31.488581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a76a5ba7-c82f-4599-9da2-67b9f63c817b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:31.489025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a76a5ba7-c82f-4599-9da2-67b9f63c817b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:31.490357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a76a5ba7-c82f-4599-9da2-67b9f63c817b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:31.491379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a76a5ba7-c82f-4599-9da2-67b9f63c817b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:31.600590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a76a5ba7-c82f-4599-9da2-67b9f63c817b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:31.611157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a76a5ba7-c82f-4599-9da2-67b9f63c817b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1186 microversion: 2.1 time: 0.140930 Jul 25 19:29:31.612097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 274/524] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:31 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1186 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:31.824906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e4d5639c-b2d5-44a5-89dd-7bb99afc1aa2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d9cd473-5428-47a4-b3d9-dabaad200ca9"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:31.829431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e4d5639c-b2d5-44a5-89dd-7bb99afc1aa2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:31.833791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=66 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:31.844462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4d5639c-b2d5-44a5-89dd-7bb99afc1aa2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:31.845228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4d5639c-b2d5-44a5-89dd-7bb99afc1aa2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:31.846666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4d5639c-b2d5-44a5-89dd-7bb99afc1aa2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:31.847391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4d5639c-b2d5-44a5-89dd-7bb99afc1aa2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:32.073463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-082568e5-5877-4dec-8e08-a5fa44b5c870 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:32.074516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-082568e5-5877-4dec-8e08-a5fa44b5c870 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:32.093691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-082568e5-5877-4dec-8e08-a5fa44b5c870 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:32.094546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-082568e5-5877-4dec-8e08-a5fa44b5c870 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:32.096235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-082568e5-5877-4dec-8e08-a5fa44b5c870 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:32.100949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-082568e5-5877-4dec-8e08-a5fa44b5c870 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:32.201513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-082568e5-5877-4dec-8e08-a5fa44b5c870 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:32.209974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-082568e5-5877-4dec-8e08-a5fa44b5c870 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1268 microversion: 2.1 time: 0.147928 Jul 25 19:29:32.210577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 275/525] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:32 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:32.380844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ff4e2014-6aae-4cd5-8d3e-9ee7e4c65bb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:32.381466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ff4e2014-6aae-4cd5-8d3e-9ee7e4c65bb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:32.388673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4e2014-6aae-4cd5-8d3e-9ee7e4c65bb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:32.389117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4e2014-6aae-4cd5-8d3e-9ee7e4c65bb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:32.389892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4e2014-6aae-4cd5-8d3e-9ee7e4c65bb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:32.390322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4e2014-6aae-4cd5-8d3e-9ee7e4c65bb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:33.145049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e4d5639c-b2d5-44a5-89dd-7bb99afc1aa2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "POST /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.328387 Jul 25 19:29:33.146491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 251/526] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 19:29:31 2022] POST /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 194 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:33.157732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-07976ebf-0e33-49a5-a611-5b374e7e703b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:33.162997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-07976ebf-0e33-49a5-a611-5b374e7e703b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:33.172600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07976ebf-0e33-49a5-a611-5b374e7e703b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:33.173939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07976ebf-0e33-49a5-a611-5b374e7e703b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:33.176814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07976ebf-0e33-49a5-a611-5b374e7e703b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:33.178063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07976ebf-0e33-49a5-a611-5b374e7e703b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:33.360954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-07976ebf-0e33-49a5-a611-5b374e7e703b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:33.367080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ff4e2014-6aae-4cd5-8d3e-9ee7e4c65bb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:33.372575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-07976ebf-0e33-49a5-a611-5b374e7e703b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1204 microversion: 2.1 time: 0.223929 Jul 25 19:29:33.377113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 252/527] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:33 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1204 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:33.387251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ff4e2014-6aae-4cd5-8d3e-9ee7e4c65bb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:33.390257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fc03f433-8441-46a7-843c-05b2d3903f91 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:33.391417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fc03f433-8441-46a7-843c-05b2d3903f91 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:33.392185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ff4e2014-6aae-4cd5-8d3e-9ee7e4c65bb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:33.395169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ff4e2014-6aae-4cd5-8d3e-9ee7e4c65bb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 1.018104 Jul 25 19:29:33.396485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 276/528] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:32 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:33.402112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc03f433-8441-46a7-843c-05b2d3903f91 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:33.402523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc03f433-8441-46a7-843c-05b2d3903f91 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:33.403573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc03f433-8441-46a7-843c-05b2d3903f91 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:33.404093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fc03f433-8441-46a7-843c-05b2d3903f91 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:33.614340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fc03f433-8441-46a7-843c-05b2d3903f91 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:33.632264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fc03f433-8441-46a7-843c-05b2d3903f91 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1274 microversion: 2.1 time: 0.252698 Jul 25 19:29:33.633710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 253/529] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:33 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:34.402495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb6da1bc-668e-48f9-a892-fef14b577545 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:34.403837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb6da1bc-668e-48f9-a892-fef14b577545 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:34.418266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb6da1bc-668e-48f9-a892-fef14b577545 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:34.423941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb6da1bc-668e-48f9-a892-fef14b577545 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:34.423941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb6da1bc-668e-48f9-a892-fef14b577545 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:34.423941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb6da1bc-668e-48f9-a892-fef14b577545 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:34.440310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-210d15fb-d9d2-4b14-bc38-0c0421a59d18 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:34.442203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-210d15fb-d9d2-4b14-bc38-0c0421a59d18 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:34.455329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-210d15fb-d9d2-4b14-bc38-0c0421a59d18 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:34.456860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-210d15fb-d9d2-4b14-bc38-0c0421a59d18 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:34.458979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-210d15fb-d9d2-4b14-bc38-0c0421a59d18 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:34.459915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-210d15fb-d9d2-4b14-bc38-0c0421a59d18 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:34.820071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb6da1bc-668e-48f9-a892-fef14b577545 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:34.834779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb6da1bc-668e-48f9-a892-fef14b577545 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1204 microversion: 2.1 time: 0.440572 Jul 25 19:29:34.835925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 277/530] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:34 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1204 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:34.857029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-03f23094-2c92-49c6-a775-a1c01265e95d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:34.858642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-03f23094-2c92-49c6-a775-a1c01265e95d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:34.875075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03f23094-2c92-49c6-a775-a1c01265e95d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:34.876760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03f23094-2c92-49c6-a775-a1c01265e95d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:34.878808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03f23094-2c92-49c6-a775-a1c01265e95d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:34.880957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03f23094-2c92-49c6-a775-a1c01265e95d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:34.921648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-210d15fb-d9d2-4b14-bc38-0c0421a59d18 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:34.947931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-210d15fb-d9d2-4b14-bc38-0c0421a59d18 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:34.954851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-210d15fb-d9d2-4b14-bc38-0c0421a59d18 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:34.960910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-210d15fb-d9d2-4b14-bc38-0c0421a59d18 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.528871 Jul 25 19:29:34.964071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 254/531] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:29:35.047552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-03f23094-2c92-49c6-a775-a1c01265e95d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:35.064487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-03f23094-2c92-49c6-a775-a1c01265e95d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1274 microversion: 2.1 time: 0.226263 Jul 25 19:29:35.065494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 278/532] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:34 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1274 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:35.548570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-58fa5685-2748-4278-b708-33ebc358aa7a req-0d1b93c1-30f9-4b16-8b11-9fe277ed2c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1007369a-dd3c-4837-95f4-e8326d600031", "name": "network-vif-plugged", "status": "completed", "tag": "33faefb9-12a5-4e86-b189-357d316c5553"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:35.586253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-58fa5685-2748-4278-b708-33ebc358aa7a req-0d1b93c1-30f9-4b16-8b11-9fe277ed2c83 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:35.587682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-58fa5685-2748-4278-b708-33ebc358aa7a req-0d1b93c1-30f9-4b16-8b11-9fe277ed2c83 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:35.610569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-58fa5685-2748-4278-b708-33ebc358aa7a req-0d1b93c1-30f9-4b16-8b11-9fe277ed2c83 service nova] Creating event network-vif-plugged:33faefb9-12a5-4e86-b189-357d316c5553 for instance 1007369a-dd3c-4837-95f4-e8326d600031 on hv-cinder-85093 Jul 25 19:29:35.618849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-58fa5685-2748-4278-b708-33ebc358aa7a req-0d1b93c1-30f9-4b16-8b11-9fe277ed2c83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080432 Jul 25 19:29:35.620684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 255/533] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:35.886231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ab8b3156-9b48-4b19-a757-1eae5d4a0cb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:35.889549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ab8b3156-9b48-4b19-a757-1eae5d4a0cb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:35.912969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab8b3156-9b48-4b19-a757-1eae5d4a0cb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:35.914845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab8b3156-9b48-4b19-a757-1eae5d4a0cb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:35.917063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab8b3156-9b48-4b19-a757-1eae5d4a0cb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:35.918279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab8b3156-9b48-4b19-a757-1eae5d4a0cb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:36.012418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4d6ae262-e1d9-49eb-b72c-5d25594e00b2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:36.013760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4d6ae262-e1d9-49eb-b72c-5d25594e00b2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:36.023862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d6ae262-e1d9-49eb-b72c-5d25594e00b2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:36.025264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d6ae262-e1d9-49eb-b72c-5d25594e00b2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:36.027087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d6ae262-e1d9-49eb-b72c-5d25594e00b2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:36.027947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d6ae262-e1d9-49eb-b72c-5d25594e00b2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:36.538923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ab8b3156-9b48-4b19-a757-1eae5d4a0cb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:36.549351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ab8b3156-9b48-4b19-a757-1eae5d4a0cb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.673310 Jul 25 19:29:36.554374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 279/534] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:35 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:36.579247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-135bdc03-81fb-4241-b4aa-e08eac46b0d3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:36.579891 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-135bdc03-81fb-4241-b4aa-e08eac46b0d3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:36.589190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-135bdc03-81fb-4241-b4aa-e08eac46b0d3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:36.589710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-135bdc03-81fb-4241-b4aa-e08eac46b0d3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:36.590580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-135bdc03-81fb-4241-b4aa-e08eac46b0d3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:36.591103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-135bdc03-81fb-4241-b4aa-e08eac46b0d3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:36.647045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4d6ae262-e1d9-49eb-b72c-5d25594e00b2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:36.666624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4d6ae262-e1d9-49eb-b72c-5d25594e00b2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:36.669941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4d6ae262-e1d9-49eb-b72c-5d25594e00b2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:36.672669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4d6ae262-e1d9-49eb-b72c-5d25594e00b2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.668340 Jul 25 19:29:36.695566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 256/535] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:36.955413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-135bdc03-81fb-4241-b4aa-e08eac46b0d3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:36.971447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-135bdc03-81fb-4241-b4aa-e08eac46b0d3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.415260 Jul 25 19:29:36.973125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 280/536] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:36 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:37.579752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-18e359a2-6e28-446e-abf6-efa9b484861a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:37.580744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-18e359a2-6e28-446e-abf6-efa9b484861a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:37.592288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18e359a2-6e28-446e-abf6-efa9b484861a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:37.592945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18e359a2-6e28-446e-abf6-efa9b484861a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:37.594341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18e359a2-6e28-446e-abf6-efa9b484861a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:37.594934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18e359a2-6e28-446e-abf6-efa9b484861a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:37.618845 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:37.658654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-e3db3784-0671-4b39-9b15-00730d242723 req-0bd5b56c-fb13-40ac-bc0e-bc9081aa3db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d238c56a-d3fb-4eaa-abb6-4f9155523e90", "tag": "3eb28b0d-848d-465c-8ce3-db043d446935"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:37.679853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e3db3784-0671-4b39-9b15-00730d242723 req-0bd5b56c-fb13-40ac-bc0e-bc9081aa3db6 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:37.680766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e3db3784-0671-4b39-9b15-00730d242723 req-0bd5b56c-fb13-40ac-bc0e-bc9081aa3db6 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:37.721946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-e3db3784-0671-4b39-9b15-00730d242723 req-0bd5b56c-fb13-40ac-bc0e-bc9081aa3db6 service nova] Creating event network-changed:3eb28b0d-848d-465c-8ce3-db043d446935 for instance d238c56a-d3fb-4eaa-abb6-4f9155523e90 on hv-cinder-85093 Jul 25 19:29:37.745518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-e3db3784-0671-4b39-9b15-00730d242723 req-0bd5b56c-fb13-40ac-bc0e-bc9081aa3db6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093940 Jul 25 19:29:37.746652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 281/537] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:37.756739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aa997b4c-bb3b-4fe7-883f-31dbb039bbd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:37.758102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aa997b4c-bb3b-4fe7-883f-31dbb039bbd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:37.773733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa997b4c-bb3b-4fe7-883f-31dbb039bbd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:37.774463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa997b4c-bb3b-4fe7-883f-31dbb039bbd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:37.775758 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa997b4c-bb3b-4fe7-883f-31dbb039bbd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:37.776299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa997b4c-bb3b-4fe7-883f-31dbb039bbd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:38.690791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-18e359a2-6e28-446e-abf6-efa9b484861a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:38.703016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-18e359a2-6e28-446e-abf6-efa9b484861a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 1.128686 Jul 25 19:29:38.703640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 257/538] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:37 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:38.712289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eb991096-328a-41ed-bf43-08eabf1fbf11 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:38.714620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eb991096-328a-41ed-bf43-08eabf1fbf11 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:38.725784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb991096-328a-41ed-bf43-08eabf1fbf11 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:38.726389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb991096-328a-41ed-bf43-08eabf1fbf11 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:38.727337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb991096-328a-41ed-bf43-08eabf1fbf11 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:38.727943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb991096-328a-41ed-bf43-08eabf1fbf11 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:39.104184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa997b4c-bb3b-4fe7-883f-31dbb039bbd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:39.126687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa997b4c-bb3b-4fe7-883f-31dbb039bbd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:39.130282 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa997b4c-bb3b-4fe7-883f-31dbb039bbd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:39.132363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aa997b4c-bb3b-4fe7-883f-31dbb039bbd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 1.383731 Jul 25 19:29:39.133319 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 282/539] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:39.140887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af780b88-eae5-4944-a5ef-5e0a97d0a291 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:39.149576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af780b88-eae5-4944-a5ef-5e0a97d0a291 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:39.150026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af780b88-eae5-4944-a5ef-5e0a97d0a291 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:39.203840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eb991096-328a-41ed-bf43-08eabf1fbf11 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:39.219648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eb991096-328a-41ed-bf43-08eabf1fbf11 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.514858 Jul 25 19:29:39.220508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 258/540] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:38 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:39.250120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af780b88-eae5-4944-a5ef-5e0a97d0a291 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Going to try to stop instance {{(pid=117951) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 19:29:39.279479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:39.334664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af780b88-eae5-4944-a5ef-5e0a97d0a291 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "POST /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/action" status: 202 len: 0 microversion: 2.1 time: 0.199362 Jul 25 19:29:39.335709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 283/541] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 19:29:39 2022] POST /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:29:39.347036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df76e2df-608c-4e28-bdfd-16cef898c362 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:39.348283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df76e2df-608c-4e28-bdfd-16cef898c362 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:39.358287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df76e2df-608c-4e28-bdfd-16cef898c362 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:39.358736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df76e2df-608c-4e28-bdfd-16cef898c362 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:39.359571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df76e2df-608c-4e28-bdfd-16cef898c362 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:39.360013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df76e2df-608c-4e28-bdfd-16cef898c362 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:39.528949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df76e2df-608c-4e28-bdfd-16cef898c362 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:39.540698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df76e2df-608c-4e28-bdfd-16cef898c362 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.199699 Jul 25 19:29:39.541445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 259/542] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:39 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:39.729651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-545ab7be-71c8-4f43-ab10-3d48c5bda44b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:39.730349 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-545ab7be-71c8-4f43-ab10-3d48c5bda44b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:39.737993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-545ab7be-71c8-4f43-ab10-3d48c5bda44b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:39.739169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-545ab7be-71c8-4f43-ab10-3d48c5bda44b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:39.739933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-545ab7be-71c8-4f43-ab10-3d48c5bda44b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:39.740379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-545ab7be-71c8-4f43-ab10-3d48c5bda44b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:39.773128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-efa587f6-7b15-4328-bae6-e6643e886199 req-020033cf-672a-49b5-8f6e-2183d7ae64a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44f6c42-c9a6-4a85-8776-d2f694f0ac8e", "tag": "7198e141-c0f4-476e-81a3-f0ece4990c63"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:39.787824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-efa587f6-7b15-4328-bae6-e6643e886199 req-020033cf-672a-49b5-8f6e-2183d7ae64a9 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:39.788523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-efa587f6-7b15-4328-bae6-e6643e886199 req-020033cf-672a-49b5-8f6e-2183d7ae64a9 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:39.802839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-efa587f6-7b15-4328-bae6-e6643e886199 req-020033cf-672a-49b5-8f6e-2183d7ae64a9 service nova] Creating event network-changed:7198e141-c0f4-476e-81a3-f0ece4990c63 for instance a44f6c42-c9a6-4a85-8776-d2f694f0ac8e on hv-cinder-85093 Jul 25 19:29:39.810401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-efa587f6-7b15-4328-bae6-e6643e886199 req-020033cf-672a-49b5-8f6e-2183d7ae64a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042072 Jul 25 19:29:39.812314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 260/543] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:39.934216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-545ab7be-71c8-4f43-ab10-3d48c5bda44b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:39.943968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-545ab7be-71c8-4f43-ab10-3d48c5bda44b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.218374 Jul 25 19:29:39.944662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 284/544] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:39 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:40.158490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4f8ef0d6-bee7-4105-ab8a-d99d9c40a42c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:40.159325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4f8ef0d6-bee7-4105-ab8a-d99d9c40a42c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:40.168427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f8ef0d6-bee7-4105-ab8a-d99d9c40a42c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:40.168996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f8ef0d6-bee7-4105-ab8a-d99d9c40a42c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:40.169952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f8ef0d6-bee7-4105-ab8a-d99d9c40a42c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:40.170753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f8ef0d6-bee7-4105-ab8a-d99d9c40a42c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:40.242594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-21d516eb-770e-4d2d-bfd5-71aa96ed0acb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:40.243204 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-21d516eb-770e-4d2d-bfd5-71aa96ed0acb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:40.250236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21d516eb-770e-4d2d-bfd5-71aa96ed0acb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:40.250685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21d516eb-770e-4d2d-bfd5-71aa96ed0acb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:40.251606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21d516eb-770e-4d2d-bfd5-71aa96ed0acb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:40.252112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21d516eb-770e-4d2d-bfd5-71aa96ed0acb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:40.439354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f8ef0d6-bee7-4105-ab8a-d99d9c40a42c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:40.456669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f8ef0d6-bee7-4105-ab8a-d99d9c40a42c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:40.460662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f8ef0d6-bee7-4105-ab8a-d99d9c40a42c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:40.463112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4f8ef0d6-bee7-4105-ab8a-d99d9c40a42c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.309175 Jul 25 19:29:40.464192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 261/545] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:40.476823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-21d516eb-770e-4d2d-bfd5-71aa96ed0acb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:40.485783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-21d516eb-770e-4d2d-bfd5-71aa96ed0acb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.248120 Jul 25 19:29:40.486485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 285/546] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:40 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:40.570056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-36accbdf-8fd3-4a89-bff8-4693eeabb5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:40.571209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-36accbdf-8fd3-4a89-bff8-4693eeabb5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:40.583307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36accbdf-8fd3-4a89-bff8-4693eeabb5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:40.584050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36accbdf-8fd3-4a89-bff8-4693eeabb5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:40.585427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36accbdf-8fd3-4a89-bff8-4693eeabb5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:40.586249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36accbdf-8fd3-4a89-bff8-4693eeabb5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:40.799031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-36accbdf-8fd3-4a89-bff8-4693eeabb5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:40.809084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-36accbdf-8fd3-4a89-bff8-4693eeabb5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.247058 Jul 25 19:29:40.809697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 262/547] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:40 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:40.970069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ec16fc1c-cabe-4a3c-b181-8393e06c34c3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:40.970915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ec16fc1c-cabe-4a3c-b181-8393e06c34c3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:40.982944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec16fc1c-cabe-4a3c-b181-8393e06c34c3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:40.983790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec16fc1c-cabe-4a3c-b181-8393e06c34c3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:40.985224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec16fc1c-cabe-4a3c-b181-8393e06c34c3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:40.985997 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec16fc1c-cabe-4a3c-b181-8393e06c34c3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:41.315463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ec16fc1c-cabe-4a3c-b181-8393e06c34c3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:41.326666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ec16fc1c-cabe-4a3c-b181-8393e06c34c3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.363732 Jul 25 19:29:41.327276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 286/548] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:40 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:41.508409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3888a5b2-2537-46ba-8d5a-3850d37e12f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:41.509231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3888a5b2-2537-46ba-8d5a-3850d37e12f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:41.510042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4f58a071-6339-48be-b8bb-803dc35cc912 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:41.510663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4f58a071-6339-48be-b8bb-803dc35cc912 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:41.517717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f58a071-6339-48be-b8bb-803dc35cc912 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:41.518159 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f58a071-6339-48be-b8bb-803dc35cc912 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:41.518393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3888a5b2-2537-46ba-8d5a-3850d37e12f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:41.518943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f58a071-6339-48be-b8bb-803dc35cc912 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:41.519150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3888a5b2-2537-46ba-8d5a-3850d37e12f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:41.520011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f58a071-6339-48be-b8bb-803dc35cc912 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:41.520996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3888a5b2-2537-46ba-8d5a-3850d37e12f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:41.521972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3888a5b2-2537-46ba-8d5a-3850d37e12f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:41.876810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3888a5b2-2537-46ba-8d5a-3850d37e12f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:41.886734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f58a071-6339-48be-b8bb-803dc35cc912 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:41.890484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3888a5b2-2537-46ba-8d5a-3850d37e12f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:41.894274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3888a5b2-2537-46ba-8d5a-3850d37e12f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:41.897499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3888a5b2-2537-46ba-8d5a-3850d37e12f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.396882 Jul 25 19:29:41.899238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 263/549] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:41.909165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-78dbcdbe-445f-4cdb-a144-63a96bedf3b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:41.910783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-78dbcdbe-445f-4cdb-a144-63a96bedf3b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:41.924405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4f58a071-6339-48be-b8bb-803dc35cc912 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.417954 Jul 25 19:29:41.925915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78dbcdbe-445f-4cdb-a144-63a96bedf3b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:41.927101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78dbcdbe-445f-4cdb-a144-63a96bedf3b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:41.929007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78dbcdbe-445f-4cdb-a144-63a96bedf3b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:41.929737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78dbcdbe-445f-4cdb-a144-63a96bedf3b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:41.930385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 287/550] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:41 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:42.300460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78dbcdbe-445f-4cdb-a144-63a96bedf3b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:42.313834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-78dbcdbe-445f-4cdb-a144-63a96bedf3b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.412510 Jul 25 19:29:42.314632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 264/551] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:41 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:42.362671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-efa35563-12e8-49ac-b70f-10f2956e389e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:42.364415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-efa35563-12e8-49ac-b70f-10f2956e389e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:42.372679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efa35563-12e8-49ac-b70f-10f2956e389e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:42.373252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efa35563-12e8-49ac-b70f-10f2956e389e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:42.374201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efa35563-12e8-49ac-b70f-10f2956e389e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:42.374741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efa35563-12e8-49ac-b70f-10f2956e389e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:42.583942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-efa35563-12e8-49ac-b70f-10f2956e389e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:42.599646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-efa35563-12e8-49ac-b70f-10f2956e389e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.242034 Jul 25 19:29:42.600614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 288/552] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:42 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:42.938148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ca62288d-30ca-4cd4-a5d8-a8b521b9970b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:42.938954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ca62288d-30ca-4cd4-a5d8-a8b521b9970b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:42.952645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca62288d-30ca-4cd4-a5d8-a8b521b9970b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:42.953482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca62288d-30ca-4cd4-a5d8-a8b521b9970b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:42.954848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca62288d-30ca-4cd4-a5d8-a8b521b9970b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:42.955606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca62288d-30ca-4cd4-a5d8-a8b521b9970b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:42.963372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-608f4a73-abd0-45b6-86b0-d5ade441632b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:42.964213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-608f4a73-abd0-45b6-86b0-d5ade441632b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:42.974630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-608f4a73-abd0-45b6-86b0-d5ade441632b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:42.975410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-608f4a73-abd0-45b6-86b0-d5ade441632b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:42.976780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-608f4a73-abd0-45b6-86b0-d5ade441632b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:42.977498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-608f4a73-abd0-45b6-86b0-d5ade441632b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:43.331189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ca62288d-30ca-4cd4-a5d8-a8b521b9970b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:43.341830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-608f4a73-abd0-45b6-86b0-d5ade441632b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:43.343291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ca62288d-30ca-4cd4-a5d8-a8b521b9970b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:43.345804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ca62288d-30ca-4cd4-a5d8-a8b521b9970b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:43.347129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ca62288d-30ca-4cd4-a5d8-a8b521b9970b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1809 microversion: 2.20 time: 0.413409 Jul 25 19:29:43.348905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 265/553] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1809 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:43.357178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-608f4a73-abd0-45b6-86b0-d5ade441632b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.400804 Jul 25 19:29:43.358328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 289/554] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:42 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:43.365523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-256e5de8-ca40-4cc5-b2e7-8898cd8ff106 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:43.365523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-256e5de8-ca40-4cc5-b2e7-8898cd8ff106 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:43.376238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-256e5de8-ca40-4cc5-b2e7-8898cd8ff106 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:43.376238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-256e5de8-ca40-4cc5-b2e7-8898cd8ff106 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:43.376238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-256e5de8-ca40-4cc5-b2e7-8898cd8ff106 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:43.376238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-256e5de8-ca40-4cc5-b2e7-8898cd8ff106 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:43.624256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c295545-6268-4af1-afb3-7bba226c99bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:43.624893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c295545-6268-4af1-afb3-7bba226c99bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:43.627635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:43.634157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c295545-6268-4af1-afb3-7bba226c99bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:43.634607 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c295545-6268-4af1-afb3-7bba226c99bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:43.635443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c295545-6268-4af1-afb3-7bba226c99bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:43.635914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c295545-6268-4af1-afb3-7bba226c99bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:43.754916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-256e5de8-ca40-4cc5-b2e7-8898cd8ff106 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:43.769933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-256e5de8-ca40-4cc5-b2e7-8898cd8ff106 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.418410 Jul 25 19:29:43.770824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 266/555] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:43 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:44.230343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c295545-6268-4af1-afb3-7bba226c99bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:44.253454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c295545-6268-4af1-afb3-7bba226c99bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.632796 Jul 25 19:29:44.270094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 290/556] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:43 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:44.382789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-89610243-e07c-4cd5-b7fd-f5e34ef4efe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:44.384128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-89610243-e07c-4cd5-b7fd-f5e34ef4efe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:44.395872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b3adfd92-0c99-48bf-afa7-26d2fc3b86a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:44.397090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89610243-e07c-4cd5-b7fd-f5e34ef4efe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:44.397273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b3adfd92-0c99-48bf-afa7-26d2fc3b86a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:44.397999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89610243-e07c-4cd5-b7fd-f5e34ef4efe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:44.399459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89610243-e07c-4cd5-b7fd-f5e34ef4efe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:44.400625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89610243-e07c-4cd5-b7fd-f5e34ef4efe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:44.409469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3adfd92-0c99-48bf-afa7-26d2fc3b86a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:44.411408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3adfd92-0c99-48bf-afa7-26d2fc3b86a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:44.412763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3adfd92-0c99-48bf-afa7-26d2fc3b86a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:44.413409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3adfd92-0c99-48bf-afa7-26d2fc3b86a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:44.710314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-89610243-e07c-4cd5-b7fd-f5e34ef4efe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:44.726607 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b3adfd92-0c99-48bf-afa7-26d2fc3b86a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:44.731224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-89610243-e07c-4cd5-b7fd-f5e34ef4efe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:44.734716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-89610243-e07c-4cd5-b7fd-f5e34ef4efe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:44.737107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-89610243-e07c-4cd5-b7fd-f5e34ef4efe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1796 microversion: 2.20 time: 0.361612 Jul 25 19:29:44.737374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b3adfd92-0c99-48bf-afa7-26d2fc3b86a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.349173 Jul 25 19:29:44.738972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 267/557] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:29:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1796 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:29:44.739162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 291/558] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:44 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:44.811101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8ec4d823-950c-4f6b-8531-01f8b5380406 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:44.812302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8ec4d823-950c-4f6b-8531-01f8b5380406 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:44.824417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ec4d823-950c-4f6b-8531-01f8b5380406 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:44.825113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ec4d823-950c-4f6b-8531-01f8b5380406 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:44.826373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ec4d823-950c-4f6b-8531-01f8b5380406 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:44.827133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ec4d823-950c-4f6b-8531-01f8b5380406 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:45.100177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8ec4d823-950c-4f6b-8531-01f8b5380406 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:45.111197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8ec4d823-950c-4f6b-8531-01f8b5380406 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.307231 Jul 25 19:29:45.112006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 268/559] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:44 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:45.298510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1f2821c1-eb95-4921-a9a3-f834559d0eb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:45.299691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1f2821c1-eb95-4921-a9a3-f834559d0eb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:45.312160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f2821c1-eb95-4921-a9a3-f834559d0eb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:45.312955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f2821c1-eb95-4921-a9a3-f834559d0eb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:45.314359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f2821c1-eb95-4921-a9a3-f834559d0eb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:45.315150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f2821c1-eb95-4921-a9a3-f834559d0eb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:45.537413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:29:45.538204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:29:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:29:45.565089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1f2821c1-eb95-4921-a9a3-f834559d0eb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:45.583126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1f2821c1-eb95-4921-a9a3-f834559d0eb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.291009 Jul 25 19:29:45.584615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 292/560] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:45 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:45.776295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7a05f6fb-691d-4e01-9399-112ee458aa15 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:45.777339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7a05f6fb-691d-4e01-9399-112ee458aa15 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:45.786379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7a05f6fb-691d-4e01-9399-112ee458aa15 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:45.786832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7a05f6fb-691d-4e01-9399-112ee458aa15 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:45.787739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7a05f6fb-691d-4e01-9399-112ee458aa15 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:45.788186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7a05f6fb-691d-4e01-9399-112ee458aa15 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:45.966126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7a05f6fb-691d-4e01-9399-112ee458aa15 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:45.976386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7a05f6fb-691d-4e01-9399-112ee458aa15 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.208410 Jul 25 19:29:45.977192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 269/561] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:45 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:46.148262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de611455-2bd5-4ae7-9ecd-9572ade11f6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:46.149000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de611455-2bd5-4ae7-9ecd-9572ade11f6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:46.156656 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de611455-2bd5-4ae7-9ecd-9572ade11f6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.157098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de611455-2bd5-4ae7-9ecd-9572ade11f6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.157899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de611455-2bd5-4ae7-9ecd-9572ade11f6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.158342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de611455-2bd5-4ae7-9ecd-9572ade11f6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.358314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de611455-2bd5-4ae7-9ecd-9572ade11f6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:46.368145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de611455-2bd5-4ae7-9ecd-9572ade11f6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.225250 Jul 25 19:29:46.368745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 293/562] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:46 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:46.532139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-797471c7-8c0d-4382-a063-740b06da457c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:46.532854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-797471c7-8c0d-4382-a063-740b06da457c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:46.541547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-797471c7-8c0d-4382-a063-740b06da457c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.542584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-797471c7-8c0d-4382-a063-740b06da457c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.543376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-797471c7-8c0d-4382-a063-740b06da457c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.544032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-797471c7-8c0d-4382-a063-740b06da457c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.584895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-797471c7-8c0d-4382-a063-740b06da457c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d/ips" status: 200 len: 148 microversion: 2.1 time: 0.056650 Jul 25 19:29:46.585885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 270/563] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Jul 25 19:29:46 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d/ips => generated 148 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:46.605079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f4b206b-b272-44f0-a906-fbe96507af24 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:46.609525 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8f4b206b-b272-44f0-a906-fbe96507af24 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:46.620537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f4b206b-b272-44f0-a906-fbe96507af24 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.621102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f4b206b-b272-44f0-a906-fbe96507af24 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.621977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f4b206b-b272-44f0-a906-fbe96507af24 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.622474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f4b206b-b272-44f0-a906-fbe96507af24 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.624532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-08a3e475-2ab9-4fcb-af8d-e1da5ab46a87 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:46.625576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-08a3e475-2ab9-4fcb-af8d-e1da5ab46a87 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:46.636384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08a3e475-2ab9-4fcb-af8d-e1da5ab46a87 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.637108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08a3e475-2ab9-4fcb-af8d-e1da5ab46a87 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.638348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08a3e475-2ab9-4fcb-af8d-e1da5ab46a87 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.639060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08a3e475-2ab9-4fcb-af8d-e1da5ab46a87 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.751536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-8f4b206b-b272-44f0-a906-fbe96507af24 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Invalid volume: volume 20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe is already attached to instances: 4bcfc471-41be-4079-81d3-0cf334d03888 Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f4b206b-b272-44f0-a906-fbe96507af24 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: POST /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d/os-volume_attachments HTTP/1.1 Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 74 Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:29:46.753777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {"volumeAttachment": {"volumeId": "20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe"}} Jul 25 19:29:46.757623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Invalid volume: volume 20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe is already attached to instances: 4bcfc471-41be-4079-81d3-0cf334d03888 Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'server_id': 'd25205dc-2b73-4c21-b5c9-ee7b365ac47d', 'body': {'volumeAttachment': {'volumeId': '20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe'}}} Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe is already attached to instances: 4bcfc471-41be-4079-81d3-0cf334d03888 Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:29:46.760845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe is already attached to instances: 4bcfc471-41be-4079-81d3-0cf334d03888 Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:29:46.764721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:29:46.768499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:29:46.768499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:29:46.768499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:29:46.768499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe is already attached to instances: 4bcfc471-41be-4079-81d3-0cf334d03888 Jul 25 19:29:46.768499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:29:46.768499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f4b206b-b272-44f0-a906-fbe96507af24 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 400 to user: Invalid volume: volume 20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe is already attached to instances: 4bcfc471-41be-4079-81d3-0cf334d03888 {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:29:46.768499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8f4b206b-b272-44f0-a906-fbe96507af24 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.157768 Jul 25 19:29:46.768499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 294/564] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 19:29:46 2022] POST /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d/os-volume_attachments => generated 174 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:29:46.772425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c8cf6ecb-c974-4001-9077-345716d92963 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:46.772425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c8cf6ecb-c974-4001-9077-345716d92963 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:46.776278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ecb-c974-4001-9077-345716d92963 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.776732 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ecb-c974-4001-9077-345716d92963 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.777531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ecb-c974-4001-9077-345716d92963 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.777975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ecb-c974-4001-9077-345716d92963 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.828130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c8cf6ecb-c974-4001-9077-345716d92963 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:29:46.872645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-08a3e475-2ab9-4fcb-af8d-e1da5ab46a87 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:46.882196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-08a3e475-2ab9-4fcb-af8d-e1da5ab46a87 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.264598 Jul 25 19:29:46.882787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 271/565] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:46 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:46.953281 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c8cf6ecb-c974-4001-9077-345716d92963 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 204 len: 0 microversion: 2.1 time: 0.190332 Jul 25 19:29:46.954082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 295/566] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:29:46 2022] DELETE /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:29:46.968771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c68edea5-e443-42a3-9b20-cf8bd6e4a04f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:46.969854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c68edea5-e443-42a3-9b20-cf8bd6e4a04f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:46.981201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c68edea5-e443-42a3-9b20-cf8bd6e4a04f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.981939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c68edea5-e443-42a3-9b20-cf8bd6e4a04f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:46.983267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c68edea5-e443-42a3-9b20-cf8bd6e4a04f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:46.984001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c68edea5-e443-42a3-9b20-cf8bd6e4a04f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:47.024973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1f983fa8-370d-43e5-9683-b3c15ab8b535 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:47.025596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1f983fa8-370d-43e5-9683-b3c15ab8b535 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:47.037889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f983fa8-370d-43e5-9683-b3c15ab8b535 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:47.038640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f983fa8-370d-43e5-9683-b3c15ab8b535 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:47.039484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f983fa8-370d-43e5-9683-b3c15ab8b535 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:47.039955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f983fa8-370d-43e5-9683-b3c15ab8b535 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:47.293316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c68edea5-e443-42a3-9b20-cf8bd6e4a04f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:47.299337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1f983fa8-370d-43e5-9683-b3c15ab8b535 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:47.302304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c68edea5-e443-42a3-9b20-cf8bd6e4a04f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1679 microversion: 2.1 time: 0.340963 Jul 25 19:29:47.303166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 272/567] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:46 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1679 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:47.309788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1f983fa8-370d-43e5-9683-b3c15ab8b535 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.300307 Jul 25 19:29:47.310928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 296/568] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:47 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:47.397521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9988eed0-92a7-483c-8a28-e648535c866c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:47.398642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9988eed0-92a7-483c-8a28-e648535c866c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:47.407348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9988eed0-92a7-483c-8a28-e648535c866c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:47.408096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9988eed0-92a7-483c-8a28-e648535c866c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:47.408928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9988eed0-92a7-483c-8a28-e648535c866c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:47.409385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9988eed0-92a7-483c-8a28-e648535c866c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:47.593666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9988eed0-92a7-483c-8a28-e648535c866c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:47.605422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9988eed0-92a7-483c-8a28-e648535c866c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.216816 Jul 25 19:29:47.606048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 273/569] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:47 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:47.919435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f9a2aad8-aeb5-4072-b72c-2b4245d061b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:47.920276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f9a2aad8-aeb5-4072-b72c-2b4245d061b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:47.928697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9a2aad8-aeb5-4072-b72c-2b4245d061b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:47.929217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9a2aad8-aeb5-4072-b72c-2b4245d061b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:47.930069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9a2aad8-aeb5-4072-b72c-2b4245d061b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:47.930554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9a2aad8-aeb5-4072-b72c-2b4245d061b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:48.111447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f9a2aad8-aeb5-4072-b72c-2b4245d061b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:48.120610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f9a2aad8-aeb5-4072-b72c-2b4245d061b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.205436 Jul 25 19:29:48.121216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 297/570] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:47 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:48.331385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6fb358ae-f618-4652-b1de-25968a21653f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:48.336074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-57a6fc44-ba93-4899-8948-dc578ba2973f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:48.337242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-57a6fc44-ba93-4899-8948-dc578ba2973f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:48.339738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6fb358ae-f618-4652-b1de-25968a21653f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:48.346489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a6fc44-ba93-4899-8948-dc578ba2973f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:48.346943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a6fc44-ba93-4899-8948-dc578ba2973f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:48.348356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a6fc44-ba93-4899-8948-dc578ba2973f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:48.348806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a6fc44-ba93-4899-8948-dc578ba2973f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:48.352561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fb358ae-f618-4652-b1de-25968a21653f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:48.354357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fb358ae-f618-4652-b1de-25968a21653f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:48.354581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:48.354889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fb358ae-f618-4652-b1de-25968a21653f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:48.355790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fb358ae-f618-4652-b1de-25968a21653f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:48.610964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-57a6fc44-ba93-4899-8948-dc578ba2973f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:48.621912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-57a6fc44-ba93-4899-8948-dc578ba2973f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.293067 Jul 25 19:29:48.628516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 298/571] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:48 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:48.638043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3abf3f0f-ad0d-4f20-9bf8-c9f3a497a5a0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:48.639429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3abf3f0f-ad0d-4f20-9bf8-c9f3a497a5a0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:48.651443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abf3f0f-ad0d-4f20-9bf8-c9f3a497a5a0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:48.652302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abf3f0f-ad0d-4f20-9bf8-c9f3a497a5a0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:48.653745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abf3f0f-ad0d-4f20-9bf8-c9f3a497a5a0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:48.654529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abf3f0f-ad0d-4f20-9bf8-c9f3a497a5a0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:48.661955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6fb358ae-f618-4652-b1de-25968a21653f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:48.674721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6fb358ae-f618-4652-b1de-25968a21653f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1679 microversion: 2.1 time: 0.350998 Jul 25 19:29:48.675773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 274/572] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:48 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1679 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:48.838665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3abf3f0f-ad0d-4f20-9bf8-c9f3a497a5a0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:48.855805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3abf3f0f-ad0d-4f20-9bf8-c9f3a497a5a0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.225353 Jul 25 19:29:48.856869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 299/573] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:48 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:49.142850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-13b40eb2-1aab-4b1d-ba3b-811590c5198c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:49.143422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-13b40eb2-1aab-4b1d-ba3b-811590c5198c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:49.151403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13b40eb2-1aab-4b1d-ba3b-811590c5198c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:49.151933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13b40eb2-1aab-4b1d-ba3b-811590c5198c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:49.152795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13b40eb2-1aab-4b1d-ba3b-811590c5198c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:49.153273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13b40eb2-1aab-4b1d-ba3b-811590c5198c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:49.156822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:49.353300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-13b40eb2-1aab-4b1d-ba3b-811590c5198c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:49.370735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-13b40eb2-1aab-4b1d-ba3b-811590c5198c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.231588 Jul 25 19:29:49.371806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 275/574] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:49 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:49.652566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1d4fb2da-647e-43a0-a16f-8fcc854114d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:49.653432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1d4fb2da-647e-43a0-a16f-8fcc854114d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:49.666546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d4fb2da-647e-43a0-a16f-8fcc854114d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:49.667408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d4fb2da-647e-43a0-a16f-8fcc854114d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:49.670151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d4fb2da-647e-43a0-a16f-8fcc854114d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:49.671033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d4fb2da-647e-43a0-a16f-8fcc854114d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:49.710203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e16a630d-41e1-416f-9823-1eb5d2d29b15 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:49.711468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e16a630d-41e1-416f-9823-1eb5d2d29b15 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:49.724142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e16a630d-41e1-416f-9823-1eb5d2d29b15 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:49.724953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e16a630d-41e1-416f-9823-1eb5d2d29b15 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:49.726359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e16a630d-41e1-416f-9823-1eb5d2d29b15 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:49.727098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e16a630d-41e1-416f-9823-1eb5d2d29b15 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:49.971818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1d4fb2da-647e-43a0-a16f-8fcc854114d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:49.987149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1d4fb2da-647e-43a0-a16f-8fcc854114d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.339124 Jul 25 19:29:49.988247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 300/575] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:49 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:49.995197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3ad2b466-26da-40fc-b404-24a8105ecf2e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:49.995856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3ad2b466-26da-40fc-b404-24a8105ecf2e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:50.002604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ad2b466-26da-40fc-b404-24a8105ecf2e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:50.003077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ad2b466-26da-40fc-b404-24a8105ecf2e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:50.003945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ad2b466-26da-40fc-b404-24a8105ecf2e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:50.004560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ad2b466-26da-40fc-b404-24a8105ecf2e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:50.026489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e16a630d-41e1-416f-9823-1eb5d2d29b15 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:50.042450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e16a630d-41e1-416f-9823-1eb5d2d29b15 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1679 microversion: 2.1 time: 0.337201 Jul 25 19:29:50.043631 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 276/576] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:49 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1679 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:50.386203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3ad2b466-26da-40fc-b404-24a8105ecf2e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:50.400651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-42e73a80-eb0e-44b5-899b-cdc850d7e806 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:50.401875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-42e73a80-eb0e-44b5-899b-cdc850d7e806 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:50.410698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3ad2b466-26da-40fc-b404-24a8105ecf2e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.418877 Jul 25 19:29:50.412185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 301/577] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:49 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:50.415811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42e73a80-eb0e-44b5-899b-cdc850d7e806 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:50.417391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42e73a80-eb0e-44b5-899b-cdc850d7e806 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:50.419001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42e73a80-eb0e-44b5-899b-cdc850d7e806 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:50.419828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42e73a80-eb0e-44b5-899b-cdc850d7e806 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:50.487875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-bfe21181-3d8d-4f50-a07e-f49c163c2633 req-f3e34f5f-1148-40a4-8bae-0d8a6a0a957f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d238c56a-d3fb-4eaa-abb6-4f9155523e90", "name": "network-vif-plugged", "status": "completed", "tag": "3eb28b0d-848d-465c-8ce3-db043d446935"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:50.520417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-bfe21181-3d8d-4f50-a07e-f49c163c2633 req-f3e34f5f-1148-40a4-8bae-0d8a6a0a957f service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:50.522126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-bfe21181-3d8d-4f50-a07e-f49c163c2633 req-f3e34f5f-1148-40a4-8bae-0d8a6a0a957f service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:50.542659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-bfe21181-3d8d-4f50-a07e-f49c163c2633 req-f3e34f5f-1148-40a4-8bae-0d8a6a0a957f service nova] Creating event network-vif-plugged:3eb28b0d-848d-465c-8ce3-db043d446935 for instance d238c56a-d3fb-4eaa-abb6-4f9155523e90 on hv-cinder-85093 Jul 25 19:29:50.551268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-bfe21181-3d8d-4f50-a07e-f49c163c2633 req-f3e34f5f-1148-40a4-8bae-0d8a6a0a957f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069291 Jul 25 19:29:50.552994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 302/578] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:29:51.037028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-08f33250-8a48-406c-8c8a-9bf41ba38c00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:51.038350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-08f33250-8a48-406c-8c8a-9bf41ba38c00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:51.050977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08f33250-8a48-406c-8c8a-9bf41ba38c00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:51.052231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08f33250-8a48-406c-8c8a-9bf41ba38c00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:51.054216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08f33250-8a48-406c-8c8a-9bf41ba38c00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:51.055024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08f33250-8a48-406c-8c8a-9bf41ba38c00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:51.172146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-42e73a80-eb0e-44b5-899b-cdc850d7e806 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:51.187288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-42e73a80-eb0e-44b5-899b-cdc850d7e806 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.794147 Jul 25 19:29:51.188115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 277/579] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:50 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:51.197723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8237e446-eb2f-408e-8d5a-801858964b97 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:51.199104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8237e446-eb2f-408e-8d5a-801858964b97 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:51.211786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8237e446-eb2f-408e-8d5a-801858964b97 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:51.212731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8237e446-eb2f-408e-8d5a-801858964b97 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:51.214212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8237e446-eb2f-408e-8d5a-801858964b97 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:51.215129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8237e446-eb2f-408e-8d5a-801858964b97 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:51.330377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08f33250-8a48-406c-8c8a-9bf41ba38c00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:51.344907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-08f33250-8a48-406c-8c8a-9bf41ba38c00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.317499 Jul 25 19:29:51.345861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 303/580] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:51 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:51.450498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8237e446-eb2f-408e-8d5a-801858964b97 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:51.451884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-445842b1-b0e4-4920-ba14-9a8f1ccfe56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:51.452566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-445842b1-b0e4-4920-ba14-9a8f1ccfe56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:51.461338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8237e446-eb2f-408e-8d5a-801858964b97 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1679 microversion: 2.1 time: 0.271681 Jul 25 19:29:51.462461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 278/581] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:51 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1679 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:51.465093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-445842b1-b0e4-4920-ba14-9a8f1ccfe56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:51.466028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-445842b1-b0e4-4920-ba14-9a8f1ccfe56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:51.467859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-445842b1-b0e4-4920-ba14-9a8f1ccfe56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:51.468751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-445842b1-b0e4-4920-ba14-9a8f1ccfe56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:51.671677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-445842b1-b0e4-4920-ba14-9a8f1ccfe56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:51.688359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-445842b1-b0e4-4920-ba14-9a8f1ccfe56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.242813 Jul 25 19:29:51.689751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 304/582] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:51 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:52.224509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4451de8c-a366-4593-854e-af7568d15713 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:52.225609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4451de8c-a366-4593-854e-af7568d15713 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:52.234615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4451de8c-a366-4593-854e-af7568d15713 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:52.235296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4451de8c-a366-4593-854e-af7568d15713 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:52.236617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4451de8c-a366-4593-854e-af7568d15713 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:52.237173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4451de8c-a366-4593-854e-af7568d15713 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:52.378306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fa4f35d5-7f8f-4019-b95f-0e9c2be17fd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:52.379953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa4f35d5-7f8f-4019-b95f-0e9c2be17fd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:52.392655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa4f35d5-7f8f-4019-b95f-0e9c2be17fd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:52.393467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa4f35d5-7f8f-4019-b95f-0e9c2be17fd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:52.395573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa4f35d5-7f8f-4019-b95f-0e9c2be17fd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:52.396404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa4f35d5-7f8f-4019-b95f-0e9c2be17fd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:52.768942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4451de8c-a366-4593-854e-af7568d15713 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:52.783899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4451de8c-a366-4593-854e-af7568d15713 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.563986 Jul 25 19:29:52.796277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 279/583] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:52 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:52.806943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0bd0c027-991a-4649-88bc-1e44f58e4ff5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:52.808051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0bd0c027-991a-4649-88bc-1e44f58e4ff5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:52.819984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0bd0c027-991a-4649-88bc-1e44f58e4ff5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:52.820782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0bd0c027-991a-4649-88bc-1e44f58e4ff5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:52.822236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0bd0c027-991a-4649-88bc-1e44f58e4ff5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:52.822982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0bd0c027-991a-4649-88bc-1e44f58e4ff5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:52.874402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa4f35d5-7f8f-4019-b95f-0e9c2be17fd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:52.885810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fa4f35d5-7f8f-4019-b95f-0e9c2be17fd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.514835 Jul 25 19:29:52.886536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 305/584] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:52 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:52.896177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4525466-b83c-4e5b-831b-4af1c01bb06e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:52.897436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c4525466-b83c-4e5b-831b-4af1c01bb06e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:52.910287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4525466-b83c-4e5b-831b-4af1c01bb06e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:52.912156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4525466-b83c-4e5b-831b-4af1c01bb06e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:52.914647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4525466-b83c-4e5b-831b-4af1c01bb06e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:52.915189 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4525466-b83c-4e5b-831b-4af1c01bb06e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:53.179927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0bd0c027-991a-4649-88bc-1e44f58e4ff5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:53.189659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0bd0c027-991a-4649-88bc-1e44f58e4ff5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1679 microversion: 2.1 time: 0.391861 Jul 25 19:29:53.190379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 280/585] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:52 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1679 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:53.229252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c4525466-b83c-4e5b-831b-4af1c01bb06e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:53.243734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c4525466-b83c-4e5b-831b-4af1c01bb06e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.355670 Jul 25 19:29:53.244554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 306/586] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:53.765467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-4ccf3873-8bb0-4883-9ea6-d9fd0a71536e req-9e6cd62d-b5e1-4497-aa57-b79edc230124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25205dc-2b73-4c21-b5c9-ee7b365ac47d", "name": "network-vif-deleted", "tag": "8f9b0ab5-6735-4140-9ebc-beecce6a3499"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:53.789131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-4ccf3873-8bb0-4883-9ea6-d9fd0a71536e req-9e6cd62d-b5e1-4497-aa57-b79edc230124 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:53.789930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-4ccf3873-8bb0-4883-9ea6-d9fd0a71536e req-9e6cd62d-b5e1-4497-aa57-b79edc230124 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:53.821113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-4ccf3873-8bb0-4883-9ea6-d9fd0a71536e req-9e6cd62d-b5e1-4497-aa57-b79edc230124 service nova] Creating event network-vif-deleted:8f9b0ab5-6735-4140-9ebc-beecce6a3499 for instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d on hv-cinder-85093 Jul 25 19:29:53.828279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-4ccf3873-8bb0-4883-9ea6-d9fd0a71536e req-9e6cd62d-b5e1-4497-aa57-b79edc230124 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071286 Jul 25 19:29:53.829650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-317a7628-d483-43ea-b715-b85ba98a070c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:53.830448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-317a7628-d483-43ea-b715-b85ba98a070c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:53.838371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-317a7628-d483-43ea-b715-b85ba98a070c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:53.839463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-317a7628-d483-43ea-b715-b85ba98a070c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:53.841281 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-317a7628-d483-43ea-b715-b85ba98a070c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:53.841908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 281/587] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:53.842185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-317a7628-d483-43ea-b715-b85ba98a070c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:53.928637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-613a345a-eda4-41f5-b444-42b2d95170a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:53.930611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-613a345a-eda4-41f5-b444-42b2d95170a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:53.943680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-613a345a-eda4-41f5-b444-42b2d95170a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:53.944428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-613a345a-eda4-41f5-b444-42b2d95170a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:53.946205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-613a345a-eda4-41f5-b444-42b2d95170a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:53.947008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-613a345a-eda4-41f5-b444-42b2d95170a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:54.077058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-317a7628-d483-43ea-b715-b85ba98a070c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:54.086977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-317a7628-d483-43ea-b715-b85ba98a070c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.261136 Jul 25 19:29:54.103422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 307/588] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:53 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:54.221334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-613a345a-eda4-41f5-b444-42b2d95170a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:54.231095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-846ba117-16e8-4fcc-9dfe-4f262cf3933b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:54.231755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-846ba117-16e8-4fcc-9dfe-4f262cf3933b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:54.243184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-613a345a-eda4-41f5-b444-42b2d95170a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1316 microversion: 2.1 time: 0.323665 Jul 25 19:29:54.243637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-846ba117-16e8-4fcc-9dfe-4f262cf3933b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:54.244782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-846ba117-16e8-4fcc-9dfe-4f262cf3933b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:54.245029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 282/589] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:53 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:54.246656 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-846ba117-16e8-4fcc-9dfe-4f262cf3933b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:54.247495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-846ba117-16e8-4fcc-9dfe-4f262cf3933b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:54.273505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-886e9b76-87e8-449a-9f12-afa44b4ad1a1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:54.274660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-886e9b76-87e8-449a-9f12-afa44b4ad1a1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:54.282341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-886e9b76-87e8-449a-9f12-afa44b4ad1a1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:54.283152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-886e9b76-87e8-449a-9f12-afa44b4ad1a1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:54.284267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-886e9b76-87e8-449a-9f12-afa44b4ad1a1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:54.285163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-886e9b76-87e8-449a-9f12-afa44b4ad1a1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:54.346450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-846ba117-16e8-4fcc-9dfe-4f262cf3933b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:54.359291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-846ba117-16e8-4fcc-9dfe-4f262cf3933b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1327 microversion: 2.1 time: 0.143153 Jul 25 19:29:54.372996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 308/590] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:54 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1327 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:54.556166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-886e9b76-87e8-449a-9f12-afa44b4ad1a1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:54.570369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-886e9b76-87e8-449a-9f12-afa44b4ad1a1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.301394 Jul 25 19:29:54.571278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 283/591] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:54 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:55.116087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-906543f3-bb8a-428e-b733-ba6d0c5d1c72 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:55.118229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-906543f3-bb8a-428e-b733-ba6d0c5d1c72 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:55.131112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-906543f3-bb8a-428e-b733-ba6d0c5d1c72 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.132360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-906543f3-bb8a-428e-b733-ba6d0c5d1c72 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.134033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-906543f3-bb8a-428e-b733-ba6d0c5d1c72 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.134716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-906543f3-bb8a-428e-b733-ba6d0c5d1c72 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.286475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-15e4ed03-486f-452e-bf04-8782df7cba70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:55.287950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-15e4ed03-486f-452e-bf04-8782df7cba70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:55.310176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15e4ed03-486f-452e-bf04-8782df7cba70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.311304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15e4ed03-486f-452e-bf04-8782df7cba70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.313270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15e4ed03-486f-452e-bf04-8782df7cba70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.315302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15e4ed03-486f-452e-bf04-8782df7cba70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.362853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-906543f3-bb8a-428e-b733-ba6d0c5d1c72 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:55.382371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-906543f3-bb8a-428e-b733-ba6d0c5d1c72 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.273901 Jul 25 19:29:55.383836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 309/592] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:55 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:55.389829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:55.391139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:55.402265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.403072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.404901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.405365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.478432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.479220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.480047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lazy-loading 'fault' on Instance uuid d25205dc-2b73-4c21-b5c9-ee7b365ac47d {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:29:55.573109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:55.597263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b625f657-e5f5-441d-a1af-e5e77c1d56c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 200 len: 1332 microversion: 2.1 time: 0.211652 Jul 25 19:29:55.599094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 310/593] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:55 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 1332 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:55.609824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4129f4be-0e66-4386-960d-9c9946b94f48 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:55.611139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4129f4be-0e66-4386-960d-9c9946b94f48 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:55.634776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4129f4be-0e66-4386-960d-9c9946b94f48 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.635406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4129f4be-0e66-4386-960d-9c9946b94f48 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.636426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4129f4be-0e66-4386-960d-9c9946b94f48 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.637156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4129f4be-0e66-4386-960d-9c9946b94f48 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.641548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-15e4ed03-486f-452e-bf04-8782df7cba70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:55.657465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-15e4ed03-486f-452e-bf04-8782df7cba70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1504 microversion: 2.1 time: 0.389410 Jul 25 19:29:55.658262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 284/594] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:55 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:55.721691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ae1d09d4-4318-4652-badf-80919def6df5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e1d33df-af4c-4066-b230-5e7f93c81a16", "device": "/dev/sdb"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:55.735793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ae1d09d4-4318-4652-badf-80919def6df5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:55.749543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae1d09d4-4318-4652-badf-80919def6df5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.751014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae1d09d4-4318-4652-badf-80919def6df5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.752823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae1d09d4-4318-4652-badf-80919def6df5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:55.754015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae1d09d4-4318-4652-badf-80919def6df5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:55.981574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4129f4be-0e66-4386-960d-9c9946b94f48 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:56.007200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4129f4be-0e66-4386-960d-9c9946b94f48 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.403337 Jul 25 19:29:56.008860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 311/595] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:55 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:56.406863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81646229-10c9-4a68-92a8-b1b974779ccf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:56.408035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81646229-10c9-4a68-92a8-b1b974779ccf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:56.418968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81646229-10c9-4a68-92a8-b1b974779ccf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:56.420004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81646229-10c9-4a68-92a8-b1b974779ccf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:56.421627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81646229-10c9-4a68-92a8-b1b974779ccf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:56.422418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81646229-10c9-4a68-92a8-b1b974779ccf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:56.704706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-81646229-10c9-4a68-92a8-b1b974779ccf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:56.716319 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81646229-10c9-4a68-92a8-b1b974779ccf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.314325 Jul 25 19:29:56.716917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 312/596] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:56 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:56.732787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd7e7650-d154-4817-a68d-3ec64a847775 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:56.733829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd7e7650-d154-4817-a68d-3ec64a847775 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:56.751147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd7e7650-d154-4817-a68d-3ec64a847775 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:56.752919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd7e7650-d154-4817-a68d-3ec64a847775 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:56.755901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd7e7650-d154-4817-a68d-3ec64a847775 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:56.756846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd7e7650-d154-4817-a68d-3ec64a847775 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:56.786096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-fd7e7650-d154-4817-a68d-3ec64a847775 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd7e7650-d154-4817-a68d-3ec64a847775 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d HTTP/1.1 Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:29:56.789612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 19:29:56.792688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'd25205dc-2b73-4c21-b5c9-ee7b365ac47d'} Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:29:56.794148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 19:29:56.796515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:29:56.798646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd7e7650-d154-4817-a68d-3ec64a847775 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:29:56.798646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fd7e7650-d154-4817-a68d-3ec64a847775 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 404 len: 111 microversion: 2.1 time: 0.068823 Jul 25 19:29:56.798646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 313/597] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:56 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:29:56.809743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e03b00b3-6820-4d06-b21d-05e6c27ab119 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '.version_select at 0x7feb084b14c0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:56.839721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e03b00b3-6820-4d06-b21d-05e6c27ab119 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925928688" status: 202 len: 0 microversion: 2.1 time: 0.038876 Jul 25 19:29:56.840322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 314/598] 10.222.0.18 () {58 vars in 1221 bytes} [Mon Jul 25 19:29:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925928688 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:29:56.868256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ae1d09d4-4318-4652-badf-80919def6df5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "POST /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.162943 Jul 25 19:29:56.869198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 285/599] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 19:29:55 2022] POST /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments => generated 194 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:57.047422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4670f67b-b4b4-4b2d-a87c-3a2a1a113a32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:57.048973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4670f67b-b4b4-4b2d-a87c-3a2a1a113a32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:57.067773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4670f67b-b4b4-4b2d-a87c-3a2a1a113a32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:57.068955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4670f67b-b4b4-4b2d-a87c-3a2a1a113a32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:57.070434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4670f67b-b4b4-4b2d-a87c-3a2a1a113a32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:57.071184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4670f67b-b4b4-4b2d-a87c-3a2a1a113a32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:57.310451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4670f67b-b4b4-4b2d-a87c-3a2a1a113a32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:57.324914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4670f67b-b4b4-4b2d-a87c-3a2a1a113a32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.279946 Jul 25 19:29:57.324914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 315/600] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:57 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:57.743916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c87fc894-1977-4d87-97b5-8b5e93f61661 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:57.745403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c87fc894-1977-4d87-97b5-8b5e93f61661 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:57.756546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c87fc894-1977-4d87-97b5-8b5e93f61661 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:57.757034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c87fc894-1977-4d87-97b5-8b5e93f61661 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:57.758244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c87fc894-1977-4d87-97b5-8b5e93f61661 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:57.758980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c87fc894-1977-4d87-97b5-8b5e93f61661 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:57.947230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-979c3f87-2874-435f-aecb-d33070f33b7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:57.948087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-979c3f87-2874-435f-aecb-d33070f33b7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:57.956615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-979c3f87-2874-435f-aecb-d33070f33b7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:57.957803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-979c3f87-2874-435f-aecb-d33070f33b7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:57.959017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-979c3f87-2874-435f-aecb-d33070f33b7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:57.960010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-979c3f87-2874-435f-aecb-d33070f33b7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:57.993331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c87fc894-1977-4d87-97b5-8b5e93f61661 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:58.013611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c87fc894-1977-4d87-97b5-8b5e93f61661 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.277367 Jul 25 19:29:58.015976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 286/601] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:57 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:58.177649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:58.193787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-979c3f87-2874-435f-aecb-d33070f33b7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lazy-loading 'services' on Instance uuid 4bcfc471-41be-4079-81d3-0cf334d03888 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:29:58.362642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-34c0e6a4-5d21-45b8-be3a-651c270d0f21 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:58.365205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-34c0e6a4-5d21-45b8-be3a-651c270d0f21 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:58.377026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34c0e6a4-5d21-45b8-be3a-651c270d0f21 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:58.378292 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34c0e6a4-5d21-45b8-be3a-651c270d0f21 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:58.381079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34c0e6a4-5d21-45b8-be3a-651c270d0f21 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:58.381945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34c0e6a4-5d21-45b8-be3a-651c270d0f21 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:58.422002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-979c3f87-2874-435f-aecb-d33070f33b7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments/20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe" status: 202 len: 0 microversion: 2.1 time: 0.479669 Jul 25 19:29:58.423577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 316/602] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 19:29:57 2022] DELETE /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments/20b5a3dc-2348-4f8e-a9b5-e8a2a9fc8efe => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 19:29:58.438879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6086c9a8-6e63-4c2e-9699-60d95391f891 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:58.443350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6086c9a8-6e63-4c2e-9699-60d95391f891 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:58.455640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6086c9a8-6e63-4c2e-9699-60d95391f891 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:58.456512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6086c9a8-6e63-4c2e-9699-60d95391f891 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:58.458839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6086c9a8-6e63-4c2e-9699-60d95391f891 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:58.459979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6086c9a8-6e63-4c2e-9699-60d95391f891 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:58.520597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6086c9a8-6e63-4c2e-9699-60d95391f891 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088177 Jul 25 19:29:58.521047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 317/603] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:29:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:29:58.530636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-8f33577a-faf9-4a88-bfce-2085f635fa83 req-96ba0197-cf52-4e1b-b43d-1731bb071c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44f6c42-c9a6-4a85-8776-d2f694f0ac8e", "name": "network-vif-plugged", "status": "completed", "tag": "7198e141-c0f4-476e-81a3-f0ece4990c63"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:58.547074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-8f33577a-faf9-4a88-bfce-2085f635fa83 req-96ba0197-cf52-4e1b-b43d-1731bb071c81 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:58.547716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-8f33577a-faf9-4a88-bfce-2085f635fa83 req-96ba0197-cf52-4e1b-b43d-1731bb071c81 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:58.569100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-8f33577a-faf9-4a88-bfce-2085f635fa83 req-96ba0197-cf52-4e1b-b43d-1731bb071c81 service nova] Creating event network-vif-plugged:7198e141-c0f4-476e-81a3-f0ece4990c63 for instance a44f6c42-c9a6-4a85-8776-d2f694f0ac8e on hv-cinder-85093 Jul 25 19:29:58.577547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-8f33577a-faf9-4a88-bfce-2085f635fa83 req-96ba0197-cf52-4e1b-b43d-1731bb071c81 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054774 Jul 25 19:29:58.578766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 318/604] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:58.664056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-34c0e6a4-5d21-45b8-be3a-651c270d0f21 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:58.680074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-34c0e6a4-5d21-45b8-be3a-651c270d0f21 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.333128 Jul 25 19:29:58.681161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 287/605] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:58 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:59.055397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee2268ba-e371-4ec4-8968-c00ad8929b49 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:59.056853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee2268ba-e371-4ec4-8968-c00ad8929b49 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:59.069866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee2268ba-e371-4ec4-8968-c00ad8929b49 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:59.070676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee2268ba-e371-4ec4-8968-c00ad8929b49 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:59.072181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee2268ba-e371-4ec4-8968-c00ad8929b49 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:59.073125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee2268ba-e371-4ec4-8968-c00ad8929b49 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:59.352175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee2268ba-e371-4ec4-8968-c00ad8929b49 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:59.365979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee2268ba-e371-4ec4-8968-c00ad8929b49 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.320282 Jul 25 19:29:59.366934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 319/606] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:59 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:59.541693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4acc25e5-3e21-4763-addb-1b41cc08dd45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:59.545756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4acc25e5-3e21-4763-addb-1b41cc08dd45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:59.558752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4acc25e5-3e21-4763-addb-1b41cc08dd45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:59.560032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4acc25e5-3e21-4763-addb-1b41cc08dd45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:59.561471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4acc25e5-3e21-4763-addb-1b41cc08dd45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:59.562228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4acc25e5-3e21-4763-addb-1b41cc08dd45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:59.623765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4acc25e5-3e21-4763-addb-1b41cc08dd45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090355 Jul 25 19:29:59.624646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 288/607] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:29:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:59.720834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d4562da1-757c-48d0-8aa9-b090b3bec078 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:59.722042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d4562da1-757c-48d0-8aa9-b090b3bec078 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:59.735165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4562da1-757c-48d0-8aa9-b090b3bec078 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:59.735851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4562da1-757c-48d0-8aa9-b090b3bec078 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:59.737137 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4562da1-757c-48d0-8aa9-b090b3bec078 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:59.737919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4562da1-757c-48d0-8aa9-b090b3bec078 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:59.986112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d4562da1-757c-48d0-8aa9-b090b3bec078 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:00.001329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d4562da1-757c-48d0-8aa9-b090b3bec078 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.288409 Jul 25 19:30:00.002131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 320/608] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:59 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:00.401244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d43748c1-e874-4fb6-bb7f-5311646d9267 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:00.402014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d43748c1-e874-4fb6-bb7f-5311646d9267 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:00.409174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d43748c1-e874-4fb6-bb7f-5311646d9267 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:00.409683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d43748c1-e874-4fb6-bb7f-5311646d9267 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:00.411376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d43748c1-e874-4fb6-bb7f-5311646d9267 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:00.411979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d43748c1-e874-4fb6-bb7f-5311646d9267 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:00.633232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d43748c1-e874-4fb6-bb7f-5311646d9267 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:00.640904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-850c4777-4fbb-44a2-a489-9849e0a9b2ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:00.643108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-850c4777-4fbb-44a2-a489-9849e0a9b2ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:00.647654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d43748c1-e874-4fb6-bb7f-5311646d9267 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1260 microversion: 2.1 time: 0.250143 Jul 25 19:30:00.648714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 289/609] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:00 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:00.654448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-850c4777-4fbb-44a2-a489-9849e0a9b2ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:00.655231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-850c4777-4fbb-44a2-a489-9849e0a9b2ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:00.657029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-850c4777-4fbb-44a2-a489-9849e0a9b2ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:00.657866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-850c4777-4fbb-44a2-a489-9849e0a9b2ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:00.721179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-850c4777-4fbb-44a2-a489-9849e0a9b2ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084014 Jul 25 19:30:00.722257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 321/610] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:01.034651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dab68a84-b8a3-4866-8972-b721bb440784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:01.037121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dab68a84-b8a3-4866-8972-b721bb440784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:01.052827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dab68a84-b8a3-4866-8972-b721bb440784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:01.054031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dab68a84-b8a3-4866-8972-b721bb440784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:01.055898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dab68a84-b8a3-4866-8972-b721bb440784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:01.056565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dab68a84-b8a3-4866-8972-b721bb440784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:01.295163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-dab68a84-b8a3-4866-8972-b721bb440784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:01.307287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dab68a84-b8a3-4866-8972-b721bb440784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.280195 Jul 25 19:30:01.308095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 290/611] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:01 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:01.683565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b443eadd-39ba-4c63-ac24-450cd5734756 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:01.684290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b443eadd-39ba-4c63-ac24-450cd5734756 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:01.691366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b443eadd-39ba-4c63-ac24-450cd5734756 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:01.691845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b443eadd-39ba-4c63-ac24-450cd5734756 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:01.692743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b443eadd-39ba-4c63-ac24-450cd5734756 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:01.693177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b443eadd-39ba-4c63-ac24-450cd5734756 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:01.740620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f1b4ad1d-e930-466c-ae17-071fc3140d8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:01.743662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f1b4ad1d-e930-466c-ae17-071fc3140d8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:01.752730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1b4ad1d-e930-466c-ae17-071fc3140d8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:01.753476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1b4ad1d-e930-466c-ae17-071fc3140d8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:01.755256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1b4ad1d-e930-466c-ae17-071fc3140d8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:01.756069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1b4ad1d-e930-466c-ae17-071fc3140d8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:01.760862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:01.802686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f1b4ad1d-e930-466c-ae17-071fc3140d8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067460 Jul 25 19:30:01.803415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 291/612] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:01.877573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b443eadd-39ba-4c63-ac24-450cd5734756 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:01.886930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b443eadd-39ba-4c63-ac24-450cd5734756 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1444 microversion: 2.1 time: 0.207339 Jul 25 19:30:01.887615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 322/613] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:01 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1444 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:30:01.908769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7c1d8448-8097-4146-a852-6a3c380479b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:01.909431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7c1d8448-8097-4146-a852-6a3c380479b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:01.912293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=82 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:01.918159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c1d8448-8097-4146-a852-6a3c380479b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:01.918604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c1d8448-8097-4146-a852-6a3c380479b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:01.919395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c1d8448-8097-4146-a852-6a3c380479b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:01.919865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c1d8448-8097-4146-a852-6a3c380479b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:02.104603 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7c1d8448-8097-4146-a852-6a3c380479b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:02.119630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7c1d8448-8097-4146-a852-6a3c380479b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1444 microversion: 2.1 time: 0.214581 Jul 25 19:30:02.120705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 292/614] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:01 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1444 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:02.345457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d540ebb5-657c-47d5-bc9c-eb2fb9e0ed7e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:02.346468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d540ebb5-657c-47d5-bc9c-eb2fb9e0ed7e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:02.357284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d540ebb5-657c-47d5-bc9c-eb2fb9e0ed7e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:02.357897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d540ebb5-657c-47d5-bc9c-eb2fb9e0ed7e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:02.358822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d540ebb5-657c-47d5-bc9c-eb2fb9e0ed7e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:02.361503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d540ebb5-657c-47d5-bc9c-eb2fb9e0ed7e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:02.673645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d540ebb5-657c-47d5-bc9c-eb2fb9e0ed7e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:02.694652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d540ebb5-657c-47d5-bc9c-eb2fb9e0ed7e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.352799 Jul 25 19:30:02.708347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 323/615] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:02 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:02.999761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0de1ce79-ca52-43f7-97a1-66ac6b16a30d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:03.005394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0de1ce79-ca52-43f7-97a1-66ac6b16a30d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:03.013891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0de1ce79-ca52-43f7-97a1-66ac6b16a30d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:03.014658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0de1ce79-ca52-43f7-97a1-66ac6b16a30d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:03.015647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0de1ce79-ca52-43f7-97a1-66ac6b16a30d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:03.016163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0de1ce79-ca52-43f7-97a1-66ac6b16a30d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:03.061770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0de1ce79-ca52-43f7-97a1-66ac6b16a30d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.246435 Jul 25 19:30:03.062666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 293/616] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:03.735776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b1b2c799-76db-402e-a689-26f5d3e87469 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:03.736844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b1b2c799-76db-402e-a689-26f5d3e87469 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:03.747499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1b2c799-76db-402e-a689-26f5d3e87469 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:03.748127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1b2c799-76db-402e-a689-26f5d3e87469 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:03.748969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1b2c799-76db-402e-a689-26f5d3e87469 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:03.749538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1b2c799-76db-402e-a689-26f5d3e87469 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:04.076321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b1d0ad71-d0f5-4321-a7ba-ae188e2d65f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:04.078622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b1d0ad71-d0f5-4321-a7ba-ae188e2d65f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:04.086795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1d0ad71-d0f5-4321-a7ba-ae188e2d65f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:04.087235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1d0ad71-d0f5-4321-a7ba-ae188e2d65f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:04.088324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1d0ad71-d0f5-4321-a7ba-ae188e2d65f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:04.088958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1d0ad71-d0f5-4321-a7ba-ae188e2d65f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:04.125472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b1d0ad71-d0f5-4321-a7ba-ae188e2d65f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053197 Jul 25 19:30:04.126352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 294/617] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:04.130638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1b2c799-76db-402e-a689-26f5d3e87469 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:04.143687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b1b2c799-76db-402e-a689-26f5d3e87469 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.414841 Jul 25 19:30:04.144876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 324/618] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:03 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:05.146047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-edd6b991-5c17-4ec6-a490-a7e0e188ceb2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:05.148450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-edd6b991-5c17-4ec6-a490-a7e0e188ceb2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:05.167578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-edd6b991-5c17-4ec6-a490-a7e0e188ceb2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:05.167578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-edd6b991-5c17-4ec6-a490-a7e0e188ceb2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:05.168940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-edd6b991-5c17-4ec6-a490-a7e0e188ceb2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:05.169431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-edd6b991-5c17-4ec6-a490-a7e0e188ceb2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:05.171126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b64d42ac-7a3d-4791-8da8-cd6b5d62f921 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:05.172677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b64d42ac-7a3d-4791-8da8-cd6b5d62f921 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:05.184389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b64d42ac-7a3d-4791-8da8-cd6b5d62f921 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:05.185316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b64d42ac-7a3d-4791-8da8-cd6b5d62f921 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:05.186378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b64d42ac-7a3d-4791-8da8-cd6b5d62f921 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:05.187059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b64d42ac-7a3d-4791-8da8-cd6b5d62f921 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:05.230234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-edd6b991-5c17-4ec6-a490-a7e0e188ceb2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091226 Jul 25 19:30:05.232767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 295/619] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:05.583021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b64d42ac-7a3d-4791-8da8-cd6b5d62f921 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:05.583926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-9fbd7549-0016-438b-b390-563650714db6 req-4b61f357-bac8-46cf-9c89-b25d02423278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44f6c42-c9a6-4a85-8776-d2f694f0ac8e", "tag": "7198e141-c0f4-476e-81a3-f0ece4990c63"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:05.592569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b64d42ac-7a3d-4791-8da8-cd6b5d62f921 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1721 microversion: 2.1 time: 0.426504 Jul 25 19:30:05.593786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 325/620] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:05 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1721 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:30:05.599982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-9fbd7549-0016-438b-b390-563650714db6 req-4b61f357-bac8-46cf-9c89-b25d02423278 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:05.600807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-9fbd7549-0016-438b-b390-563650714db6 req-4b61f357-bac8-46cf-9c89-b25d02423278 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:05.625665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-9fbd7549-0016-438b-b390-563650714db6 req-4b61f357-bac8-46cf-9c89-b25d02423278 service nova] Creating event network-changed:7198e141-c0f4-476e-81a3-f0ece4990c63 for instance a44f6c42-c9a6-4a85-8776-d2f694f0ac8e on hv-cinder-85093 Jul 25 19:30:05.631937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-9fbd7549-0016-438b-b390-563650714db6 req-4b61f357-bac8-46cf-9c89-b25d02423278 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055301 Jul 25 19:30:05.632533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 296/621] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:06.249258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15de511e-914c-4210-8904-03d0e30cb540 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:06.253229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-15de511e-914c-4210-8904-03d0e30cb540 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:06.274723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15de511e-914c-4210-8904-03d0e30cb540 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:06.276001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15de511e-914c-4210-8904-03d0e30cb540 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:06.277471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15de511e-914c-4210-8904-03d0e30cb540 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:06.278262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15de511e-914c-4210-8904-03d0e30cb540 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:06.352411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15de511e-914c-4210-8904-03d0e30cb540 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111094 Jul 25 19:30:06.353841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 326/622] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:06.637083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0b2a8848-6111-4589-a4a8-70542afd8f28 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:06.638618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0b2a8848-6111-4589-a4a8-70542afd8f28 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:06.655614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b2a8848-6111-4589-a4a8-70542afd8f28 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:06.657174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b2a8848-6111-4589-a4a8-70542afd8f28 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:06.659070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b2a8848-6111-4589-a4a8-70542afd8f28 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:06.660854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b2a8848-6111-4589-a4a8-70542afd8f28 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:07.005998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0b2a8848-6111-4589-a4a8-70542afd8f28 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:07.023868 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0b2a8848-6111-4589-a4a8-70542afd8f28 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1698 microversion: 2.1 time: 0.397320 Jul 25 19:30:07.025678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 297/623] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:06 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1698 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:07.054872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-12ecfced-12cf-4f11-921b-4a5847784098 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:07.062739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12ecfced-12cf-4f11-921b-4a5847784098 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:07.063188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12ecfced-12cf-4f11-921b-4a5847784098 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:07.122730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-12ecfced-12cf-4f11-921b-4a5847784098 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Going to try to start instance {{(pid=117951) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 19:30:07.194023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-12ecfced-12cf-4f11-921b-4a5847784098 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "POST /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/action" status: 202 len: 0 microversion: 2.1 time: 0.142384 Jul 25 19:30:07.195174 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 327/624] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 19:30:07 2022] POST /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:30:07.213816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-178bcf9c-a007-458d-ac7b-dca0635261b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:07.216196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-178bcf9c-a007-458d-ac7b-dca0635261b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:07.231913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-178bcf9c-a007-458d-ac7b-dca0635261b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:07.233484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-178bcf9c-a007-458d-ac7b-dca0635261b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:07.236596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-178bcf9c-a007-458d-ac7b-dca0635261b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:07.237790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-178bcf9c-a007-458d-ac7b-dca0635261b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:07.376397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-76e9cee6-fb9f-4d47-8657-ed66fc29ea48 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:07.383905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-76e9cee6-fb9f-4d47-8657-ed66fc29ea48 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:07.400967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76e9cee6-fb9f-4d47-8657-ed66fc29ea48 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:07.403392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76e9cee6-fb9f-4d47-8657-ed66fc29ea48 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:07.405595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76e9cee6-fb9f-4d47-8657-ed66fc29ea48 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:07.406698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76e9cee6-fb9f-4d47-8657-ed66fc29ea48 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:07.463129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-76e9cee6-fb9f-4d47-8657-ed66fc29ea48 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096668 Jul 25 19:30:07.464115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 328/625] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:07.622349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-178bcf9c-a007-458d-ac7b-dca0635261b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:07.633030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-178bcf9c-a007-458d-ac7b-dca0635261b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1707 microversion: 2.1 time: 0.432556 Jul 25 19:30:07.633618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 298/626] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:07 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1707 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:08.481705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b28e97e1-10b1-498a-9d1e-6388cc5b104d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:08.483959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b28e97e1-10b1-498a-9d1e-6388cc5b104d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:08.492439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b28e97e1-10b1-498a-9d1e-6388cc5b104d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:08.493025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b28e97e1-10b1-498a-9d1e-6388cc5b104d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:08.493939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b28e97e1-10b1-498a-9d1e-6388cc5b104d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:08.494469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b28e97e1-10b1-498a-9d1e-6388cc5b104d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:08.530210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b28e97e1-10b1-498a-9d1e-6388cc5b104d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053312 Jul 25 19:30:08.530923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 329/627] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:08.672076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-706a5cf6-e202-4c0c-bf6e-a4d60ac23b55 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:08.672856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-706a5cf6-e202-4c0c-bf6e-a4d60ac23b55 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:08.680597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-706a5cf6-e202-4c0c-bf6e-a4d60ac23b55 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:08.681046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-706a5cf6-e202-4c0c-bf6e-a4d60ac23b55 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:08.681842 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-706a5cf6-e202-4c0c-bf6e-a4d60ac23b55 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:08.682284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-706a5cf6-e202-4c0c-bf6e-a4d60ac23b55 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:08.857716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-706a5cf6-e202-4c0c-bf6e-a4d60ac23b55 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:08.868517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-706a5cf6-e202-4c0c-bf6e-a4d60ac23b55 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1707 microversion: 2.1 time: 0.201573 Jul 25 19:30:08.869373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 299/628] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:08 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1707 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:09.546902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0200233e-a8cf-474c-b225-0e2206c352e7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:09.550618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0200233e-a8cf-474c-b225-0e2206c352e7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:09.559062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0200233e-a8cf-474c-b225-0e2206c352e7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:09.559800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0200233e-a8cf-474c-b225-0e2206c352e7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:09.561051 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0200233e-a8cf-474c-b225-0e2206c352e7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:09.561621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0200233e-a8cf-474c-b225-0e2206c352e7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:09.610373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0200233e-a8cf-474c-b225-0e2206c352e7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066356 Jul 25 19:30:09.610373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 330/629] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:09.892430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b71c361c-eeb2-4416-b1fc-46714900be65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:09.893164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b71c361c-eeb2-4416-b1fc-46714900be65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:09.901469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b71c361c-eeb2-4416-b1fc-46714900be65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:09.901921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b71c361c-eeb2-4416-b1fc-46714900be65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:09.902843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b71c361c-eeb2-4416-b1fc-46714900be65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:09.903290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b71c361c-eeb2-4416-b1fc-46714900be65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:10.073201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b71c361c-eeb2-4416-b1fc-46714900be65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:10.082314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b71c361c-eeb2-4416-b1fc-46714900be65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1711 microversion: 2.1 time: 0.194206 Jul 25 19:30:10.083235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 300/630] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:09 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1711 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:30:10.626438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ebf78b0c-eb4d-46b0-9ae8-c61a1e5ddd49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:10.629007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ebf78b0c-eb4d-46b0-9ae8-c61a1e5ddd49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:10.636629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebf78b0c-eb4d-46b0-9ae8-c61a1e5ddd49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:10.637407 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebf78b0c-eb4d-46b0-9ae8-c61a1e5ddd49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:10.638383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebf78b0c-eb4d-46b0-9ae8-c61a1e5ddd49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:10.638914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebf78b0c-eb4d-46b0-9ae8-c61a1e5ddd49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:10.678345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ebf78b0c-eb4d-46b0-9ae8-c61a1e5ddd49 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057767 Jul 25 19:30:10.678937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 331/631] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:11.703795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9320e0da-6500-4cf6-8fc4-966769df5b71 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:11.706277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9320e0da-6500-4cf6-8fc4-966769df5b71 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:11.714617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9320e0da-6500-4cf6-8fc4-966769df5b71 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:11.715079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9320e0da-6500-4cf6-8fc4-966769df5b71 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:11.715991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9320e0da-6500-4cf6-8fc4-966769df5b71 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:11.716599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9320e0da-6500-4cf6-8fc4-966769df5b71 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:11.764126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9320e0da-6500-4cf6-8fc4-966769df5b71 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073280 Jul 25 19:30:11.765409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 301/632] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:11 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:12.781880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b65eeea-ebd1-4c77-a8c8-32a87289fa61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:12.785132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2b65eeea-ebd1-4c77-a8c8-32a87289fa61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:12.795965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b65eeea-ebd1-4c77-a8c8-32a87289fa61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:12.796761 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b65eeea-ebd1-4c77-a8c8-32a87289fa61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:12.798207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b65eeea-ebd1-4c77-a8c8-32a87289fa61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:12.799002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b65eeea-ebd1-4c77-a8c8-32a87289fa61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:12.819987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:12.844997 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2b65eeea-ebd1-4c77-a8c8-32a87289fa61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069803 Jul 25 19:30:12.845607 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 332/633] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:13.862260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b1c7ea6d-c3f7-49de-98c9-f5c5d5fd93a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:13.867101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b1c7ea6d-c3f7-49de-98c9-f5c5d5fd93a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:13.879854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1c7ea6d-c3f7-49de-98c9-f5c5d5fd93a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:13.880736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1c7ea6d-c3f7-49de-98c9-f5c5d5fd93a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:13.882055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1c7ea6d-c3f7-49de-98c9-f5c5d5fd93a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:13.882788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1c7ea6d-c3f7-49de-98c9-f5c5d5fd93a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:13.941048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b1c7ea6d-c3f7-49de-98c9-f5c5d5fd93a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085863 Jul 25 19:30:13.943401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 302/634] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:14.960270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e0363be-c11a-4007-afd1-ceb032df16a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:14.963297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e0363be-c11a-4007-afd1-ceb032df16a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:14.968927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:14.976615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e0363be-c11a-4007-afd1-ceb032df16a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:14.977181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e0363be-c11a-4007-afd1-ceb032df16a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:14.978048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e0363be-c11a-4007-afd1-ceb032df16a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:14.978608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e0363be-c11a-4007-afd1-ceb032df16a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:15.017231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e0363be-c11a-4007-afd1-ceb032df16a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062627 Jul 25 19:30:15.017911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 333/635] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:14 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:16.032950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4731e88d-61bd-416c-a082-cda3010cdf7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:16.035191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4731e88d-61bd-416c-a082-cda3010cdf7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:16.043628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4731e88d-61bd-416c-a082-cda3010cdf7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:16.044230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4731e88d-61bd-416c-a082-cda3010cdf7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:16.045084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4731e88d-61bd-416c-a082-cda3010cdf7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:16.045686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4731e88d-61bd-416c-a082-cda3010cdf7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:16.083124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4731e88d-61bd-416c-a082-cda3010cdf7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054461 Jul 25 19:30:16.085131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 303/636] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:17.100562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4020a8bb-0da2-4b1b-b5c7-743e9fbb28ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:17.104066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4020a8bb-0da2-4b1b-b5c7-743e9fbb28ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:17.115767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4020a8bb-0da2-4b1b-b5c7-743e9fbb28ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:17.116634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4020a8bb-0da2-4b1b-b5c7-743e9fbb28ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:17.117717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4020a8bb-0da2-4b1b-b5c7-743e9fbb28ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:17.118205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4020a8bb-0da2-4b1b-b5c7-743e9fbb28ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:17.175479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4020a8bb-0da2-4b1b-b5c7-743e9fbb28ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080025 Jul 25 19:30:17.180516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 334/637] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:18.191386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6b3f772f-68ea-49aa-b676-5c7921250e34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:18.194314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6b3f772f-68ea-49aa-b676-5c7921250e34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:18.204826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b3f772f-68ea-49aa-b676-5c7921250e34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:18.205318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b3f772f-68ea-49aa-b676-5c7921250e34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:18.206134 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b3f772f-68ea-49aa-b676-5c7921250e34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:18.206581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b3f772f-68ea-49aa-b676-5c7921250e34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:18.254578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6b3f772f-68ea-49aa-b676-5c7921250e34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067140 Jul 25 19:30:18.255201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 304/638] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:19.272827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f984d1d2-8fdf-4ba7-9dff-be5eb1ff0785 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:19.276830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f984d1d2-8fdf-4ba7-9dff-be5eb1ff0785 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:19.289212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f984d1d2-8fdf-4ba7-9dff-be5eb1ff0785 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:19.290016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f984d1d2-8fdf-4ba7-9dff-be5eb1ff0785 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:19.291488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f984d1d2-8fdf-4ba7-9dff-be5eb1ff0785 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:19.292314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f984d1d2-8fdf-4ba7-9dff-be5eb1ff0785 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:19.362772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f984d1d2-8fdf-4ba7-9dff-be5eb1ff0785 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096395 Jul 25 19:30:19.363812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 335/639] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:20.380942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b3acf230-65ad-4f7a-8710-2a7cdd1e0e0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:20.384507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b3acf230-65ad-4f7a-8710-2a7cdd1e0e0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:20.396921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3acf230-65ad-4f7a-8710-2a7cdd1e0e0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:20.397683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3acf230-65ad-4f7a-8710-2a7cdd1e0e0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:20.399018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3acf230-65ad-4f7a-8710-2a7cdd1e0e0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:20.399795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3acf230-65ad-4f7a-8710-2a7cdd1e0e0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:20.456207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b3acf230-65ad-4f7a-8710-2a7cdd1e0e0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080975 Jul 25 19:30:20.457114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 305/640] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:21.478674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4847e556-399d-4395-8737-f5b4eb5b5db9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:21.482695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4847e556-399d-4395-8737-f5b4eb5b5db9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:21.496110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4847e556-399d-4395-8737-f5b4eb5b5db9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:21.496937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4847e556-399d-4395-8737-f5b4eb5b5db9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:21.498314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4847e556-399d-4395-8737-f5b4eb5b5db9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:21.498997 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4847e556-399d-4395-8737-f5b4eb5b5db9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:21.561880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4847e556-399d-4395-8737-f5b4eb5b5db9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090349 Jul 25 19:30:21.562876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 336/641] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:22.590012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-603d6c52-6f4e-4ffa-952b-42c9db6767b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:22.594069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-603d6c52-6f4e-4ffa-952b-42c9db6767b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:22.608147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-603d6c52-6f4e-4ffa-952b-42c9db6767b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:22.608658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-603d6c52-6f4e-4ffa-952b-42c9db6767b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:22.609585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-603d6c52-6f4e-4ffa-952b-42c9db6767b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:22.610278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-603d6c52-6f4e-4ffa-952b-42c9db6767b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:22.666419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-603d6c52-6f4e-4ffa-952b-42c9db6767b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084664 Jul 25 19:30:22.667376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 306/642] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:23.687092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5b39945d-8410-4077-a1fa-3a87bc609907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:23.690102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5b39945d-8410-4077-a1fa-3a87bc609907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:23.703265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b39945d-8410-4077-a1fa-3a87bc609907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:23.703979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b39945d-8410-4077-a1fa-3a87bc609907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:23.705066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b39945d-8410-4077-a1fa-3a87bc609907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:23.705663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b39945d-8410-4077-a1fa-3a87bc609907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:23.762018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5b39945d-8410-4077-a1fa-3a87bc609907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081075 Jul 25 19:30:23.771102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 337/643] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:24.780667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aac75ed6-55e1-4d21-9a89-856a7a535e2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:24.783286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aac75ed6-55e1-4d21-9a89-856a7a535e2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:24.792262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aac75ed6-55e1-4d21-9a89-856a7a535e2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:24.792867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aac75ed6-55e1-4d21-9a89-856a7a535e2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:24.793891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aac75ed6-55e1-4d21-9a89-856a7a535e2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:24.794373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aac75ed6-55e1-4d21-9a89-856a7a535e2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:24.840088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aac75ed6-55e1-4d21-9a89-856a7a535e2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064257 Jul 25 19:30:24.840831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 307/644] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:25.854571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb2acf0a-9008-43c0-b76a-e445524407d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:25.856910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb2acf0a-9008-43c0-b76a-e445524407d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:25.866031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb2acf0a-9008-43c0-b76a-e445524407d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:25.866573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb2acf0a-9008-43c0-b76a-e445524407d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:25.867467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb2acf0a-9008-43c0-b76a-e445524407d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:25.868201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb2acf0a-9008-43c0-b76a-e445524407d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:25.910490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb2acf0a-9008-43c0-b76a-e445524407d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059833 Jul 25 19:30:25.911552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 338/645] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:26.925059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6131cbfb-c89c-44c6-99cc-cdcda6640148 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:26.928452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6131cbfb-c89c-44c6-99cc-cdcda6640148 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:26.937607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6131cbfb-c89c-44c6-99cc-cdcda6640148 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:26.938187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6131cbfb-c89c-44c6-99cc-cdcda6640148 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:26.939284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6131cbfb-c89c-44c6-99cc-cdcda6640148 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:26.939854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6131cbfb-c89c-44c6-99cc-cdcda6640148 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:26.959589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:26.982894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6131cbfb-c89c-44c6-99cc-cdcda6640148 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062562 Jul 25 19:30:26.983488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 308/646] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:28.000449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6110a64e-2e1c-4a47-8d56-8595f1b3ba46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:28.004489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6110a64e-2e1c-4a47-8d56-8595f1b3ba46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:28.016818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6110a64e-2e1c-4a47-8d56-8595f1b3ba46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:28.017658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6110a64e-2e1c-4a47-8d56-8595f1b3ba46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:28.019318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6110a64e-2e1c-4a47-8d56-8595f1b3ba46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:28.020747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6110a64e-2e1c-4a47-8d56-8595f1b3ba46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:28.078304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6110a64e-2e1c-4a47-8d56-8595f1b3ba46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085029 Jul 25 19:30:28.079357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 339/647] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:28.148641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cc3517d9-d7a4-4498-83bb-24166458a912 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a074a34-8803-406b-836b-5e6d8da96026"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:28.151864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cc3517d9-d7a4-4498-83bb-24166458a912 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:28.159075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc3517d9-d7a4-4498-83bb-24166458a912 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:28.159716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc3517d9-d7a4-4498-83bb-24166458a912 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:28.160830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc3517d9-d7a4-4498-83bb-24166458a912 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:28.161535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc3517d9-d7a4-4498-83bb-24166458a912 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:28.640657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cc3517d9-d7a4-4498-83bb-24166458a912 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "POST /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641989 Jul 25 19:30:28.641582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 309/648] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 19:30:27 2022] POST /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:29.100593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-33739b9c-6780-4d90-82f6-89c168b3feb1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:29.104294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-33739b9c-6780-4d90-82f6-89c168b3feb1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:29.124404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33739b9c-6780-4d90-82f6-89c168b3feb1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:29.125169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33739b9c-6780-4d90-82f6-89c168b3feb1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:29.126536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33739b9c-6780-4d90-82f6-89c168b3feb1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:29.127328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33739b9c-6780-4d90-82f6-89c168b3feb1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:29.166871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-33739b9c-6780-4d90-82f6-89c168b3feb1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074625 Jul 25 19:30:29.168163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 340/649] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:29 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:30.187991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-47fceb34-38c5-4fbc-86fb-b5cc5eebfca4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:30.193115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-47fceb34-38c5-4fbc-86fb-b5cc5eebfca4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:30.205419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47fceb34-38c5-4fbc-86fb-b5cc5eebfca4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:30.206172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47fceb34-38c5-4fbc-86fb-b5cc5eebfca4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:30.208081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47fceb34-38c5-4fbc-86fb-b5cc5eebfca4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:30.209936 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47fceb34-38c5-4fbc-86fb-b5cc5eebfca4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:30.274430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-47fceb34-38c5-4fbc-86fb-b5cc5eebfca4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095510 Jul 25 19:30:30.275474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 310/650] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:31.291410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1a4af55-5232-4b0d-a53e-0d46f0e46b3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:31.294152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c1a4af55-5232-4b0d-a53e-0d46f0e46b3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:31.302654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1a4af55-5232-4b0d-a53e-0d46f0e46b3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:31.303396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1a4af55-5232-4b0d-a53e-0d46f0e46b3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:31.304895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1a4af55-5232-4b0d-a53e-0d46f0e46b3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:31.305373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1a4af55-5232-4b0d-a53e-0d46f0e46b3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:31.344958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c1a4af55-5232-4b0d-a53e-0d46f0e46b3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058126 Jul 25 19:30:31.345758 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 341/651] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:32.367100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-813518fa-950c-4581-b704-5b926bc43fe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:32.370812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-813518fa-950c-4581-b704-5b926bc43fe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:32.374727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=38 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:32.384728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-813518fa-950c-4581-b704-5b926bc43fe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:32.385511 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-813518fa-950c-4581-b704-5b926bc43fe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:32.386843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-813518fa-950c-4581-b704-5b926bc43fe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:32.387601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-813518fa-950c-4581-b704-5b926bc43fe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:32.448782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-813518fa-950c-4581-b704-5b926bc43fe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089531 Jul 25 19:30:32.449848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 311/652] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:33.466344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-65b8fc27-9f69-4bef-bc0c-cf04fc56b582 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:33.469150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-65b8fc27-9f69-4bef-bc0c-cf04fc56b582 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:33.482864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65b8fc27-9f69-4bef-bc0c-cf04fc56b582 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:33.483678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65b8fc27-9f69-4bef-bc0c-cf04fc56b582 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:33.485082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65b8fc27-9f69-4bef-bc0c-cf04fc56b582 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:33.485865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65b8fc27-9f69-4bef-bc0c-cf04fc56b582 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:33.550741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-65b8fc27-9f69-4bef-bc0c-cf04fc56b582 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087698 Jul 25 19:30:33.552702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 342/653] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:34.569761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-596fd52f-e6d8-42bb-9b98-a034bf8f5f27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:34.572435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-596fd52f-e6d8-42bb-9b98-a034bf8f5f27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:34.583060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-596fd52f-e6d8-42bb-9b98-a034bf8f5f27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:34.583755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-596fd52f-e6d8-42bb-9b98-a034bf8f5f27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:34.585074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-596fd52f-e6d8-42bb-9b98-a034bf8f5f27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:34.586230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-596fd52f-e6d8-42bb-9b98-a034bf8f5f27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:34.639668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-596fd52f-e6d8-42bb-9b98-a034bf8f5f27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076034 Jul 25 19:30:34.640623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 312/654] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:35.657983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-64828e69-21ba-4129-82f3-aaf68c0fecc2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:35.662552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-64828e69-21ba-4129-82f3-aaf68c0fecc2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:35.675076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64828e69-21ba-4129-82f3-aaf68c0fecc2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:35.675901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64828e69-21ba-4129-82f3-aaf68c0fecc2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:35.677370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64828e69-21ba-4129-82f3-aaf68c0fecc2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:35.678131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64828e69-21ba-4129-82f3-aaf68c0fecc2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:35.744022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-64828e69-21ba-4129-82f3-aaf68c0fecc2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092483 Jul 25 19:30:35.745130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 343/655] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:35 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:36.760907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-714e2725-9351-480b-857e-fef794898644 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:36.763933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-714e2725-9351-480b-857e-fef794898644 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:36.774554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714e2725-9351-480b-857e-fef794898644 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:36.775150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714e2725-9351-480b-857e-fef794898644 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:36.776158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714e2725-9351-480b-857e-fef794898644 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:36.776692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714e2725-9351-480b-857e-fef794898644 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:36.815959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-714e2725-9351-480b-857e-fef794898644 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059253 Jul 25 19:30:36.817193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 313/656] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:37.832197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-64c913e4-3034-43f4-b989-5b139d4b2639 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:37.835699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-64c913e4-3034-43f4-b989-5b139d4b2639 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:37.843103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64c913e4-3034-43f4-b989-5b139d4b2639 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:37.843890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64c913e4-3034-43f4-b989-5b139d4b2639 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:37.845264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64c913e4-3034-43f4-b989-5b139d4b2639 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:37.845724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64c913e4-3034-43f4-b989-5b139d4b2639 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:37.884100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-64c913e4-3034-43f4-b989-5b139d4b2639 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056525 Jul 25 19:30:37.884695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 344/657] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:38.905067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-936086df-b448-439c-aa0e-24ec0fa5d315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:38.909882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-936086df-b448-439c-aa0e-24ec0fa5d315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:38.923159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-936086df-b448-439c-aa0e-24ec0fa5d315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:38.924028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-936086df-b448-439c-aa0e-24ec0fa5d315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:38.925442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-936086df-b448-439c-aa0e-24ec0fa5d315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:38.927440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-936086df-b448-439c-aa0e-24ec0fa5d315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:38.983869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-936086df-b448-439c-aa0e-24ec0fa5d315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086173 Jul 25 19:30:38.985133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 314/658] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:40.001457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-19e4caba-26c9-4042-b2fa-5a036cec70fd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:40.003850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-19e4caba-26c9-4042-b2fa-5a036cec70fd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:40.011278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19e4caba-26c9-4042-b2fa-5a036cec70fd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:40.011784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19e4caba-26c9-4042-b2fa-5a036cec70fd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:40.012614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19e4caba-26c9-4042-b2fa-5a036cec70fd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:40.013227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19e4caba-26c9-4042-b2fa-5a036cec70fd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:40.070338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-19e4caba-26c9-4042-b2fa-5a036cec70fd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072287 Jul 25 19:30:40.071487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 345/659] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:41.088931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-67704c26-f9bf-43eb-9b5a-4be8c0b3fed7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:41.092378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-67704c26-f9bf-43eb-9b5a-4be8c0b3fed7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:41.103383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-67704c26-f9bf-43eb-9b5a-4be8c0b3fed7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:41.104061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-67704c26-f9bf-43eb-9b5a-4be8c0b3fed7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:41.105005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-67704c26-f9bf-43eb-9b5a-4be8c0b3fed7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:41.105683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-67704c26-f9bf-43eb-9b5a-4be8c0b3fed7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:41.154282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-67704c26-f9bf-43eb-9b5a-4be8c0b3fed7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071298 Jul 25 19:30:41.155095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 315/660] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:42.170933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e02f2734-87c5-4807-8f0e-a4ae03f5b337 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:42.175108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e02f2734-87c5-4807-8f0e-a4ae03f5b337 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:42.189678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e02f2734-87c5-4807-8f0e-a4ae03f5b337 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:42.190431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e02f2734-87c5-4807-8f0e-a4ae03f5b337 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:42.191805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e02f2734-87c5-4807-8f0e-a4ae03f5b337 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:42.192433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e02f2734-87c5-4807-8f0e-a4ae03f5b337 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:42.235965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e02f2734-87c5-4807-8f0e-a4ae03f5b337 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070512 Jul 25 19:30:42.237890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 346/661] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:42 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:43.251672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d5173270-d45e-4530-9fd6-a484ae5a247f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:43.255147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d5173270-d45e-4530-9fd6-a484ae5a247f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:43.263074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5173270-d45e-4530-9fd6-a484ae5a247f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:43.263826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5173270-d45e-4530-9fd6-a484ae5a247f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:43.264805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5173270-d45e-4530-9fd6-a484ae5a247f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:43.265467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5173270-d45e-4530-9fd6-a484ae5a247f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:43.311137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d5173270-d45e-4530-9fd6-a484ae5a247f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065521 Jul 25 19:30:43.312040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 316/662] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:44.329900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a9193b8e-71f3-445e-b427-b715190453f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:44.335087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a9193b8e-71f3-445e-b427-b715190453f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:44.345389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9193b8e-71f3-445e-b427-b715190453f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:44.345973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9193b8e-71f3-445e-b427-b715190453f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:44.347294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9193b8e-71f3-445e-b427-b715190453f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:44.348773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9193b8e-71f3-445e-b427-b715190453f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:44.391490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a9193b8e-71f3-445e-b427-b715190453f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067796 Jul 25 19:30:44.392291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 347/663] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:45.408661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b220c793-cb5b-496d-ad8f-d974550969a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:45.412481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b220c793-cb5b-496d-ad8f-d974550969a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:45.420821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b220c793-cb5b-496d-ad8f-d974550969a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:45.421412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b220c793-cb5b-496d-ad8f-d974550969a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:45.422477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b220c793-cb5b-496d-ad8f-d974550969a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:45.423045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b220c793-cb5b-496d-ad8f-d974550969a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:45.468672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b220c793-cb5b-496d-ad8f-d974550969a7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066493 Jul 25 19:30:45.469684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 317/664] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:46.488422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81e818af-61ae-4b87-aef9-859a0fb07c61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:46.493861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81e818af-61ae-4b87-aef9-859a0fb07c61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:46.498407 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:46.509785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81e818af-61ae-4b87-aef9-859a0fb07c61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:46.510561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81e818af-61ae-4b87-aef9-859a0fb07c61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:46.512011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81e818af-61ae-4b87-aef9-859a0fb07c61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:46.512802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81e818af-61ae-4b87-aef9-859a0fb07c61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:46.521214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=94 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:46.573263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81e818af-61ae-4b87-aef9-859a0fb07c61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092343 Jul 25 19:30:46.574118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 348/665] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:47.591076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ec2daa39-b6b9-4b5b-aa15-6f4378567d40 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:47.593789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ec2daa39-b6b9-4b5b-aa15-6f4378567d40 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:47.603598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec2daa39-b6b9-4b5b-aa15-6f4378567d40 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:47.604209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec2daa39-b6b9-4b5b-aa15-6f4378567d40 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:47.605457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec2daa39-b6b9-4b5b-aa15-6f4378567d40 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:47.606004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec2daa39-b6b9-4b5b-aa15-6f4378567d40 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:47.657074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ec2daa39-b6b9-4b5b-aa15-6f4378567d40 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070773 Jul 25 19:30:47.658106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 318/666] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:48.678354 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c53073a-b623-43c6-b595-d67bac28a47d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:48.682243 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7c53073a-b623-43c6-b595-d67bac28a47d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:48.695583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c53073a-b623-43c6-b595-d67bac28a47d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:48.696213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c53073a-b623-43c6-b595-d67bac28a47d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:48.697598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c53073a-b623-43c6-b595-d67bac28a47d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:48.698391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c53073a-b623-43c6-b595-d67bac28a47d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:48.756497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c53073a-b623-43c6-b595-d67bac28a47d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085635 Jul 25 19:30:48.757630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 349/667] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:49.774902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ce88ebff-15c8-4ebc-a519-667e7fd76e7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:49.777715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ce88ebff-15c8-4ebc-a519-667e7fd76e7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:49.788971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce88ebff-15c8-4ebc-a519-667e7fd76e7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:49.789794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce88ebff-15c8-4ebc-a519-667e7fd76e7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:49.791371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce88ebff-15c8-4ebc-a519-667e7fd76e7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:49.792211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce88ebff-15c8-4ebc-a519-667e7fd76e7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:49.856958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ce88ebff-15c8-4ebc-a519-667e7fd76e7d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086854 Jul 25 19:30:49.858058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 319/668] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:50.879831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c2638bc-13e2-4ceb-ac37-bb19a1af6b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:50.883785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7c2638bc-13e2-4ceb-ac37-bb19a1af6b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:50.897530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c2638bc-13e2-4ceb-ac37-bb19a1af6b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:50.898290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c2638bc-13e2-4ceb-ac37-bb19a1af6b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:50.900020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c2638bc-13e2-4ceb-ac37-bb19a1af6b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:50.900832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c2638bc-13e2-4ceb-ac37-bb19a1af6b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:50.972610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c2638bc-13e2-4ceb-ac37-bb19a1af6b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100774 Jul 25 19:30:50.975825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 350/669] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:51.992320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3581bdfe-e4e8-4e5a-a3e0-4766415c5811 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:51.996162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3581bdfe-e4e8-4e5a-a3e0-4766415c5811 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:52.009502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3581bdfe-e4e8-4e5a-a3e0-4766415c5811 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:52.010343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3581bdfe-e4e8-4e5a-a3e0-4766415c5811 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:52.011830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3581bdfe-e4e8-4e5a-a3e0-4766415c5811 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:52.012628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3581bdfe-e4e8-4e5a-a3e0-4766415c5811 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:52.057324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3581bdfe-e4e8-4e5a-a3e0-4766415c5811 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073521 Jul 25 19:30:52.058101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 320/670] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:53.076308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a50e1477-d696-4cee-9168-98beba42b387 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:53.079834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a50e1477-d696-4cee-9168-98beba42b387 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:53.091292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a50e1477-d696-4cee-9168-98beba42b387 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:53.092089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a50e1477-d696-4cee-9168-98beba42b387 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:53.093324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a50e1477-d696-4cee-9168-98beba42b387 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:53.094099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a50e1477-d696-4cee-9168-98beba42b387 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:53.144110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a50e1477-d696-4cee-9168-98beba42b387 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074513 Jul 25 19:30:53.144718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 351/671] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:54.164154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-045a68e7-65f7-45ca-a91b-c21544815dfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:54.166396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-045a68e7-65f7-45ca-a91b-c21544815dfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:54.177106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-045a68e7-65f7-45ca-a91b-c21544815dfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:54.177937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-045a68e7-65f7-45ca-a91b-c21544815dfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:54.179326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-045a68e7-65f7-45ca-a91b-c21544815dfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:54.180095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-045a68e7-65f7-45ca-a91b-c21544815dfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:54.221838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-045a68e7-65f7-45ca-a91b-c21544815dfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064784 Jul 25 19:30:54.222564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 321/672] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:55.237414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e8b295d-6cd7-4936-874a-85f95f216432 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:55.240294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e8b295d-6cd7-4936-874a-85f95f216432 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:55.246889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e8b295d-6cd7-4936-874a-85f95f216432 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:55.247347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e8b295d-6cd7-4936-874a-85f95f216432 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:55.248251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e8b295d-6cd7-4936-874a-85f95f216432 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:55.248877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e8b295d-6cd7-4936-874a-85f95f216432 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:55.302751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e8b295d-6cd7-4936-874a-85f95f216432 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069943 Jul 25 19:30:55.303441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 352/673] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:56.320296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a75333c9-f09b-4690-8d80-6ec240931a8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:56.323079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a75333c9-f09b-4690-8d80-6ec240931a8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:56.332084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a75333c9-f09b-4690-8d80-6ec240931a8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:56.333109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a75333c9-f09b-4690-8d80-6ec240931a8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:56.333928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a75333c9-f09b-4690-8d80-6ec240931a8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:56.334377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a75333c9-f09b-4690-8d80-6ec240931a8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:56.384430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a75333c9-f09b-4690-8d80-6ec240931a8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069325 Jul 25 19:30:56.385298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 322/674] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:57.400266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3bf1f8d9-60bf-4527-9673-42b97fe5c0d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:57.402507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3bf1f8d9-60bf-4527-9673-42b97fe5c0d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:57.411093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bf1f8d9-60bf-4527-9673-42b97fe5c0d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:57.411432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bf1f8d9-60bf-4527-9673-42b97fe5c0d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:57.412515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bf1f8d9-60bf-4527-9673-42b97fe5c0d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:57.413088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bf1f8d9-60bf-4527-9673-42b97fe5c0d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:57.451375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3bf1f8d9-60bf-4527-9673-42b97fe5c0d1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056553 Jul 25 19:30:57.452079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 353/675] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:58.328402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-de3acbcf-fa12-409a-b5d8-382a096eb8e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:58.329334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-de3acbcf-fa12-409a-b5d8-382a096eb8e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:58.341024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3acbcf-fa12-409a-b5d8-382a096eb8e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:58.341817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3acbcf-fa12-409a-b5d8-382a096eb8e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:58.343220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3acbcf-fa12-409a-b5d8-382a096eb8e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:58.344070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3acbcf-fa12-409a-b5d8-382a096eb8e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:58.352317 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:58.391346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-de3acbcf-fa12-409a-b5d8-382a096eb8e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments/ceb03705-2541-4b1a-9f7a-a2a9a3ab13fc" status: 200 len: 194 microversion: 2.20 time: 0.249248 Jul 25 19:30:58.391996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 323/676] 10.222.0.18 () {60 vars in 1454 bytes} [Mon Jul 25 19:30:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments/ceb03705-2541-4b1a-9f7a-a2a9a3ab13fc => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:30:58.470621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-11b240ed-65f7-4f98-9e2e-66453c491da0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:58.476117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-11b240ed-65f7-4f98-9e2e-66453c491da0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:58.484140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e22a218f-79e1-49af-b34d-290ac3740a44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:58.484733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e22a218f-79e1-49af-b34d-290ac3740a44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:58.493849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b240ed-65f7-4f98-9e2e-66453c491da0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:58.494653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b240ed-65f7-4f98-9e2e-66453c491da0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:58.496173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b240ed-65f7-4f98-9e2e-66453c491da0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:58.496981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b240ed-65f7-4f98-9e2e-66453c491da0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:58.497319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e22a218f-79e1-49af-b34d-290ac3740a44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:58.497669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e22a218f-79e1-49af-b34d-290ac3740a44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:58.498649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e22a218f-79e1-49af-b34d-290ac3740a44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:58.499307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e22a218f-79e1-49af-b34d-290ac3740a44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:58.560719 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-11b240ed-65f7-4f98-9e2e-66453c491da0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098758 Jul 25 19:30:58.566489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 354/677] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:58.647707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-e22a218f-79e1-49af-b34d-290ac3740a44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lazy-loading 'services' on Instance uuid 1007369a-dd3c-4837-95f4-e8326d600031 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:30:58.771210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e22a218f-79e1-49af-b34d-290ac3740a44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments/ceb03705-2541-4b1a-9f7a-a2a9a3ab13fc" status: 202 len: 0 microversion: 2.20 time: 0.291171 Jul 25 19:30:58.772110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 324/678] 10.222.0.18 () {60 vars in 1457 bytes} [Mon Jul 25 19:30:58 2022] DELETE /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments/ceb03705-2541-4b1a-9f7a-a2a9a3ab13fc => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:30:58.781457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7ba58b64-c806-4c21-993f-543a4b49dd9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:58.783936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7ba58b64-c806-4c21-993f-543a4b49dd9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:58.795431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ba58b64-c806-4c21-993f-543a4b49dd9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:58.796256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ba58b64-c806-4c21-993f-543a4b49dd9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:58.797691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ba58b64-c806-4c21-993f-543a4b49dd9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:58.798498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ba58b64-c806-4c21-993f-543a4b49dd9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:58.862318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7ba58b64-c806-4c21-993f-543a4b49dd9b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084491 Jul 25 19:30:58.863213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 355/679] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:30:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:30:59.579061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-be02811e-1722-4b9b-95f6-2d01aca60d5f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:59.583822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-be02811e-1722-4b9b-95f6-2d01aca60d5f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:59.596530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be02811e-1722-4b9b-95f6-2d01aca60d5f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:59.597351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be02811e-1722-4b9b-95f6-2d01aca60d5f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:59.599423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be02811e-1722-4b9b-95f6-2d01aca60d5f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:59.600277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be02811e-1722-4b9b-95f6-2d01aca60d5f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:59.660344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-be02811e-1722-4b9b-95f6-2d01aca60d5f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088691 Jul 25 19:30:59.662345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 325/680] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:30:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:59.876935 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6d11f9c6-c69b-456b-91c9-15ba52bc4ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:59.880561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d11f9c6-c69b-456b-91c9-15ba52bc4ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:59.888922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d11f9c6-c69b-456b-91c9-15ba52bc4ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:59.889524 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d11f9c6-c69b-456b-91c9-15ba52bc4ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:59.890435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d11f9c6-c69b-456b-91c9-15ba52bc4ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:59.890974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d11f9c6-c69b-456b-91c9-15ba52bc4ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:59.934696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6d11f9c6-c69b-456b-91c9-15ba52bc4ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062236 Jul 25 19:30:59.935619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 356/681] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:30:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:00.675036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a7461f3e-ea21-4870-bbf0-4dd99842f4c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:00.678498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a7461f3e-ea21-4870-bbf0-4dd99842f4c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:00.686773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7461f3e-ea21-4870-bbf0-4dd99842f4c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:00.687227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7461f3e-ea21-4870-bbf0-4dd99842f4c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:00.688051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7461f3e-ea21-4870-bbf0-4dd99842f4c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:00.688492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7461f3e-ea21-4870-bbf0-4dd99842f4c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:00.730200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a7461f3e-ea21-4870-bbf0-4dd99842f4c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059416 Jul 25 19:31:00.730804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 326/682] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:00.950533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-10983d86-dd8b-42de-ba0d-6a3eedd2937c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:00.952921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-10983d86-dd8b-42de-ba0d-6a3eedd2937c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:00.961034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10983d86-dd8b-42de-ba0d-6a3eedd2937c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:00.961482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10983d86-dd8b-42de-ba0d-6a3eedd2937c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:00.962265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10983d86-dd8b-42de-ba0d-6a3eedd2937c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:00.962703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10983d86-dd8b-42de-ba0d-6a3eedd2937c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:00.996974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-10983d86-dd8b-42de-ba0d-6a3eedd2937c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050556 Jul 25 19:31:00.997570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 357/683] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:01.743957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9806da86-90b8-40a2-a33b-2263291f41ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:01.746799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9806da86-90b8-40a2-a33b-2263291f41ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:01.755190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9806da86-90b8-40a2-a33b-2263291f41ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:01.755545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9806da86-90b8-40a2-a33b-2263291f41ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:01.756636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9806da86-90b8-40a2-a33b-2263291f41ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:01.757070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9806da86-90b8-40a2-a33b-2263291f41ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:01.820252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9806da86-90b8-40a2-a33b-2263291f41ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081068 Jul 25 19:31:01.821327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 327/684] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:02.013763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2423da19-1572-4f08-bdc0-25df5ed1a75d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:02.016421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2423da19-1572-4f08-bdc0-25df5ed1a75d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:02.027576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2423da19-1572-4f08-bdc0-25df5ed1a75d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:02.028162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2423da19-1572-4f08-bdc0-25df5ed1a75d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:02.029076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2423da19-1572-4f08-bdc0-25df5ed1a75d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:02.029609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2423da19-1572-4f08-bdc0-25df5ed1a75d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:02.069072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2423da19-1572-4f08-bdc0-25df5ed1a75d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062118 Jul 25 19:31:02.069800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 358/685] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:02.838772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7f723e93-cf6e-42e5-8bad-09db0acf9a85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:02.841886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7f723e93-cf6e-42e5-8bad-09db0acf9a85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:02.845380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=34 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:02.852730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f723e93-cf6e-42e5-8bad-09db0acf9a85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:02.853179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f723e93-cf6e-42e5-8bad-09db0acf9a85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:02.854011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f723e93-cf6e-42e5-8bad-09db0acf9a85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:02.854455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f723e93-cf6e-42e5-8bad-09db0acf9a85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:02.909086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7f723e93-cf6e-42e5-8bad-09db0acf9a85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075673 Jul 25 19:31:02.910055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 328/686] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:03.085471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eac6bb59-500b-4290-b6b8-431682eeb880 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:03.087810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eac6bb59-500b-4290-b6b8-431682eeb880 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:03.095258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eac6bb59-500b-4290-b6b8-431682eeb880 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:03.095650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eac6bb59-500b-4290-b6b8-431682eeb880 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:03.096469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eac6bb59-500b-4290-b6b8-431682eeb880 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:03.096914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eac6bb59-500b-4290-b6b8-431682eeb880 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:03.137526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eac6bb59-500b-4290-b6b8-431682eeb880 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057703 Jul 25 19:31:03.138309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 359/687] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:03.930615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c7227ca7-91c1-49d7-8af2-68a972ad16f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:03.933368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c7227ca7-91c1-49d7-8af2-68a972ad16f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:03.941102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c7227ca7-91c1-49d7-8af2-68a972ad16f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:03.941552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c7227ca7-91c1-49d7-8af2-68a972ad16f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:03.944282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c7227ca7-91c1-49d7-8af2-68a972ad16f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:03.944814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c7227ca7-91c1-49d7-8af2-68a972ad16f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:03.986680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c7227ca7-91c1-49d7-8af2-68a972ad16f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063806 Jul 25 19:31:03.987505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 329/688] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:03 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:04.153809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6903cfde-8a25-48f2-a300-255e452d1b77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:04.156992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6903cfde-8a25-48f2-a300-255e452d1b77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:04.165949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6903cfde-8a25-48f2-a300-255e452d1b77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:04.166450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6903cfde-8a25-48f2-a300-255e452d1b77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:04.167177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6903cfde-8a25-48f2-a300-255e452d1b77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:04.167658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6903cfde-8a25-48f2-a300-255e452d1b77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:04.221995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6903cfde-8a25-48f2-a300-255e452d1b77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074045 Jul 25 19:31:04.222902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 360/689] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:05.006244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-183c31c6-2cfd-4d08-8483-336911c1a115 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:05.011118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-183c31c6-2cfd-4d08-8483-336911c1a115 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:05.019174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-183c31c6-2cfd-4d08-8483-336911c1a115 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:05.019836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-183c31c6-2cfd-4d08-8483-336911c1a115 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:05.020727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-183c31c6-2cfd-4d08-8483-336911c1a115 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:05.021260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-183c31c6-2cfd-4d08-8483-336911c1a115 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:05.065274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-183c31c6-2cfd-4d08-8483-336911c1a115 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067004 Jul 25 19:31:05.066117 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 330/690] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:05.237358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dd0d8b3f-e0d2-4edf-bf80-4458ac251a09 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:05.240966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dd0d8b3f-e0d2-4edf-bf80-4458ac251a09 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:05.252603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd0d8b3f-e0d2-4edf-bf80-4458ac251a09 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:05.253417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd0d8b3f-e0d2-4edf-bf80-4458ac251a09 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:05.254721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd0d8b3f-e0d2-4edf-bf80-4458ac251a09 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:05.255464 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd0d8b3f-e0d2-4edf-bf80-4458ac251a09 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:05.306914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dd0d8b3f-e0d2-4edf-bf80-4458ac251a09 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074677 Jul 25 19:31:05.307737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 361/691] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:06.080144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-26c59372-a133-4cd0-a0e8-786604b996db tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:06.083289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-26c59372-a133-4cd0-a0e8-786604b996db tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:06.094291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26c59372-a133-4cd0-a0e8-786604b996db tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:06.095340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26c59372-a133-4cd0-a0e8-786604b996db tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:06.096302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26c59372-a133-4cd0-a0e8-786604b996db tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:06.096858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26c59372-a133-4cd0-a0e8-786604b996db tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:06.134474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-26c59372-a133-4cd0-a0e8-786604b996db tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058925 Jul 25 19:31:06.135061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 331/692] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:06.321958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50bc6569-8719-45bf-9f86-6a8be075a125 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:06.324330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50bc6569-8719-45bf-9f86-6a8be075a125 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:06.333977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50bc6569-8719-45bf-9f86-6a8be075a125 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:06.334300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50bc6569-8719-45bf-9f86-6a8be075a125 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:06.335359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50bc6569-8719-45bf-9f86-6a8be075a125 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:06.336191 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50bc6569-8719-45bf-9f86-6a8be075a125 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:06.382500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50bc6569-8719-45bf-9f86-6a8be075a125 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065208 Jul 25 19:31:06.383146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 362/693] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:07.147855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f6c0b5dc-6324-4bc9-8d98-472e7f7831ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:07.150073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f6c0b5dc-6324-4bc9-8d98-472e7f7831ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:07.160756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6c0b5dc-6324-4bc9-8d98-472e7f7831ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:07.161455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6c0b5dc-6324-4bc9-8d98-472e7f7831ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:07.162832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6c0b5dc-6324-4bc9-8d98-472e7f7831ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:07.163619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6c0b5dc-6324-4bc9-8d98-472e7f7831ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:07.209192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f6c0b5dc-6324-4bc9-8d98-472e7f7831ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066047 Jul 25 19:31:07.209781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 332/694] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:07.399471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-832000fe-255e-4d2c-8107-27bfccb7c74f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:07.401805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-832000fe-255e-4d2c-8107-27bfccb7c74f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:07.411902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-832000fe-255e-4d2c-8107-27bfccb7c74f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:07.412357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-832000fe-255e-4d2c-8107-27bfccb7c74f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:07.413581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-832000fe-255e-4d2c-8107-27bfccb7c74f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:07.414334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-832000fe-255e-4d2c-8107-27bfccb7c74f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:07.462022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-832000fe-255e-4d2c-8107-27bfccb7c74f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066321 Jul 25 19:31:07.462706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 363/695] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:08.225737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-57ebd8f9-0fef-40d5-a494-b6884797534f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:08.229427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-57ebd8f9-0fef-40d5-a494-b6884797534f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:08.238754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57ebd8f9-0fef-40d5-a494-b6884797534f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:08.239763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57ebd8f9-0fef-40d5-a494-b6884797534f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:08.240577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57ebd8f9-0fef-40d5-a494-b6884797534f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:08.241087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57ebd8f9-0fef-40d5-a494-b6884797534f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:08.283710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-57ebd8f9-0fef-40d5-a494-b6884797534f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064728 Jul 25 19:31:08.284346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 333/696] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:08.482387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b10f88a-8fc6-489e-b46b-8774e077e315 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:08.486249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2b10f88a-8fc6-489e-b46b-8774e077e315 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:08.499375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b10f88a-8fc6-489e-b46b-8774e077e315 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:08.500184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b10f88a-8fc6-489e-b46b-8774e077e315 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:08.501603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b10f88a-8fc6-489e-b46b-8774e077e315 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:08.502395 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b10f88a-8fc6-489e-b46b-8774e077e315 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:08.542033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:08.551870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2b10f88a-8fc6-489e-b46b-8774e077e315 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076760 Jul 25 19:31:08.553062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 364/697] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:09.301887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e62645b6-17af-40e2-a88e-6d0615d39bbe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:09.304782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e62645b6-17af-40e2-a88e-6d0615d39bbe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:09.311989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e62645b6-17af-40e2-a88e-6d0615d39bbe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:09.312435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e62645b6-17af-40e2-a88e-6d0615d39bbe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:09.313234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e62645b6-17af-40e2-a88e-6d0615d39bbe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:09.313672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e62645b6-17af-40e2-a88e-6d0615d39bbe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:09.365978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e62645b6-17af-40e2-a88e-6d0615d39bbe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068121 Jul 25 19:31:09.367050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 334/698] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:09.573626 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d9525fed-5a9d-42c6-84ab-ab7309df84fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:09.577643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d9525fed-5a9d-42c6-84ab-ab7309df84fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:09.590072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9525fed-5a9d-42c6-84ab-ab7309df84fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:09.590859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9525fed-5a9d-42c6-84ab-ab7309df84fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:09.592299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9525fed-5a9d-42c6-84ab-ab7309df84fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:09.593092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9525fed-5a9d-42c6-84ab-ab7309df84fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:09.640508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d9525fed-5a9d-42c6-84ab-ab7309df84fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075493 Jul 25 19:31:09.641372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 365/699] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:10.387184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1abb5dc7-aac5-4e78-9315-52c5379e2247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:10.391118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1abb5dc7-aac5-4e78-9315-52c5379e2247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:10.405007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1abb5dc7-aac5-4e78-9315-52c5379e2247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:10.405711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1abb5dc7-aac5-4e78-9315-52c5379e2247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:10.407181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1abb5dc7-aac5-4e78-9315-52c5379e2247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:10.408081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1abb5dc7-aac5-4e78-9315-52c5379e2247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:10.466867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1abb5dc7-aac5-4e78-9315-52c5379e2247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087740 Jul 25 19:31:10.467305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 335/700] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:10.653939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2cff3b7-6ca2-41cf-99b2-b6798d277ce7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:10.656499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c2cff3b7-6ca2-41cf-99b2-b6798d277ce7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:10.666361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2cff3b7-6ca2-41cf-99b2-b6798d277ce7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:10.666900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2cff3b7-6ca2-41cf-99b2-b6798d277ce7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:10.668040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2cff3b7-6ca2-41cf-99b2-b6798d277ce7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:10.668931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2cff3b7-6ca2-41cf-99b2-b6798d277ce7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:10.709648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2cff3b7-6ca2-41cf-99b2-b6798d277ce7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059571 Jul 25 19:31:10.710261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 366/701] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:11.485830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dca95fb0-54d4-4e91-8e63-a0e3433515ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:11.490177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dca95fb0-54d4-4e91-8e63-a0e3433515ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:11.502512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dca95fb0-54d4-4e91-8e63-a0e3433515ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:11.503327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dca95fb0-54d4-4e91-8e63-a0e3433515ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:11.504803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dca95fb0-54d4-4e91-8e63-a0e3433515ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:11.505586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dca95fb0-54d4-4e91-8e63-a0e3433515ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:11.554743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dca95fb0-54d4-4e91-8e63-a0e3433515ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076725 Jul 25 19:31:11.555543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 336/702] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:11 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:11.727280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c97c0c1f-5c7b-4a6b-a576-e91d6b57109c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:11.730613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c97c0c1f-5c7b-4a6b-a576-e91d6b57109c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:11.749144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97c0c1f-5c7b-4a6b-a576-e91d6b57109c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:11.749493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97c0c1f-5c7b-4a6b-a576-e91d6b57109c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:11.750240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97c0c1f-5c7b-4a6b-a576-e91d6b57109c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:11.750677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97c0c1f-5c7b-4a6b-a576-e91d6b57109c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:11.803286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c97c0c1f-5c7b-4a6b-a576-e91d6b57109c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082634 Jul 25 19:31:11.804165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 367/703] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:12.571060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-07a0f7c7-b720-4e20-82f7-fef63c96e9ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:12.574339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-07a0f7c7-b720-4e20-82f7-fef63c96e9ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:12.582827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07a0f7c7-b720-4e20-82f7-fef63c96e9ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:12.583996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07a0f7c7-b720-4e20-82f7-fef63c96e9ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:12.584846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07a0f7c7-b720-4e20-82f7-fef63c96e9ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:12.585302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07a0f7c7-b720-4e20-82f7-fef63c96e9ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:12.625604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-07a0f7c7-b720-4e20-82f7-fef63c96e9ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060416 Jul 25 19:31:12.626361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 337/704] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:12.820170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-30095a46-acd1-479b-9104-9fe24adbcbbd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:12.822800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-30095a46-acd1-479b-9104-9fe24adbcbbd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:12.830508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30095a46-acd1-479b-9104-9fe24adbcbbd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:12.831083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30095a46-acd1-479b-9104-9fe24adbcbbd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:12.832056 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30095a46-acd1-479b-9104-9fe24adbcbbd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:12.832593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30095a46-acd1-479b-9104-9fe24adbcbbd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:12.874133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-30095a46-acd1-479b-9104-9fe24adbcbbd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059122 Jul 25 19:31:12.874893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 368/705] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:13.643825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9cb9d86f-a8a8-41b6-a202-48678f0e93ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:13.648514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9cb9d86f-a8a8-41b6-a202-48678f0e93ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:13.663333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cb9d86f-a8a8-41b6-a202-48678f0e93ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:13.664184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cb9d86f-a8a8-41b6-a202-48678f0e93ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:13.665677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cb9d86f-a8a8-41b6-a202-48678f0e93ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:13.666423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cb9d86f-a8a8-41b6-a202-48678f0e93ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:13.729119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9cb9d86f-a8a8-41b6-a202-48678f0e93ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092614 Jul 25 19:31:13.730197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 338/706] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:13.893042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4200a637-7c9e-4fc3-a06a-6b6f9b2d78a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:13.897337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4200a637-7c9e-4fc3-a06a-6b6f9b2d78a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:13.906208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4200a637-7c9e-4fc3-a06a-6b6f9b2d78a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:13.906910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4200a637-7c9e-4fc3-a06a-6b6f9b2d78a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:13.908438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4200a637-7c9e-4fc3-a06a-6b6f9b2d78a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:13.908904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4200a637-7c9e-4fc3-a06a-6b6f9b2d78a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:13.956202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4200a637-7c9e-4fc3-a06a-6b6f9b2d78a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068704 Jul 25 19:31:13.956859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 369/707] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:14.749626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ee88de81-30d6-4209-9b33-107834a450bb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:14.753541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ee88de81-30d6-4209-9b33-107834a450bb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:14.766285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee88de81-30d6-4209-9b33-107834a450bb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:14.767103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee88de81-30d6-4209-9b33-107834a450bb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:14.769398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee88de81-30d6-4209-9b33-107834a450bb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:14.770750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee88de81-30d6-4209-9b33-107834a450bb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:14.778782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:14.834869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ee88de81-30d6-4209-9b33-107834a450bb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092175 Jul 25 19:31:14.835950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 339/708] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:14 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:14.976505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7884b3af-c8ea-44d3-9f68-e9f4920b69fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:14.979751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7884b3af-c8ea-44d3-9f68-e9f4920b69fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:14.987791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7884b3af-c8ea-44d3-9f68-e9f4920b69fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:14.988390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7884b3af-c8ea-44d3-9f68-e9f4920b69fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:14.990960 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7884b3af-c8ea-44d3-9f68-e9f4920b69fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:14.991680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7884b3af-c8ea-44d3-9f68-e9f4920b69fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:15.031471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7884b3af-c8ea-44d3-9f68-e9f4920b69fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062052 Jul 25 19:31:15.032327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 370/709] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:15.857344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5e920af6-5c7c-4822-869a-e7ab16c6c9ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:15.861171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5e920af6-5c7c-4822-869a-e7ab16c6c9ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:15.873461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e920af6-5c7c-4822-869a-e7ab16c6c9ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:15.874243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e920af6-5c7c-4822-869a-e7ab16c6c9ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:15.875758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e920af6-5c7c-4822-869a-e7ab16c6c9ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:15.876539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e920af6-5c7c-4822-869a-e7ab16c6c9ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:15.938168 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5e920af6-5c7c-4822-869a-e7ab16c6c9ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088681 Jul 25 19:31:15.939182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 340/710] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:16.049641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6293b931-b7c8-491f-83ca-73182e1a1b98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:16.054027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6293b931-b7c8-491f-83ca-73182e1a1b98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:16.065548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6293b931-b7c8-491f-83ca-73182e1a1b98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:16.066258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6293b931-b7c8-491f-83ca-73182e1a1b98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:16.068278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6293b931-b7c8-491f-83ca-73182e1a1b98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:16.069044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6293b931-b7c8-491f-83ca-73182e1a1b98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:16.127043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6293b931-b7c8-491f-83ca-73182e1a1b98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084379 Jul 25 19:31:16.128057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 371/711] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:16.957570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2dd2b807-7c1e-4a87-a68b-af079b489a28 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:16.960267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2dd2b807-7c1e-4a87-a68b-af079b489a28 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:16.968255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2dd2b807-7c1e-4a87-a68b-af079b489a28 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:16.968756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2dd2b807-7c1e-4a87-a68b-af079b489a28 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:16.969601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2dd2b807-7c1e-4a87-a68b-af079b489a28 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:16.970103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2dd2b807-7c1e-4a87-a68b-af079b489a28 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:17.008358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2dd2b807-7c1e-4a87-a68b-af079b489a28 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057136 Jul 25 19:31:17.008958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 341/712] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:17.148012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d2b3af02-1039-495c-bf2a-935da0c5317c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:17.151374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d2b3af02-1039-495c-bf2a-935da0c5317c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:17.155245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=48 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:17.163601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2b3af02-1039-495c-bf2a-935da0c5317c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:17.164419 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2b3af02-1039-495c-bf2a-935da0c5317c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:17.165834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2b3af02-1039-495c-bf2a-935da0c5317c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:17.166606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2b3af02-1039-495c-bf2a-935da0c5317c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:17.214627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d2b3af02-1039-495c-bf2a-935da0c5317c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073994 Jul 25 19:31:17.215315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 372/713] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:18.025795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d5472ce3-cff6-44df-aeee-48e48abedc2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:18.029331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d5472ce3-cff6-44df-aeee-48e48abedc2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:18.041435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5472ce3-cff6-44df-aeee-48e48abedc2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:18.042087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5472ce3-cff6-44df-aeee-48e48abedc2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:18.043482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5472ce3-cff6-44df-aeee-48e48abedc2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:18.044164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5472ce3-cff6-44df-aeee-48e48abedc2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:18.107219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d5472ce3-cff6-44df-aeee-48e48abedc2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088204 Jul 25 19:31:18.108489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 342/714] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:18.232366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fceb447d-ba2b-4dc5-88e2-963e3af0a959 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:18.238034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fceb447d-ba2b-4dc5-88e2-963e3af0a959 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:18.247466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fceb447d-ba2b-4dc5-88e2-963e3af0a959 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:18.247979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fceb447d-ba2b-4dc5-88e2-963e3af0a959 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:18.248776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fceb447d-ba2b-4dc5-88e2-963e3af0a959 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:18.249213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fceb447d-ba2b-4dc5-88e2-963e3af0a959 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:18.290342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fceb447d-ba2b-4dc5-88e2-963e3af0a959 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062672 Jul 25 19:31:18.290944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 373/715] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:19.126026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8afe105c-812e-4cfe-a01b-bbeef29da954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:19.129137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8afe105c-812e-4cfe-a01b-bbeef29da954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:19.137511 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8afe105c-812e-4cfe-a01b-bbeef29da954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:19.137959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8afe105c-812e-4cfe-a01b-bbeef29da954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:19.138769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8afe105c-812e-4cfe-a01b-bbeef29da954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:19.139210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8afe105c-812e-4cfe-a01b-bbeef29da954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:19.175647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8afe105c-812e-4cfe-a01b-bbeef29da954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055446 Jul 25 19:31:19.181536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 343/716] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:19.303490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e96cf9db-dbd5-4489-8545-83aa3cffb06c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:19.306346 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e96cf9db-dbd5-4489-8545-83aa3cffb06c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:19.313443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e96cf9db-dbd5-4489-8545-83aa3cffb06c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:19.313893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e96cf9db-dbd5-4489-8545-83aa3cffb06c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:19.314753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e96cf9db-dbd5-4489-8545-83aa3cffb06c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:19.315192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e96cf9db-dbd5-4489-8545-83aa3cffb06c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:19.355857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e96cf9db-dbd5-4489-8545-83aa3cffb06c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056982 Jul 25 19:31:19.356647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 374/717] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:20.197267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dedf0cad-dfd7-498a-85ce-0f1b17cf91e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:20.201221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dedf0cad-dfd7-498a-85ce-0f1b17cf91e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:20.214356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dedf0cad-dfd7-498a-85ce-0f1b17cf91e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:20.215162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dedf0cad-dfd7-498a-85ce-0f1b17cf91e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:20.216684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dedf0cad-dfd7-498a-85ce-0f1b17cf91e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:20.217494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dedf0cad-dfd7-498a-85ce-0f1b17cf91e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:20.284130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dedf0cad-dfd7-498a-85ce-0f1b17cf91e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095557 Jul 25 19:31:20.285055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 344/718] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:20.375046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e7dfbb8-ef0d-43e0-8110-a1f535c6075f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:20.378783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e7dfbb8-ef0d-43e0-8110-a1f535c6075f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:20.390066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e7dfbb8-ef0d-43e0-8110-a1f535c6075f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:20.390747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e7dfbb8-ef0d-43e0-8110-a1f535c6075f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:20.391614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e7dfbb8-ef0d-43e0-8110-a1f535c6075f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:20.392338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e7dfbb8-ef0d-43e0-8110-a1f535c6075f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:20.422588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f36aa3a7-2386-467f-b19f-1f492efe46a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:20.423379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f36aa3a7-2386-467f-b19f-1f492efe46a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:20.430956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f36aa3a7-2386-467f-b19f-1f492efe46a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:20.431396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f36aa3a7-2386-467f-b19f-1f492efe46a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:20.432307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f36aa3a7-2386-467f-b19f-1f492efe46a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:20.432743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f36aa3a7-2386-467f-b19f-1f492efe46a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:20.444598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e7dfbb8-ef0d-43e0-8110-a1f535c6075f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075518 Jul 25 19:31:20.445474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 375/719] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:20.533843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-f36aa3a7-2386-467f-b19f-1f492efe46a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lazy-loading 'services' on Instance uuid 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:31:20.620823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f36aa3a7-2386-467f-b19f-1f492efe46a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments/5d9cd473-5428-47a4-b3d9-dabaad200ca9" status: 202 len: 0 microversion: 2.1 time: 0.202175 Jul 25 19:31:20.621425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 345/720] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 19:31:20 2022] DELETE /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments/5d9cd473-5428-47a4-b3d9-dabaad200ca9 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 19:31:21.298384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-602e5574-cea7-4705-b05e-f284840a468f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:21.300792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-602e5574-cea7-4705-b05e-f284840a468f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:21.311287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602e5574-cea7-4705-b05e-f284840a468f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:21.312182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602e5574-cea7-4705-b05e-f284840a468f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:21.313621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602e5574-cea7-4705-b05e-f284840a468f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:21.314419 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602e5574-cea7-4705-b05e-f284840a468f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:21.377347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-602e5574-cea7-4705-b05e-f284840a468f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082787 Jul 25 19:31:21.378435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 376/721] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:21.464077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b9ab0036-b4bd-4aec-8382-aa165c17be62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:21.467770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b9ab0036-b4bd-4aec-8382-aa165c17be62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:21.477448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9ab0036-b4bd-4aec-8382-aa165c17be62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:21.477902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9ab0036-b4bd-4aec-8382-aa165c17be62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:21.478705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9ab0036-b4bd-4aec-8382-aa165c17be62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:21.479143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9ab0036-b4bd-4aec-8382-aa165c17be62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:21.523605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b9ab0036-b4bd-4aec-8382-aa165c17be62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068559 Jul 25 19:31:21.524214 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 346/722] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:22.396692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f6fcdf84-65aa-4809-96c9-da13ffc6d2d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:22.400461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f6fcdf84-65aa-4809-96c9-da13ffc6d2d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:22.411489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6fcdf84-65aa-4809-96c9-da13ffc6d2d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:22.412128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6fcdf84-65aa-4809-96c9-da13ffc6d2d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:22.412944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6fcdf84-65aa-4809-96c9-da13ffc6d2d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:22.413384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6fcdf84-65aa-4809-96c9-da13ffc6d2d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:22.457091 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f6fcdf84-65aa-4809-96c9-da13ffc6d2d3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068258 Jul 25 19:31:22.458542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 377/723] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:22.542750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0187cb70-0093-49e6-98e9-44c88ddbb9bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:22.546187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0187cb70-0093-49e6-98e9-44c88ddbb9bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:22.557602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0187cb70-0093-49e6-98e9-44c88ddbb9bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:22.558313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0187cb70-0093-49e6-98e9-44c88ddbb9bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:22.559252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0187cb70-0093-49e6-98e9-44c88ddbb9bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:22.559740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0187cb70-0093-49e6-98e9-44c88ddbb9bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:22.601857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0187cb70-0093-49e6-98e9-44c88ddbb9bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066914 Jul 25 19:31:22.602765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 347/724] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:23.476033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dbfbaad3-b5e6-43ff-b010-ab89977d93c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:23.479054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dbfbaad3-b5e6-43ff-b010-ab89977d93c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:23.488698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbfbaad3-b5e6-43ff-b010-ab89977d93c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:23.489815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbfbaad3-b5e6-43ff-b010-ab89977d93c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:23.490729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbfbaad3-b5e6-43ff-b010-ab89977d93c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:23.491220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbfbaad3-b5e6-43ff-b010-ab89977d93c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:23.552439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dbfbaad3-b5e6-43ff-b010-ab89977d93c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083661 Jul 25 19:31:23.553334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 378/725] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:23.619491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-11cbb163-ff93-47d0-badd-a27e1dddff0a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:23.622128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-11cbb163-ff93-47d0-badd-a27e1dddff0a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:23.632519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11cbb163-ff93-47d0-badd-a27e1dddff0a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:23.633175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11cbb163-ff93-47d0-badd-a27e1dddff0a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:23.634084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11cbb163-ff93-47d0-badd-a27e1dddff0a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:23.634662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11cbb163-ff93-47d0-badd-a27e1dddff0a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:23.673748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-11cbb163-ff93-47d0-badd-a27e1dddff0a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061836 Jul 25 19:31:23.674490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 348/726] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:24.566694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4e3a0fde-9c27-470c-b38c-8c2d434c6b5e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:24.570140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4e3a0fde-9c27-470c-b38c-8c2d434c6b5e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:24.578391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e3a0fde-9c27-470c-b38c-8c2d434c6b5e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:24.578901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e3a0fde-9c27-470c-b38c-8c2d434c6b5e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:24.579757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e3a0fde-9c27-470c-b38c-8c2d434c6b5e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:24.580207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e3a0fde-9c27-470c-b38c-8c2d434c6b5e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:24.618224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4e3a0fde-9c27-470c-b38c-8c2d434c6b5e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055446 Jul 25 19:31:24.618837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 379/727] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:24.689686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7cb58c97-31df-499c-92bb-df0ff5b4fcf4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:24.695419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7cb58c97-31df-499c-92bb-df0ff5b4fcf4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:24.702138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7cb58c97-31df-499c-92bb-df0ff5b4fcf4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:24.702809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7cb58c97-31df-499c-92bb-df0ff5b4fcf4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:24.703858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7cb58c97-31df-499c-92bb-df0ff5b4fcf4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:24.704453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7cb58c97-31df-499c-92bb-df0ff5b4fcf4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:24.756320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7cb58c97-31df-499c-92bb-df0ff5b4fcf4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072229 Jul 25 19:31:24.757388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 349/728] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:25.636384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a82a5b99-86e6-4217-a011-ca82337f756a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:25.638693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a82a5b99-86e6-4217-a011-ca82337f756a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:25.647851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a82a5b99-86e6-4217-a011-ca82337f756a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:25.648877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a82a5b99-86e6-4217-a011-ca82337f756a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:25.649966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a82a5b99-86e6-4217-a011-ca82337f756a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:25.650666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a82a5b99-86e6-4217-a011-ca82337f756a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:25.696352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a82a5b99-86e6-4217-a011-ca82337f756a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065147 Jul 25 19:31:25.697184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 380/729] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:25.775413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5158e661-9ced-4a6f-9049-8dd4b7b59735 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:25.778087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5158e661-9ced-4a6f-9049-8dd4b7b59735 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:25.791837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5158e661-9ced-4a6f-9049-8dd4b7b59735 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:25.792245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5158e661-9ced-4a6f-9049-8dd4b7b59735 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:25.793420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5158e661-9ced-4a6f-9049-8dd4b7b59735 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:25.793953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5158e661-9ced-4a6f-9049-8dd4b7b59735 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:25.830272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5158e661-9ced-4a6f-9049-8dd4b7b59735 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060781 Jul 25 19:31:25.831055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 350/730] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:26.716422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da33f3ee-7811-4018-9a50-f0d98429dc2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:26.720303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da33f3ee-7811-4018-9a50-f0d98429dc2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:26.734122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da33f3ee-7811-4018-9a50-f0d98429dc2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:26.734931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da33f3ee-7811-4018-9a50-f0d98429dc2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:26.736482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da33f3ee-7811-4018-9a50-f0d98429dc2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:26.737262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da33f3ee-7811-4018-9a50-f0d98429dc2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:26.765985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:26.808321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da33f3ee-7811-4018-9a50-f0d98429dc2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101657 Jul 25 19:31:26.809315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 381/731] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:26.845285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-585b93f2-a3cc-4770-b958-ec5b85bb87af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:26.848761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-585b93f2-a3cc-4770-b958-ec5b85bb87af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:26.857344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585b93f2-a3cc-4770-b958-ec5b85bb87af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:26.857927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585b93f2-a3cc-4770-b958-ec5b85bb87af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:26.858777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585b93f2-a3cc-4770-b958-ec5b85bb87af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:26.859410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585b93f2-a3cc-4770-b958-ec5b85bb87af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:26.895630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-585b93f2-a3cc-4770-b958-ec5b85bb87af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054070 Jul 25 19:31:26.896379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 351/732] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:27.836183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-79394c60-819b-4af5-bb12-a399dd077d07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:27.839462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-79394c60-819b-4af5-bb12-a399dd077d07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:27.850826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79394c60-819b-4af5-bb12-a399dd077d07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:27.851643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79394c60-819b-4af5-bb12-a399dd077d07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:27.853071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79394c60-819b-4af5-bb12-a399dd077d07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:27.853802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79394c60-819b-4af5-bb12-a399dd077d07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:27.893096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-79394c60-819b-4af5-bb12-a399dd077d07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073709 Jul 25 19:31:27.893755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 382/733] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:27.909915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-64b65af8-f53e-4fa1-a185-8ddc1741f2ef tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:27.913457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-64b65af8-f53e-4fa1-a185-8ddc1741f2ef tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:27.922290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64b65af8-f53e-4fa1-a185-8ddc1741f2ef tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:27.923068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64b65af8-f53e-4fa1-a185-8ddc1741f2ef tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:27.924071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64b65af8-f53e-4fa1-a185-8ddc1741f2ef tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:27.924516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64b65af8-f53e-4fa1-a185-8ddc1741f2ef tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:27.962796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-64b65af8-f53e-4fa1-a185-8ddc1741f2ef tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057477 Jul 25 19:31:27.963404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 352/734] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:28.911941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3c4acc71-0909-439f-8ce7-9b52d0ac4cc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:28.917712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3c4acc71-0909-439f-8ce7-9b52d0ac4cc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:28.926789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c4acc71-0909-439f-8ce7-9b52d0ac4cc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:28.927340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c4acc71-0909-439f-8ce7-9b52d0ac4cc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:28.928475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c4acc71-0909-439f-8ce7-9b52d0ac4cc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:28.929043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c4acc71-0909-439f-8ce7-9b52d0ac4cc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:28.976829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3c4acc71-0909-439f-8ce7-9b52d0ac4cc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073386 Jul 25 19:31:28.977875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 383/735] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:28.979794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a967e381-0a14-4497-bb5b-93467548e6c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:28.982435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a967e381-0a14-4497-bb5b-93467548e6c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:28.990999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a967e381-0a14-4497-bb5b-93467548e6c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:28.991442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a967e381-0a14-4497-bb5b-93467548e6c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:28.992307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a967e381-0a14-4497-bb5b-93467548e6c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:28.992894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a967e381-0a14-4497-bb5b-93467548e6c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:29.028717 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a967e381-0a14-4497-bb5b-93467548e6c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053657 Jul 25 19:31:29.035468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 353/736] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:29.998967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-32688eca-b146-418f-9138-99a4fe2405c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:30.002480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-32688eca-b146-418f-9138-99a4fe2405c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:30.013673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32688eca-b146-418f-9138-99a4fe2405c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:30.014513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32688eca-b146-418f-9138-99a4fe2405c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:30.015791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32688eca-b146-418f-9138-99a4fe2405c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:30.016755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32688eca-b146-418f-9138-99a4fe2405c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:30.050279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5e3a7b42-7fb8-484b-b1a5-050f6c1eea38 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:30.054325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5e3a7b42-7fb8-484b-b1a5-050f6c1eea38 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:30.064615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e3a7b42-7fb8-484b-b1a5-050f6c1eea38 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:30.065427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e3a7b42-7fb8-484b-b1a5-050f6c1eea38 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:30.067832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e3a7b42-7fb8-484b-b1a5-050f6c1eea38 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:30.067832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e3a7b42-7fb8-484b-b1a5-050f6c1eea38 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:30.070971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-32688eca-b146-418f-9138-99a4fe2405c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080021 Jul 25 19:31:30.071911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 384/737] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:29 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:30.125640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5e3a7b42-7fb8-484b-b1a5-050f6c1eea38 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082736 Jul 25 19:31:30.126725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 354/738] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:31.091709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0df4799e-38a4-4e46-a354-f06d2368303a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:31.095267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0df4799e-38a4-4e46-a354-f06d2368303a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:31.104646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0df4799e-38a4-4e46-a354-f06d2368303a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:31.105103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0df4799e-38a4-4e46-a354-f06d2368303a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:31.105967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0df4799e-38a4-4e46-a354-f06d2368303a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:31.106405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0df4799e-38a4-4e46-a354-f06d2368303a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:31.138864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ec0bfcae-5941-49b8-a918-650a242fa854 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:31.141260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ec0bfcae-5941-49b8-a918-650a242fa854 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:31.149135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec0bfcae-5941-49b8-a918-650a242fa854 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:31.149337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec0bfcae-5941-49b8-a918-650a242fa854 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:31.150498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec0bfcae-5941-49b8-a918-650a242fa854 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:31.151010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec0bfcae-5941-49b8-a918-650a242fa854 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:31.153994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:31.163915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0df4799e-38a4-4e46-a354-f06d2368303a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081645 Jul 25 19:31:31.170631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 385/739] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:31.189761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ec0bfcae-5941-49b8-a918-650a242fa854 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054774 Jul 25 19:31:31.190489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 355/740] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:32.182758 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b2aa8ad-2c97-44c8-9391-0f21af610b9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:32.185072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b2aa8ad-2c97-44c8-9391-0f21af610b9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:32.193344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b2aa8ad-2c97-44c8-9391-0f21af610b9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:32.193930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b2aa8ad-2c97-44c8-9391-0f21af610b9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:32.194815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b2aa8ad-2c97-44c8-9391-0f21af610b9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:32.195344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b2aa8ad-2c97-44c8-9391-0f21af610b9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:32.216610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8a7295db-b347-4191-a5fa-92abf267a007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:32.220720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8a7295db-b347-4191-a5fa-92abf267a007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:32.232742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a7295db-b347-4191-a5fa-92abf267a007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:32.233194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a7295db-b347-4191-a5fa-92abf267a007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:32.234010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a7295db-b347-4191-a5fa-92abf267a007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:32.234455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a7295db-b347-4191-a5fa-92abf267a007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:32.258085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b2aa8ad-2c97-44c8-9391-0f21af610b9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081221 Jul 25 19:31:32.260284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 386/741] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:32.271086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8a7295db-b347-4191-a5fa-92abf267a007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063538 Jul 25 19:31:32.271746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 356/742] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:32 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:33.285522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7034c2d5-76f7-4bbd-af9d-ce53a2705421 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:33.289815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9617315e-88a6-461c-a8a9-bb9a8175e082 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:33.291324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7034c2d5-76f7-4bbd-af9d-ce53a2705421 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:33.295110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9617315e-88a6-461c-a8a9-bb9a8175e082 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:33.302053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=58 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:33.315601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7034c2d5-76f7-4bbd-af9d-ce53a2705421 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:33.315601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7034c2d5-76f7-4bbd-af9d-ce53a2705421 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:33.315601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7034c2d5-76f7-4bbd-af9d-ce53a2705421 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:33.315601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7034c2d5-76f7-4bbd-af9d-ce53a2705421 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:33.317384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9617315e-88a6-461c-a8a9-bb9a8175e082 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:33.317384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9617315e-88a6-461c-a8a9-bb9a8175e082 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:33.317384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9617315e-88a6-461c-a8a9-bb9a8175e082 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:33.317384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9617315e-88a6-461c-a8a9-bb9a8175e082 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:33.367784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9617315e-88a6-461c-a8a9-bb9a8175e082 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086559 Jul 25 19:31:33.368668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 357/743] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:33.374879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7034c2d5-76f7-4bbd-af9d-ce53a2705421 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104684 Jul 25 19:31:33.375532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 387/744] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:34.390315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-26a67e8b-3696-4380-8227-1b9cdc95ecfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:34.391097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9c8d3015-8d13-414e-b8e5-5aa67e5b3023 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:34.394355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-26a67e8b-3696-4380-8227-1b9cdc95ecfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:34.394992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9c8d3015-8d13-414e-b8e5-5aa67e5b3023 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:34.412649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c8d3015-8d13-414e-b8e5-5aa67e5b3023 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:34.412649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c8d3015-8d13-414e-b8e5-5aa67e5b3023 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:34.412649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c8d3015-8d13-414e-b8e5-5aa67e5b3023 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:34.412649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c8d3015-8d13-414e-b8e5-5aa67e5b3023 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:34.416493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26a67e8b-3696-4380-8227-1b9cdc95ecfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:34.417358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26a67e8b-3696-4380-8227-1b9cdc95ecfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:34.418341 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26a67e8b-3696-4380-8227-1b9cdc95ecfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:34.419007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26a67e8b-3696-4380-8227-1b9cdc95ecfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:34.476835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9c8d3015-8d13-414e-b8e5-5aa67e5b3023 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091957 Jul 25 19:31:34.476835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 358/745] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:34.484276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-26a67e8b-3696-4380-8227-1b9cdc95ecfb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098393 Jul 25 19:31:34.485312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 388/746] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:35.490615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f50f2d24-ab97-4eae-8fea-5f5a30c23333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:35.494831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f50f2d24-ab97-4eae-8fea-5f5a30c23333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:35.503317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-259dd1dd-d44f-436e-b69d-575e7e86dc70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:35.507369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f50f2d24-ab97-4eae-8fea-5f5a30c23333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:35.507857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-259dd1dd-d44f-436e-b69d-575e7e86dc70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:35.508271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f50f2d24-ab97-4eae-8fea-5f5a30c23333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:35.509684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f50f2d24-ab97-4eae-8fea-5f5a30c23333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:35.510447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f50f2d24-ab97-4eae-8fea-5f5a30c23333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:35.519701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-259dd1dd-d44f-436e-b69d-575e7e86dc70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:35.521150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-259dd1dd-d44f-436e-b69d-575e7e86dc70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:35.522243 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-259dd1dd-d44f-436e-b69d-575e7e86dc70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:35.522697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-259dd1dd-d44f-436e-b69d-575e7e86dc70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:35.561973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f50f2d24-ab97-4eae-8fea-5f5a30c23333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076007 Jul 25 19:31:35.562803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 359/747] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:35.575259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-259dd1dd-d44f-436e-b69d-575e7e86dc70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075903 Jul 25 19:31:35.576381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 389/748] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:35 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:36.577006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6c4d6ae6-d77b-49c8-8418-2960b275ed8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:36.579905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6c4d6ae6-d77b-49c8-8418-2960b275ed8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:36.604296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c4d6ae6-d77b-49c8-8418-2960b275ed8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:36.604296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c4d6ae6-d77b-49c8-8418-2960b275ed8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:36.604296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c4d6ae6-d77b-49c8-8418-2960b275ed8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:36.604296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c4d6ae6-d77b-49c8-8418-2960b275ed8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:36.604762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-59aaf4a8-1577-4b7b-870d-e828491e12e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:36.604762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-59aaf4a8-1577-4b7b-870d-e828491e12e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:36.611621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59aaf4a8-1577-4b7b-870d-e828491e12e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:36.613007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59aaf4a8-1577-4b7b-870d-e828491e12e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:36.615725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59aaf4a8-1577-4b7b-870d-e828491e12e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:36.616985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59aaf4a8-1577-4b7b-870d-e828491e12e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:36.653828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6c4d6ae6-d77b-49c8-8418-2960b275ed8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081427 Jul 25 19:31:36.654631 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 360/749] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:36.681711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-59aaf4a8-1577-4b7b-870d-e828491e12e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093994 Jul 25 19:31:36.682773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 390/750] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:37.671144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fba63d49-708b-4f5b-92b4-ff67bed7dece tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:37.675047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fba63d49-708b-4f5b-92b4-ff67bed7dece tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:37.689418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fba63d49-708b-4f5b-92b4-ff67bed7dece tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:37.690395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fba63d49-708b-4f5b-92b4-ff67bed7dece tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:37.692495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fba63d49-708b-4f5b-92b4-ff67bed7dece tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:37.693283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fba63d49-708b-4f5b-92b4-ff67bed7dece tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:37.704196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ea8748c-0a13-4039-a07b-58d361009922 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:37.710577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ea8748c-0a13-4039-a07b-58d361009922 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:37.722870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ea8748c-0a13-4039-a07b-58d361009922 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:37.724187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ea8748c-0a13-4039-a07b-58d361009922 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:37.725625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ea8748c-0a13-4039-a07b-58d361009922 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:37.726362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ea8748c-0a13-4039-a07b-58d361009922 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:37.757670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fba63d49-708b-4f5b-92b4-ff67bed7dece tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090818 Jul 25 19:31:37.757670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 361/751] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:37.776599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ea8748c-0a13-4039-a07b-58d361009922 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080709 Jul 25 19:31:37.777403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 391/752] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:38.778912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-661b4d36-79f3-490a-9062-92fd38e25b3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:38.780782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-661b4d36-79f3-490a-9062-92fd38e25b3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:38.797796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-661b4d36-79f3-490a-9062-92fd38e25b3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:38.798566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-661b4d36-79f3-490a-9062-92fd38e25b3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:38.799685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-661b4d36-79f3-490a-9062-92fd38e25b3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:38.799874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3cf83910-46b6-4287-8a14-b5af323318eb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:38.800847 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-661b4d36-79f3-490a-9062-92fd38e25b3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:38.804549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3cf83910-46b6-4287-8a14-b5af323318eb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:38.826330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3cf83910-46b6-4287-8a14-b5af323318eb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:38.826330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3cf83910-46b6-4287-8a14-b5af323318eb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:38.826330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3cf83910-46b6-4287-8a14-b5af323318eb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:38.826330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3cf83910-46b6-4287-8a14-b5af323318eb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:38.849962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-661b4d36-79f3-490a-9062-92fd38e25b3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081594 Jul 25 19:31:38.850575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 362/753] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:38 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:38.878033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3cf83910-46b6-4287-8a14-b5af323318eb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086822 Jul 25 19:31:38.878860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 392/754] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:39.868308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4b5a4c2f-e238-4854-82ca-86e0226b0d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:39.872125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4b5a4c2f-e238-4854-82ca-86e0226b0d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:39.884901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b5a4c2f-e238-4854-82ca-86e0226b0d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:39.885182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b5a4c2f-e238-4854-82ca-86e0226b0d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:39.887217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b5a4c2f-e238-4854-82ca-86e0226b0d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:39.888539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b5a4c2f-e238-4854-82ca-86e0226b0d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:39.904732 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5bcd0338-8205-4a7c-b4ff-9740fcda11b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:39.908570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5bcd0338-8205-4a7c-b4ff-9740fcda11b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:39.929473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bcd0338-8205-4a7c-b4ff-9740fcda11b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:39.930345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bcd0338-8205-4a7c-b4ff-9740fcda11b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:39.934346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4b5a4c2f-e238-4854-82ca-86e0226b0d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074282 Jul 25 19:31:39.934965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 363/755] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:39.935101 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bcd0338-8205-4a7c-b4ff-9740fcda11b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:39.935891 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bcd0338-8205-4a7c-b4ff-9740fcda11b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:39.978292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5bcd0338-8205-4a7c-b4ff-9740fcda11b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083376 Jul 25 19:31:39.979103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 393/756] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:40.954236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-62b19b4c-aae7-4231-b210-6db7d6b06a43 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:40.958632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-62b19b4c-aae7-4231-b210-6db7d6b06a43 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:40.971634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-62b19b4c-aae7-4231-b210-6db7d6b06a43 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:40.972638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-62b19b4c-aae7-4231-b210-6db7d6b06a43 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:40.975325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-62b19b4c-aae7-4231-b210-6db7d6b06a43 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:40.976613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-62b19b4c-aae7-4231-b210-6db7d6b06a43 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:40.994737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5288796b-86b2-4542-97a8-1583642304f2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:40.997465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5288796b-86b2-4542-97a8-1583642304f2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:41.007738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5288796b-86b2-4542-97a8-1583642304f2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:41.008392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5288796b-86b2-4542-97a8-1583642304f2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:41.009383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5288796b-86b2-4542-97a8-1583642304f2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:41.010059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5288796b-86b2-4542-97a8-1583642304f2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:41.034488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-62b19b4c-aae7-4231-b210-6db7d6b06a43 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087590 Jul 25 19:31:41.035413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 364/757] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:41.052104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5288796b-86b2-4542-97a8-1583642304f2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063054 Jul 25 19:31:41.052921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 394/758] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:42.053435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5ec74b87-c550-4656-90fe-544cf46abdfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:42.057043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5ec74b87-c550-4656-90fe-544cf46abdfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:42.071254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ec74b87-c550-4656-90fe-544cf46abdfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:42.072573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ec74b87-c550-4656-90fe-544cf46abdfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:42.074330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ec74b87-c550-4656-90fe-544cf46abdfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:42.075144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ec74b87-c550-4656-90fe-544cf46abdfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:42.076876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ecdae5e1-9060-46ff-851f-cfec2df39853 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:42.081319 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ecdae5e1-9060-46ff-851f-cfec2df39853 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:42.095264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecdae5e1-9060-46ff-851f-cfec2df39853 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:42.096469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecdae5e1-9060-46ff-851f-cfec2df39853 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:42.099844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecdae5e1-9060-46ff-851f-cfec2df39853 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:42.100704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecdae5e1-9060-46ff-851f-cfec2df39853 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:42.119854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5ec74b87-c550-4656-90fe-544cf46abdfc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072139 Jul 25 19:31:42.120853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 365/759] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:42.154306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ecdae5e1-9060-46ff-851f-cfec2df39853 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091162 Jul 25 19:31:42.155281 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 395/760] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:42 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:43.138063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-198f1bb6-79f5-49dd-909b-812b43e0f46b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:43.141878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-198f1bb6-79f5-49dd-909b-812b43e0f46b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:43.168251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-198f1bb6-79f5-49dd-909b-812b43e0f46b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:43.168982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-198f1bb6-79f5-49dd-909b-812b43e0f46b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:43.169920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-198f1bb6-79f5-49dd-909b-812b43e0f46b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:43.170456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-198f1bb6-79f5-49dd-909b-812b43e0f46b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:43.179379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1aec2368-2619-42e4-9414-75ea1ab9635e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:43.182931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1aec2368-2619-42e4-9414-75ea1ab9635e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:43.191571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1aec2368-2619-42e4-9414-75ea1ab9635e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:43.193010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1aec2368-2619-42e4-9414-75ea1ab9635e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:43.193930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1aec2368-2619-42e4-9414-75ea1ab9635e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:43.194449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1aec2368-2619-42e4-9414-75ea1ab9635e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:43.219886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-198f1bb6-79f5-49dd-909b-812b43e0f46b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089367 Jul 25 19:31:43.220670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 366/761] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:43.231756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1aec2368-2619-42e4-9414-75ea1ab9635e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064654 Jul 25 19:31:43.232358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 396/762] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:44.235129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-de99baec-c3c0-4770-a688-21209e389e9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:44.238235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-de99baec-c3c0-4770-a688-21209e389e9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:44.247262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de99baec-c3c0-4770-a688-21209e389e9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:44.248017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de99baec-c3c0-4770-a688-21209e389e9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:44.249141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de99baec-c3c0-4770-a688-21209e389e9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:44.249630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb89c8a9-b451-403e-a639-a0fe7aa19ae3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:44.250408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de99baec-c3c0-4770-a688-21209e389e9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:44.259012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb89c8a9-b451-403e-a639-a0fe7aa19ae3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:44.294765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb89c8a9-b451-403e-a639-a0fe7aa19ae3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:44.295939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb89c8a9-b451-403e-a639-a0fe7aa19ae3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:44.298384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb89c8a9-b451-403e-a639-a0fe7aa19ae3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:44.299665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb89c8a9-b451-403e-a639-a0fe7aa19ae3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:44.306343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-de99baec-c3c0-4770-a688-21209e389e9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075716 Jul 25 19:31:44.306949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 367/763] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:44.355766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb89c8a9-b451-403e-a639-a0fe7aa19ae3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114880 Jul 25 19:31:44.356826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 397/764] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:45.324827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a4eab8e2-4930-46f0-9d91-7c8132a428ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:45.328375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a4eab8e2-4930-46f0-9d91-7c8132a428ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:45.339274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a4eab8e2-4930-46f0-9d91-7c8132a428ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:45.340077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a4eab8e2-4930-46f0-9d91-7c8132a428ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:45.341479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a4eab8e2-4930-46f0-9d91-7c8132a428ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:45.341951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a4eab8e2-4930-46f0-9d91-7c8132a428ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:45.382478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d61b65a-8782-497a-a165-da7fd6959988 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:45.387547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d61b65a-8782-497a-a165-da7fd6959988 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:45.388615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a4eab8e2-4930-46f0-9d91-7c8132a428ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071000 Jul 25 19:31:45.391995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 368/765] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:45.401069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d61b65a-8782-497a-a165-da7fd6959988 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:45.401781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d61b65a-8782-497a-a165-da7fd6959988 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:45.403142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d61b65a-8782-497a-a165-da7fd6959988 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:45.403923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d61b65a-8782-497a-a165-da7fd6959988 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:45.411655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:45.463649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d61b65a-8782-497a-a165-da7fd6959988 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092180 Jul 25 19:31:45.464633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 398/766] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:46.402582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-87c1ae4a-8369-476e-a1b9-da2dafed880a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:46.405384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-87c1ae4a-8369-476e-a1b9-da2dafed880a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:46.415349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87c1ae4a-8369-476e-a1b9-da2dafed880a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:46.416994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87c1ae4a-8369-476e-a1b9-da2dafed880a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:46.417543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87c1ae4a-8369-476e-a1b9-da2dafed880a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:46.418220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87c1ae4a-8369-476e-a1b9-da2dafed880a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:46.467734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-87c1ae4a-8369-476e-a1b9-da2dafed880a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069065 Jul 25 19:31:46.468859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 369/767] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:46.482945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5ec6391d-10fb-4255-9576-b150ec7390e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:46.486893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5ec6391d-10fb-4255-9576-b150ec7390e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:46.501662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ec6391d-10fb-4255-9576-b150ec7390e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:46.503292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ec6391d-10fb-4255-9576-b150ec7390e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:46.505763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ec6391d-10fb-4255-9576-b150ec7390e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:46.506775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ec6391d-10fb-4255-9576-b150ec7390e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:46.554891 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5ec6391d-10fb-4255-9576-b150ec7390e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080622 Jul 25 19:31:46.555617 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 399/768] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:47.487425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0fab17db-7a34-41b3-b10a-d1409da6cbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:47.491494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0fab17db-7a34-41b3-b10a-d1409da6cbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:47.501613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0fab17db-7a34-41b3-b10a-d1409da6cbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:47.502384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0fab17db-7a34-41b3-b10a-d1409da6cbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:47.503659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0fab17db-7a34-41b3-b10a-d1409da6cbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:47.504358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0fab17db-7a34-41b3-b10a-d1409da6cbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:47.557619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0fab17db-7a34-41b3-b10a-d1409da6cbdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076694 Jul 25 19:31:47.558331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 370/769] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:47.573802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15370679-173f-482a-a052-9d767e4bfc7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:47.578224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-15370679-173f-482a-a052-9d767e4bfc7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:47.582842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=56 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:47.591981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15370679-173f-482a-a052-9d767e4bfc7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:47.592430 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15370679-173f-482a-a052-9d767e4bfc7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:47.593568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15370679-173f-482a-a052-9d767e4bfc7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:47.594065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15370679-173f-482a-a052-9d767e4bfc7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:47.655044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15370679-173f-482a-a052-9d767e4bfc7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089249 Jul 25 19:31:47.656092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 400/770] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:48.580375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-901aea56-56c9-42b9-a2a1-27bd398a3126 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:48.585012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-901aea56-56c9-42b9-a2a1-27bd398a3126 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:48.600421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-901aea56-56c9-42b9-a2a1-27bd398a3126 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:48.600973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-901aea56-56c9-42b9-a2a1-27bd398a3126 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:48.602069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-901aea56-56c9-42b9-a2a1-27bd398a3126 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:48.602644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-901aea56-56c9-42b9-a2a1-27bd398a3126 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:48.647986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:48.654542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-901aea56-56c9-42b9-a2a1-27bd398a3126 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082582 Jul 25 19:31:48.655263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 371/771] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:48 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:48.669545 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0aa3b9fe-050d-4275-ac63-87a22d91d8bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:48.673347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0aa3b9fe-050d-4275-ac63-87a22d91d8bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:48.688558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0aa3b9fe-050d-4275-ac63-87a22d91d8bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:48.689597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0aa3b9fe-050d-4275-ac63-87a22d91d8bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:48.691423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0aa3b9fe-050d-4275-ac63-87a22d91d8bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:48.693274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0aa3b9fe-050d-4275-ac63-87a22d91d8bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:48.756490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0aa3b9fe-050d-4275-ac63-87a22d91d8bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090991 Jul 25 19:31:48.757544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 401/772] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:49.669458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0cef8645-8be7-47a0-93b9-cd392c9767c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:49.671923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0cef8645-8be7-47a0-93b9-cd392c9767c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:49.680187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cef8645-8be7-47a0-93b9-cd392c9767c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:49.680696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cef8645-8be7-47a0-93b9-cd392c9767c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:49.681587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cef8645-8be7-47a0-93b9-cd392c9767c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:49.682068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cef8645-8be7-47a0-93b9-cd392c9767c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:49.724211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0cef8645-8be7-47a0-93b9-cd392c9767c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058233 Jul 25 19:31:49.725219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 372/773] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:49.774812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ee5d0a8-3f4a-432f-a766-5a6da6bc3174 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:49.778517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ee5d0a8-3f4a-432f-a766-5a6da6bc3174 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:49.786203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ee5d0a8-3f4a-432f-a766-5a6da6bc3174 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:49.786984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ee5d0a8-3f4a-432f-a766-5a6da6bc3174 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:49.787880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ee5d0a8-3f4a-432f-a766-5a6da6bc3174 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:49.788382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ee5d0a8-3f4a-432f-a766-5a6da6bc3174 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:49.827937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ee5d0a8-3f4a-432f-a766-5a6da6bc3174 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059657 Jul 25 19:31:49.828750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 402/774] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:50.743231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-afe845eb-fe63-4d00-a5f3-6c9a96d80101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:50.745850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-afe845eb-fe63-4d00-a5f3-6c9a96d80101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:50.753560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afe845eb-fe63-4d00-a5f3-6c9a96d80101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:50.754004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afe845eb-fe63-4d00-a5f3-6c9a96d80101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:50.755403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afe845eb-fe63-4d00-a5f3-6c9a96d80101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:50.756074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afe845eb-fe63-4d00-a5f3-6c9a96d80101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:50.797174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-afe845eb-fe63-4d00-a5f3-6c9a96d80101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059798 Jul 25 19:31:50.802401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 373/775] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:50.845326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-71814b40-c47e-4881-9c12-cfb2c8a09f8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:50.859839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-71814b40-c47e-4881-9c12-cfb2c8a09f8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:50.862381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71814b40-c47e-4881-9c12-cfb2c8a09f8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:50.863179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71814b40-c47e-4881-9c12-cfb2c8a09f8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:50.865662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71814b40-c47e-4881-9c12-cfb2c8a09f8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:50.866333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71814b40-c47e-4881-9c12-cfb2c8a09f8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:50.925276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-71814b40-c47e-4881-9c12-cfb2c8a09f8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086039 Jul 25 19:31:50.927181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 403/776] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:51.816064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ee1247a0-daf6-4888-a2d3-59270d008a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:51.821780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ee1247a0-daf6-4888-a2d3-59270d008a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:51.843064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee1247a0-daf6-4888-a2d3-59270d008a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:51.843911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee1247a0-daf6-4888-a2d3-59270d008a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:51.845364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee1247a0-daf6-4888-a2d3-59270d008a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:51.846163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee1247a0-daf6-4888-a2d3-59270d008a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:51.900370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ee1247a0-daf6-4888-a2d3-59270d008a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092528 Jul 25 19:31:51.901302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 374/777] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:51.946616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-642c2278-de85-4933-9cdf-b5c7d0801559 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:51.950981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-642c2278-de85-4933-9cdf-b5c7d0801559 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:51.962263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-642c2278-de85-4933-9cdf-b5c7d0801559 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:51.963442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-642c2278-de85-4933-9cdf-b5c7d0801559 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:51.964979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-642c2278-de85-4933-9cdf-b5c7d0801559 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:51.974061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-642c2278-de85-4933-9cdf-b5c7d0801559 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:52.031819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-642c2278-de85-4933-9cdf-b5c7d0801559 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092252 Jul 25 19:31:52.032800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 404/778] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:52.916056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6c2c93c0-e411-4148-9149-a1e9ae1831b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:52.918425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6c2c93c0-e411-4148-9149-a1e9ae1831b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:52.927156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c2c93c0-e411-4148-9149-a1e9ae1831b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:52.927724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c2c93c0-e411-4148-9149-a1e9ae1831b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:52.928899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c2c93c0-e411-4148-9149-a1e9ae1831b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:52.929445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c2c93c0-e411-4148-9149-a1e9ae1831b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:52.972057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6c2c93c0-e411-4148-9149-a1e9ae1831b0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060924 Jul 25 19:31:52.972721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 375/779] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:52 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:53.056211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eba3c1d8-ff6f-47d5-87c2-3f60c2acef6c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:53.059080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eba3c1d8-ff6f-47d5-87c2-3f60c2acef6c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:53.070511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eba3c1d8-ff6f-47d5-87c2-3f60c2acef6c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:53.070872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eba3c1d8-ff6f-47d5-87c2-3f60c2acef6c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:53.072534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eba3c1d8-ff6f-47d5-87c2-3f60c2acef6c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:53.073277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eba3c1d8-ff6f-47d5-87c2-3f60c2acef6c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:53.124373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eba3c1d8-ff6f-47d5-87c2-3f60c2acef6c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075334 Jul 25 19:31:53.125689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 405/780] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:53.986923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e36781b3-9110-4304-8e53-2f918924fe58 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:53.990130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e36781b3-9110-4304-8e53-2f918924fe58 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:53.999603 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e36781b3-9110-4304-8e53-2f918924fe58 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:54.000394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e36781b3-9110-4304-8e53-2f918924fe58 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:54.001832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e36781b3-9110-4304-8e53-2f918924fe58 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:54.002661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e36781b3-9110-4304-8e53-2f918924fe58 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:54.039455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e36781b3-9110-4304-8e53-2f918924fe58 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056399 Jul 25 19:31:54.040203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 376/781] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:54.147317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ecb9d111-af7a-49e2-b0a9-74bf7c0ae378 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:54.151012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ecb9d111-af7a-49e2-b0a9-74bf7c0ae378 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:54.163813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecb9d111-af7a-49e2-b0a9-74bf7c0ae378 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:54.164559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecb9d111-af7a-49e2-b0a9-74bf7c0ae378 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:54.165784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecb9d111-af7a-49e2-b0a9-74bf7c0ae378 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:54.166696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecb9d111-af7a-49e2-b0a9-74bf7c0ae378 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:54.230057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ecb9d111-af7a-49e2-b0a9-74bf7c0ae378 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091699 Jul 25 19:31:54.231033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 406/782] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:55.057654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7228946e-1387-442d-90ad-495a899d59d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:55.060885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7228946e-1387-442d-90ad-495a899d59d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:55.072482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7228946e-1387-442d-90ad-495a899d59d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:55.073230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7228946e-1387-442d-90ad-495a899d59d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:55.074661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7228946e-1387-442d-90ad-495a899d59d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:55.075412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7228946e-1387-442d-90ad-495a899d59d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:55.136193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7228946e-1387-442d-90ad-495a899d59d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086436 Jul 25 19:31:55.136794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 377/783] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:55.247425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81fe126d-e594-4ab9-a1ec-dc97ba33ade2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:55.250455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81fe126d-e594-4ab9-a1ec-dc97ba33ade2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:55.259770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fe126d-e594-4ab9-a1ec-dc97ba33ade2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:55.260235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fe126d-e594-4ab9-a1ec-dc97ba33ade2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:55.261065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fe126d-e594-4ab9-a1ec-dc97ba33ade2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:55.261522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fe126d-e594-4ab9-a1ec-dc97ba33ade2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:55.307889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81fe126d-e594-4ab9-a1ec-dc97ba33ade2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066041 Jul 25 19:31:55.308495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 407/784] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:31:56.154973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4891caee-9935-425d-9b5f-8e3dca8c0cc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:56.158539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4891caee-9935-425d-9b5f-8e3dca8c0cc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:56.171862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4891caee-9935-425d-9b5f-8e3dca8c0cc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:56.172651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4891caee-9935-425d-9b5f-8e3dca8c0cc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:56.173979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4891caee-9935-425d-9b5f-8e3dca8c0cc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:56.174707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4891caee-9935-425d-9b5f-8e3dca8c0cc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:56.238273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4891caee-9935-425d-9b5f-8e3dca8c0cc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090153 Jul 25 19:31:56.241401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 378/785] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:56 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:56.326481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-166f4e57-d052-4661-8a5b-6e5097567f05 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:56.330321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-166f4e57-d052-4661-8a5b-6e5097567f05 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:56.343559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-166f4e57-d052-4661-8a5b-6e5097567f05 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:56.344405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-166f4e57-d052-4661-8a5b-6e5097567f05 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:56.345887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-166f4e57-d052-4661-8a5b-6e5097567f05 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:56.346904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-166f4e57-d052-4661-8a5b-6e5097567f05 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:56.408213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-166f4e57-d052-4661-8a5b-6e5097567f05 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089226 Jul 25 19:31:56.409165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 408/786] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:57.262413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ae33e8f1-0095-4715-be35-d50baae1449e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:57.264754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ae33e8f1-0095-4715-be35-d50baae1449e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:57.273045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae33e8f1-0095-4715-be35-d50baae1449e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:57.273513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae33e8f1-0095-4715-be35-d50baae1449e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:57.274341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae33e8f1-0095-4715-be35-d50baae1449e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:57.274796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae33e8f1-0095-4715-be35-d50baae1449e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:57.309093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ae33e8f1-0095-4715-be35-d50baae1449e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050977 Jul 25 19:31:57.309754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 379/787] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:57.428904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ca66b0fd-559d-46c4-b754-9f45c12f4a2d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:57.432420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ca66b0fd-559d-46c4-b754-9f45c12f4a2d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:57.444026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca66b0fd-559d-46c4-b754-9f45c12f4a2d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:57.444614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca66b0fd-559d-46c4-b754-9f45c12f4a2d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:57.446512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca66b0fd-559d-46c4-b754-9f45c12f4a2d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:57.447238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca66b0fd-559d-46c4-b754-9f45c12f4a2d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:57.499741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ca66b0fd-559d-46c4-b754-9f45c12f4a2d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077715 Jul 25 19:31:57.500645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 409/788] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:58.324199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-477cd6af-1df3-4472-8692-d79e7027eda4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:58.327997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-477cd6af-1df3-4472-8692-d79e7027eda4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:58.337102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-477cd6af-1df3-4472-8692-d79e7027eda4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:58.337102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-477cd6af-1df3-4472-8692-d79e7027eda4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:58.337102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-477cd6af-1df3-4472-8692-d79e7027eda4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:58.337731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-477cd6af-1df3-4472-8692-d79e7027eda4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:58.374189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-477cd6af-1df3-4472-8692-d79e7027eda4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055964 Jul 25 19:31:58.374976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 380/789] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:31:58.518754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1377ed37-e1c5-43c6-b659-42a3cab66756 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:58.523568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1377ed37-e1c5-43c6-b659-42a3cab66756 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:58.533390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1377ed37-e1c5-43c6-b659-42a3cab66756 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:58.534188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1377ed37-e1c5-43c6-b659-42a3cab66756 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:58.536222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1377ed37-e1c5-43c6-b659-42a3cab66756 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:58.537045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1377ed37-e1c5-43c6-b659-42a3cab66756 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:58.596396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1377ed37-e1c5-43c6-b659-42a3cab66756 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084020 Jul 25 19:31:58.597644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 410/790] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:31:58.960971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:31:58.961291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:31:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:31:59.393457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5a5cc003-101c-4f5b-8ac2-ffa2cd811ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:59.397925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5a5cc003-101c-4f5b-8ac2-ffa2cd811ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:59.412597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a5cc003-101c-4f5b-8ac2-ffa2cd811ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:59.413419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a5cc003-101c-4f5b-8ac2-ffa2cd811ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:59.415098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a5cc003-101c-4f5b-8ac2-ffa2cd811ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:59.415939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a5cc003-101c-4f5b-8ac2-ffa2cd811ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:59.482204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5a5cc003-101c-4f5b-8ac2-ffa2cd811ca7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096217 Jul 25 19:31:59.483034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 381/791] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:31:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:31:59.616315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0e15c93c-a6f7-46be-8427-380b2f628be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:59.618524 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0e15c93c-a6f7-46be-8427-380b2f628be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:59.625804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e15c93c-a6f7-46be-8427-380b2f628be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:59.626419 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e15c93c-a6f7-46be-8427-380b2f628be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:59.627209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e15c93c-a6f7-46be-8427-380b2f628be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:59.627675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e15c93c-a6f7-46be-8427-380b2f628be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:59.671871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0e15c93c-a6f7-46be-8427-380b2f628be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060098 Jul 25 19:31:59.672644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 411/792] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:31:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:00.499875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9c688b96-b75f-48c9-b5b4-d93ae4071e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:00.502854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9c688b96-b75f-48c9-b5b4-d93ae4071e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:00.512265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c688b96-b75f-48c9-b5b4-d93ae4071e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:00.512898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c688b96-b75f-48c9-b5b4-d93ae4071e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:00.513904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c688b96-b75f-48c9-b5b4-d93ae4071e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:00.514623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c688b96-b75f-48c9-b5b4-d93ae4071e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:00.562922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9c688b96-b75f-48c9-b5b4-d93ae4071e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068832 Jul 25 19:32:00.563940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 382/793] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:00.690506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb8d28b2-0df8-4e5e-a9d9-0c5ab5efce5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:00.693924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb8d28b2-0df8-4e5e-a9d9-0c5ab5efce5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:00.701310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb8d28b2-0df8-4e5e-a9d9-0c5ab5efce5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:00.701760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb8d28b2-0df8-4e5e-a9d9-0c5ab5efce5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:00.702552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb8d28b2-0df8-4e5e-a9d9-0c5ab5efce5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:00.703000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb8d28b2-0df8-4e5e-a9d9-0c5ab5efce5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:00.737703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb8d28b2-0df8-4e5e-a9d9-0c5ab5efce5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054616 Jul 25 19:32:00.738210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 412/794] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:01.581829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eeea63a9-9250-482d-a4fb-3ae2de4c3fc7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:01.585713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eeea63a9-9250-482d-a4fb-3ae2de4c3fc7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:01.597914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eeea63a9-9250-482d-a4fb-3ae2de4c3fc7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:01.598738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eeea63a9-9250-482d-a4fb-3ae2de4c3fc7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:01.600149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eeea63a9-9250-482d-a4fb-3ae2de4c3fc7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:01.600920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eeea63a9-9250-482d-a4fb-3ae2de4c3fc7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:01.662952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eeea63a9-9250-482d-a4fb-3ae2de4c3fc7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088822 Jul 25 19:32:01.664060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 383/795] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:01 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:01.751335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4066732-087a-40a4-9a3f-87f4b7108be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:01.755066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f4066732-087a-40a4-9a3f-87f4b7108be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:01.763047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4066732-087a-40a4-9a3f-87f4b7108be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:01.763722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4066732-087a-40a4-9a3f-87f4b7108be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:01.764536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4066732-087a-40a4-9a3f-87f4b7108be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:01.764972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4066732-087a-40a4-9a3f-87f4b7108be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:01.802882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4066732-087a-40a4-9a3f-87f4b7108be5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055691 Jul 25 19:32:01.803580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 413/796] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:02.680622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-27c0d0de-d316-4c05-b54e-124d25604f59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:02.682878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-27c0d0de-d316-4c05-b54e-124d25604f59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:02.689915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27c0d0de-d316-4c05-b54e-124d25604f59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:02.690361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27c0d0de-d316-4c05-b54e-124d25604f59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:02.691153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27c0d0de-d316-4c05-b54e-124d25604f59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:02.691628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27c0d0de-d316-4c05-b54e-124d25604f59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:02.732340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-27c0d0de-d316-4c05-b54e-124d25604f59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055964 Jul 25 19:32:02.733321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 384/797] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:02.820199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f096bef-b637-4361-9603-47e2dd799cab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:02.822632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f096bef-b637-4361-9603-47e2dd799cab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:02.830343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f096bef-b637-4361-9603-47e2dd799cab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:02.830704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f096bef-b637-4361-9603-47e2dd799cab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:02.831495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f096bef-b637-4361-9603-47e2dd799cab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:02.832744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f096bef-b637-4361-9603-47e2dd799cab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:02.871025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:02.885892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f096bef-b637-4361-9603-47e2dd799cab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069500 Jul 25 19:32:02.886971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 414/798] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:03.747086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-010d335d-c9cc-448c-86fa-4eb3f03bd912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:03.749570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-010d335d-c9cc-448c-86fa-4eb3f03bd912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:03.752200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=56 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:03.762120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-010d335d-c9cc-448c-86fa-4eb3f03bd912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:03.762912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-010d335d-c9cc-448c-86fa-4eb3f03bd912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:03.764364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-010d335d-c9cc-448c-86fa-4eb3f03bd912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:03.765136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-010d335d-c9cc-448c-86fa-4eb3f03bd912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:03.821913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-010d335d-c9cc-448c-86fa-4eb3f03bd912 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078932 Jul 25 19:32:03.822914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 385/799] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:03.907181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6022ab4d-6ee1-467e-b364-fb872d604d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:03.911846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6022ab4d-6ee1-467e-b364-fb872d604d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:03.921925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6022ab4d-6ee1-467e-b364-fb872d604d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:03.922662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6022ab4d-6ee1-467e-b364-fb872d604d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:03.923760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6022ab4d-6ee1-467e-b364-fb872d604d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:03.924214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6022ab4d-6ee1-467e-b364-fb872d604d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:03.972295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6022ab4d-6ee1-467e-b364-fb872d604d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072514 Jul 25 19:32:03.973361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 415/800] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:03 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:04.843431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f6201d20-aad9-4f79-bd9b-cc576928a43c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:04.850188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f6201d20-aad9-4f79-bd9b-cc576928a43c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:04.861059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6201d20-aad9-4f79-bd9b-cc576928a43c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:04.861639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6201d20-aad9-4f79-bd9b-cc576928a43c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:04.862712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6201d20-aad9-4f79-bd9b-cc576928a43c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:04.863261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6201d20-aad9-4f79-bd9b-cc576928a43c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:04.912331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f6201d20-aad9-4f79-bd9b-cc576928a43c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076230 Jul 25 19:32:04.913101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 386/801] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:04.989609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-786c73f4-a7a8-4432-9ed6-188fe4427885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:04.992026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-786c73f4-a7a8-4432-9ed6-188fe4427885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:04.999706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-786c73f4-a7a8-4432-9ed6-188fe4427885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:05.000317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-786c73f4-a7a8-4432-9ed6-188fe4427885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:05.001583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-786c73f4-a7a8-4432-9ed6-188fe4427885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:05.002289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-786c73f4-a7a8-4432-9ed6-188fe4427885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:05.057887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-786c73f4-a7a8-4432-9ed6-188fe4427885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072635 Jul 25 19:32:05.059068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 416/802] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:05.929653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fd490e85-d7b6-49c9-a65b-0c19ba98dcaa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:05.933239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fd490e85-d7b6-49c9-a65b-0c19ba98dcaa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:05.944622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fd490e85-d7b6-49c9-a65b-0c19ba98dcaa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:05.945308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fd490e85-d7b6-49c9-a65b-0c19ba98dcaa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:05.946562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fd490e85-d7b6-49c9-a65b-0c19ba98dcaa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:05.947204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fd490e85-d7b6-49c9-a65b-0c19ba98dcaa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:06.000432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fd490e85-d7b6-49c9-a65b-0c19ba98dcaa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077814 Jul 25 19:32:06.001358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 387/803] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:06.079454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d8de6c66-cb19-4b03-9cb1-897d2aa96ddb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:06.084423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d8de6c66-cb19-4b03-9cb1-897d2aa96ddb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:06.097378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8de6c66-cb19-4b03-9cb1-897d2aa96ddb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:06.099298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8de6c66-cb19-4b03-9cb1-897d2aa96ddb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:06.100568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8de6c66-cb19-4b03-9cb1-897d2aa96ddb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:06.101542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8de6c66-cb19-4b03-9cb1-897d2aa96ddb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:06.171482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d8de6c66-cb19-4b03-9cb1-897d2aa96ddb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099313 Jul 25 19:32:06.173003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 417/804] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:07.019554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1e87690b-0a25-49ac-b368-cd1cc73b74d5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:07.022474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1e87690b-0a25-49ac-b368-cd1cc73b74d5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:07.031031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e87690b-0a25-49ac-b368-cd1cc73b74d5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:07.031461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e87690b-0a25-49ac-b368-cd1cc73b74d5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:07.032475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e87690b-0a25-49ac-b368-cd1cc73b74d5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:07.033110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e87690b-0a25-49ac-b368-cd1cc73b74d5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:07.052853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:07.076479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1e87690b-0a25-49ac-b368-cd1cc73b74d5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062305 Jul 25 19:32:07.077213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 388/805] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:07.188113 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-edbf8d7c-c9ae-4677-81a9-954c55ea9948 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:07.191275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-edbf8d7c-c9ae-4677-81a9-954c55ea9948 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:07.201496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edbf8d7c-c9ae-4677-81a9-954c55ea9948 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:07.202075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edbf8d7c-c9ae-4677-81a9-954c55ea9948 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:07.203078 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edbf8d7c-c9ae-4677-81a9-954c55ea9948 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:07.203554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edbf8d7c-c9ae-4677-81a9-954c55ea9948 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:07.241462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-edbf8d7c-c9ae-4677-81a9-954c55ea9948 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057811 Jul 25 19:32:07.242182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 418/806] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:08.094113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5107f1e1-97e3-411a-8af1-d091c0050c8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:08.097611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5107f1e1-97e3-411a-8af1-d091c0050c8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:08.106132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5107f1e1-97e3-411a-8af1-d091c0050c8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:08.106628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5107f1e1-97e3-411a-8af1-d091c0050c8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:08.107609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5107f1e1-97e3-411a-8af1-d091c0050c8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:08.108115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5107f1e1-97e3-411a-8af1-d091c0050c8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:08.146497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5107f1e1-97e3-411a-8af1-d091c0050c8e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056937 Jul 25 19:32:08.147351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 389/807] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:08.255697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4e8f019-677e-4ecc-baa1-a1d669e3d1c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:08.258587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c4e8f019-677e-4ecc-baa1-a1d669e3d1c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:08.266230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4e8f019-677e-4ecc-baa1-a1d669e3d1c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:08.266824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4e8f019-677e-4ecc-baa1-a1d669e3d1c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:08.267655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4e8f019-677e-4ecc-baa1-a1d669e3d1c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:08.268102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4e8f019-677e-4ecc-baa1-a1d669e3d1c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:08.304395 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c4e8f019-677e-4ecc-baa1-a1d669e3d1c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053593 Jul 25 19:32:08.305378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 419/808] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:09.160624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e8cd5ac5-f4c2-44b8-a369-f71353e8c25a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:09.163092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e8cd5ac5-f4c2-44b8-a369-f71353e8c25a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:09.172263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8cd5ac5-f4c2-44b8-a369-f71353e8c25a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:09.172804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8cd5ac5-f4c2-44b8-a369-f71353e8c25a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:09.173826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8cd5ac5-f4c2-44b8-a369-f71353e8c25a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:09.174362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8cd5ac5-f4c2-44b8-a369-f71353e8c25a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:09.214529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e8cd5ac5-f4c2-44b8-a369-f71353e8c25a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058259 Jul 25 19:32:09.214985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 390/809] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:09.319625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2924b2da-c5c3-4620-8b14-4fe81fef0b77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:09.321992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2924b2da-c5c3-4620-8b14-4fe81fef0b77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:09.330313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2924b2da-c5c3-4620-8b14-4fe81fef0b77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:09.330888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2924b2da-c5c3-4620-8b14-4fe81fef0b77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:09.331936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2924b2da-c5c3-4620-8b14-4fe81fef0b77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:09.332492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2924b2da-c5c3-4620-8b14-4fe81fef0b77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:09.376181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2924b2da-c5c3-4620-8b14-4fe81fef0b77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059920 Jul 25 19:32:09.376181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 420/810] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:10.228242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0cb14eaa-64eb-4c7f-b1fe-8b9fe1907444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:10.230866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0cb14eaa-64eb-4c7f-b1fe-8b9fe1907444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:10.239475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cb14eaa-64eb-4c7f-b1fe-8b9fe1907444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:10.240138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cb14eaa-64eb-4c7f-b1fe-8b9fe1907444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:10.241069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cb14eaa-64eb-4c7f-b1fe-8b9fe1907444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:10.241607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cb14eaa-64eb-4c7f-b1fe-8b9fe1907444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:10.279960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0cb14eaa-64eb-4c7f-b1fe-8b9fe1907444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056698 Jul 25 19:32:10.280555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 391/811] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:10.395898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-71081a5b-29e4-41f8-b1d2-08547560f913 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:10.399827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-71081a5b-29e4-41f8-b1d2-08547560f913 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:10.411923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71081a5b-29e4-41f8-b1d2-08547560f913 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:10.412661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71081a5b-29e4-41f8-b1d2-08547560f913 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:10.413921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71081a5b-29e4-41f8-b1d2-08547560f913 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:10.414705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71081a5b-29e4-41f8-b1d2-08547560f913 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:10.476731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-71081a5b-29e4-41f8-b1d2-08547560f913 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089348 Jul 25 19:32:10.477819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 421/812] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:11.293831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c999e31c-be9d-4542-9aa5-ee4e46fec2c5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:11.296259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c999e31c-be9d-4542-9aa5-ee4e46fec2c5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:11.303639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c999e31c-be9d-4542-9aa5-ee4e46fec2c5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:11.304091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c999e31c-be9d-4542-9aa5-ee4e46fec2c5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:11.304959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c999e31c-be9d-4542-9aa5-ee4e46fec2c5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:11.305411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c999e31c-be9d-4542-9aa5-ee4e46fec2c5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:11.341156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c999e31c-be9d-4542-9aa5-ee4e46fec2c5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051385 Jul 25 19:32:11.341771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 392/813] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:11.493004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d025d8ce-e3cf-4e0c-ac50-4b58d5d6561a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:11.495463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d025d8ce-e3cf-4e0c-ac50-4b58d5d6561a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:11.503982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d025d8ce-e3cf-4e0c-ac50-4b58d5d6561a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:11.505162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d025d8ce-e3cf-4e0c-ac50-4b58d5d6561a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:11.506507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d025d8ce-e3cf-4e0c-ac50-4b58d5d6561a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:11.507199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d025d8ce-e3cf-4e0c-ac50-4b58d5d6561a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:11.547188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d025d8ce-e3cf-4e0c-ac50-4b58d5d6561a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060947 Jul 25 19:32:11.547780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 422/814] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:11 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:12.354945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c0c1a07f-169b-4c6a-bac9-bb700fe9382a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:12.357167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c0c1a07f-169b-4c6a-bac9-bb700fe9382a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:12.365050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0c1a07f-169b-4c6a-bac9-bb700fe9382a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:12.365495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0c1a07f-169b-4c6a-bac9-bb700fe9382a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:12.366291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0c1a07f-169b-4c6a-bac9-bb700fe9382a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:12.366725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0c1a07f-169b-4c6a-bac9-bb700fe9382a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:12.409807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c0c1a07f-169b-4c6a-bac9-bb700fe9382a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058953 Jul 25 19:32:12.411081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 393/815] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:12.560824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e405d469-ac41-4fc8-9f19-cef5cc616634 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:12.563171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e405d469-ac41-4fc8-9f19-cef5cc616634 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:12.571475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e405d469-ac41-4fc8-9f19-cef5cc616634 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:12.572022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e405d469-ac41-4fc8-9f19-cef5cc616634 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:12.572925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e405d469-ac41-4fc8-9f19-cef5cc616634 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:12.573608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e405d469-ac41-4fc8-9f19-cef5cc616634 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:12.612105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e405d469-ac41-4fc8-9f19-cef5cc616634 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055431 Jul 25 19:32:12.612809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 423/816] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:13.427567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-83023777-d378-4eb7-80a3-31948056dcdc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:13.431300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-83023777-d378-4eb7-80a3-31948056dcdc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:13.443217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83023777-d378-4eb7-80a3-31948056dcdc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:13.444028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83023777-d378-4eb7-80a3-31948056dcdc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:13.445233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83023777-d378-4eb7-80a3-31948056dcdc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:13.445880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83023777-d378-4eb7-80a3-31948056dcdc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:13.495200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-83023777-d378-4eb7-80a3-31948056dcdc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075449 Jul 25 19:32:13.496007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 394/817] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:13.626131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-461f6492-b916-4ee6-970d-5e7c6878f530 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:13.628512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-461f6492-b916-4ee6-970d-5e7c6878f530 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:13.636782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-461f6492-b916-4ee6-970d-5e7c6878f530 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:13.637381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-461f6492-b916-4ee6-970d-5e7c6878f530 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:13.638029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-461f6492-b916-4ee6-970d-5e7c6878f530 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:13.638462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-461f6492-b916-4ee6-970d-5e7c6878f530 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:13.678467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-461f6492-b916-4ee6-970d-5e7c6878f530 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057137 Jul 25 19:32:13.679132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 424/818] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:14.512620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c732cb3f-351f-4c12-b43c-05ad05fa1321 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:14.516618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c732cb3f-351f-4c12-b43c-05ad05fa1321 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:14.533815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c732cb3f-351f-4c12-b43c-05ad05fa1321 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:14.534789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c732cb3f-351f-4c12-b43c-05ad05fa1321 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:14.537106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c732cb3f-351f-4c12-b43c-05ad05fa1321 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:14.537937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c732cb3f-351f-4c12-b43c-05ad05fa1321 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:14.602003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c732cb3f-351f-4c12-b43c-05ad05fa1321 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093948 Jul 25 19:32:14.603046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 395/819] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:14.691735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f599b710-bfa4-4967-b3d4-b473804379b8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:14.694854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f599b710-bfa4-4967-b3d4-b473804379b8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:14.705584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f599b710-bfa4-4967-b3d4-b473804379b8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:14.706265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f599b710-bfa4-4967-b3d4-b473804379b8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:14.707567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f599b710-bfa4-4967-b3d4-b473804379b8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:14.708091 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f599b710-bfa4-4967-b3d4-b473804379b8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:14.770726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f599b710-bfa4-4967-b3d4-b473804379b8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082293 Jul 25 19:32:14.771860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 425/820] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:14 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:15.615997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7f4aab40-a40b-48a5-8b62-9c2839b51b01 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:15.618532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7f4aab40-a40b-48a5-8b62-9c2839b51b01 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:15.627763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f4aab40-a40b-48a5-8b62-9c2839b51b01 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:15.628418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f4aab40-a40b-48a5-8b62-9c2839b51b01 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:15.630510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f4aab40-a40b-48a5-8b62-9c2839b51b01 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:15.631172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f4aab40-a40b-48a5-8b62-9c2839b51b01 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:15.667332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7f4aab40-a40b-48a5-8b62-9c2839b51b01 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056491 Jul 25 19:32:15.667965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 396/821] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:15.789999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ab927a8d-66a0-4984-aba6-4f6f75ed1b79 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:15.793257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ab927a8d-66a0-4984-aba6-4f6f75ed1b79 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:15.800866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab927a8d-66a0-4984-aba6-4f6f75ed1b79 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:15.801764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab927a8d-66a0-4984-aba6-4f6f75ed1b79 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:15.802794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab927a8d-66a0-4984-aba6-4f6f75ed1b79 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:15.803235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab927a8d-66a0-4984-aba6-4f6f75ed1b79 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:15.838930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ab927a8d-66a0-4984-aba6-4f6f75ed1b79 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055706 Jul 25 19:32:15.839572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 426/822] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:16.681648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1ea086d0-f6f8-4e8b-b90d-ec736b391074 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:16.684124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1ea086d0-f6f8-4e8b-b90d-ec736b391074 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:16.692885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ea086d0-f6f8-4e8b-b90d-ec736b391074 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:16.693376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ea086d0-f6f8-4e8b-b90d-ec736b391074 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:16.694201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ea086d0-f6f8-4e8b-b90d-ec736b391074 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:16.694643 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ea086d0-f6f8-4e8b-b90d-ec736b391074 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:16.732770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1ea086d0-f6f8-4e8b-b90d-ec736b391074 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055815 Jul 25 19:32:16.733528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 397/823] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:16.858944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c50e4959-9914-420a-9738-cdf6367448e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:16.862861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c50e4959-9914-420a-9738-cdf6367448e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:16.877888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c50e4959-9914-420a-9738-cdf6367448e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:16.878653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c50e4959-9914-420a-9738-cdf6367448e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:16.881561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c50e4959-9914-420a-9738-cdf6367448e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:16.882358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c50e4959-9914-420a-9738-cdf6367448e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:16.943036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c50e4959-9914-420a-9738-cdf6367448e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091919 Jul 25 19:32:16.944275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 427/824] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:17.746926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3783fe4e-08fc-4313-bf92-21b34676ef48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:17.749765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3783fe4e-08fc-4313-bf92-21b34676ef48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:17.759119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3783fe4e-08fc-4313-bf92-21b34676ef48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:17.759602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3783fe4e-08fc-4313-bf92-21b34676ef48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:17.760409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3783fe4e-08fc-4313-bf92-21b34676ef48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:17.760855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3783fe4e-08fc-4313-bf92-21b34676ef48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:17.800584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3783fe4e-08fc-4313-bf92-21b34676ef48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057997 Jul 25 19:32:17.802646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 398/825] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:17.963757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c35fe55c-7f3d-4f97-92d1-6aada1727f5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:17.967307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c35fe55c-7f3d-4f97-92d1-6aada1727f5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:17.971025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=56 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:17.978520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c35fe55c-7f3d-4f97-92d1-6aada1727f5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:17.978965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c35fe55c-7f3d-4f97-92d1-6aada1727f5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:17.979804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c35fe55c-7f3d-4f97-92d1-6aada1727f5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:17.980240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c35fe55c-7f3d-4f97-92d1-6aada1727f5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:18.020831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c35fe55c-7f3d-4f97-92d1-6aada1727f5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064267 Jul 25 19:32:18.021311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 428/826] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:18.820393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dc956c9e-2b4d-415c-b290-2c55f6011eb0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:18.824094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dc956c9e-2b4d-415c-b290-2c55f6011eb0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:18.837757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc956c9e-2b4d-415c-b290-2c55f6011eb0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:18.838699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc956c9e-2b4d-415c-b290-2c55f6011eb0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:18.840061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc956c9e-2b4d-415c-b290-2c55f6011eb0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:18.840903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc956c9e-2b4d-415c-b290-2c55f6011eb0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:18.891655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dc956c9e-2b4d-415c-b290-2c55f6011eb0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079986 Jul 25 19:32:18.892413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 399/827] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:19.038886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-38600140-fef1-46f7-8959-3d913285dfad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:19.042745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-38600140-fef1-46f7-8959-3d913285dfad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:19.055982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38600140-fef1-46f7-8959-3d913285dfad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:19.056811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38600140-fef1-46f7-8959-3d913285dfad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:19.058207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38600140-fef1-46f7-8959-3d913285dfad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:19.058987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38600140-fef1-46f7-8959-3d913285dfad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:19.108811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-38600140-fef1-46f7-8959-3d913285dfad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077279 Jul 25 19:32:19.109785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 429/828] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:19.909768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-79fca793-3889-4e84-9dc1-edc61f993140 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:19.914164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-79fca793-3889-4e84-9dc1-edc61f993140 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:19.926382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79fca793-3889-4e84-9dc1-edc61f993140 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:19.927173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79fca793-3889-4e84-9dc1-edc61f993140 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:19.928670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79fca793-3889-4e84-9dc1-edc61f993140 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:19.929974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79fca793-3889-4e84-9dc1-edc61f993140 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:19.992109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-79fca793-3889-4e84-9dc1-edc61f993140 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089276 Jul 25 19:32:19.993058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 400/829] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:20.130849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f289cdfe-6cdd-4720-920b-69f49ed4dfd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:20.134557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f289cdfe-6cdd-4720-920b-69f49ed4dfd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:20.147811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f289cdfe-6cdd-4720-920b-69f49ed4dfd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:20.148506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f289cdfe-6cdd-4720-920b-69f49ed4dfd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:20.149949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f289cdfe-6cdd-4720-920b-69f49ed4dfd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:20.150847 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f289cdfe-6cdd-4720-920b-69f49ed4dfd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:20.216236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f289cdfe-6cdd-4720-920b-69f49ed4dfd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093066 Jul 25 19:32:20.217378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 430/830] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:21.012362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-698fddde-df4d-4d14-bf4e-3c15285f8dc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:21.015735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-698fddde-df4d-4d14-bf4e-3c15285f8dc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:21.027036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-698fddde-df4d-4d14-bf4e-3c15285f8dc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:21.027770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-698fddde-df4d-4d14-bf4e-3c15285f8dc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:21.029064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-698fddde-df4d-4d14-bf4e-3c15285f8dc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:21.029756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-698fddde-df4d-4d14-bf4e-3c15285f8dc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:21.089192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-698fddde-df4d-4d14-bf4e-3c15285f8dc2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083284 Jul 25 19:32:21.089902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 401/831] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:21.234235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e9b2b692-fc16-4a9a-82e2-7148b1f257cc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:21.236520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e9b2b692-fc16-4a9a-82e2-7148b1f257cc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:21.244806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9b2b692-fc16-4a9a-82e2-7148b1f257cc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:21.245306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9b2b692-fc16-4a9a-82e2-7148b1f257cc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:21.246282 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9b2b692-fc16-4a9a-82e2-7148b1f257cc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:21.246770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9b2b692-fc16-4a9a-82e2-7148b1f257cc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:21.268616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:21.304352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e9b2b692-fc16-4a9a-82e2-7148b1f257cc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073956 Jul 25 19:32:21.305314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 431/832] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:22.109446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-37f674ef-1239-48a5-89f2-b72606329df5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:22.113385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-37f674ef-1239-48a5-89f2-b72606329df5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:22.126254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37f674ef-1239-48a5-89f2-b72606329df5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:22.127047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37f674ef-1239-48a5-89f2-b72606329df5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:22.128488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37f674ef-1239-48a5-89f2-b72606329df5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:22.130062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37f674ef-1239-48a5-89f2-b72606329df5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:22.194087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-37f674ef-1239-48a5-89f2-b72606329df5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093153 Jul 25 19:32:22.195160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 402/833] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:22.325692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-886efa40-b25a-4135-b730-7f88c09423cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:22.329632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-886efa40-b25a-4135-b730-7f88c09423cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:22.342874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-886efa40-b25a-4135-b730-7f88c09423cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:22.343731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-886efa40-b25a-4135-b730-7f88c09423cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:22.345257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-886efa40-b25a-4135-b730-7f88c09423cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:22.346055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-886efa40-b25a-4135-b730-7f88c09423cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:22.415840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-886efa40-b25a-4135-b730-7f88c09423cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098268 Jul 25 19:32:22.416989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 432/834] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:23.213800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c211615d-a754-4870-9860-6cdb3645aa8b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:23.217613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c211615d-a754-4870-9860-6cdb3645aa8b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:23.231685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c211615d-a754-4870-9860-6cdb3645aa8b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:23.232630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c211615d-a754-4870-9860-6cdb3645aa8b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:23.234124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c211615d-a754-4870-9860-6cdb3645aa8b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:23.234876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c211615d-a754-4870-9860-6cdb3645aa8b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:23.302621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c211615d-a754-4870-9860-6cdb3645aa8b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095629 Jul 25 19:32:23.303756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 403/835] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:23.437176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-501c41d1-5d3a-40a9-bd16-bf98c02d6f1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:23.440979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-501c41d1-5d3a-40a9-bd16-bf98c02d6f1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:23.454752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-501c41d1-5d3a-40a9-bd16-bf98c02d6f1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:23.455600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-501c41d1-5d3a-40a9-bd16-bf98c02d6f1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:23.457088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-501c41d1-5d3a-40a9-bd16-bf98c02d6f1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:23.459368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-501c41d1-5d3a-40a9-bd16-bf98c02d6f1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:23.497010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-501c41d1-5d3a-40a9-bd16-bf98c02d6f1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067515 Jul 25 19:32:23.497606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 433/836] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:24.320003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-406d962f-bd97-4606-9bf0-4c40a07b270c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:24.322647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-406d962f-bd97-4606-9bf0-4c40a07b270c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:24.331025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-406d962f-bd97-4606-9bf0-4c40a07b270c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:24.331472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-406d962f-bd97-4606-9bf0-4c40a07b270c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:24.332341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-406d962f-bd97-4606-9bf0-4c40a07b270c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:24.332786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-406d962f-bd97-4606-9bf0-4c40a07b270c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:24.377485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-406d962f-bd97-4606-9bf0-4c40a07b270c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062507 Jul 25 19:32:24.378151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 404/837] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:24.515172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2c727b7-c999-4368-9626-3381c39daf64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:24.519000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c2c727b7-c999-4368-9626-3381c39daf64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:24.531880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2c727b7-c999-4368-9626-3381c39daf64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:24.532685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2c727b7-c999-4368-9626-3381c39daf64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:24.534121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2c727b7-c999-4368-9626-3381c39daf64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:24.534906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2c727b7-c999-4368-9626-3381c39daf64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:24.596828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2c727b7-c999-4368-9626-3381c39daf64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089145 Jul 25 19:32:24.598350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 434/838] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:25.395570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c5c2d752-4598-4dcf-88b8-a19ad81457a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:25.398845 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c5c2d752-4598-4dcf-88b8-a19ad81457a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:25.406430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5c2d752-4598-4dcf-88b8-a19ad81457a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:25.406930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5c2d752-4598-4dcf-88b8-a19ad81457a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:25.407904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5c2d752-4598-4dcf-88b8-a19ad81457a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:25.408658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5c2d752-4598-4dcf-88b8-a19ad81457a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:25.413223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:25.450512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c5c2d752-4598-4dcf-88b8-a19ad81457a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062272 Jul 25 19:32:25.451533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 405/839] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:25.616731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-083f2d2e-c2d5-49f6-ba20-ad492c867c2b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:25.620294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-083f2d2e-c2d5-49f6-ba20-ad492c867c2b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:25.630413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-083f2d2e-c2d5-49f6-ba20-ad492c867c2b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:25.631144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-083f2d2e-c2d5-49f6-ba20-ad492c867c2b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:25.632485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-083f2d2e-c2d5-49f6-ba20-ad492c867c2b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:25.633210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-083f2d2e-c2d5-49f6-ba20-ad492c867c2b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:25.679332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-083f2d2e-c2d5-49f6-ba20-ad492c867c2b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070408 Jul 25 19:32:25.680156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 435/840] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:26.468276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf30d4f5-5d98-462c-a682-af9f0dd78f10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:26.472011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cf30d4f5-5d98-462c-a682-af9f0dd78f10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:26.485513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf30d4f5-5d98-462c-a682-af9f0dd78f10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:26.486312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf30d4f5-5d98-462c-a682-af9f0dd78f10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:26.487894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf30d4f5-5d98-462c-a682-af9f0dd78f10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:26.489281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf30d4f5-5d98-462c-a682-af9f0dd78f10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:26.551471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cf30d4f5-5d98-462c-a682-af9f0dd78f10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090629 Jul 25 19:32:26.552630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 406/841] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:26.698892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50125364-1c55-4de4-9ad4-8e97aa9e7b07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:26.701855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50125364-1c55-4de4-9ad4-8e97aa9e7b07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:26.716600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50125364-1c55-4de4-9ad4-8e97aa9e7b07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:26.717367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50125364-1c55-4de4-9ad4-8e97aa9e7b07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:26.718432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50125364-1c55-4de4-9ad4-8e97aa9e7b07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:26.718789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50125364-1c55-4de4-9ad4-8e97aa9e7b07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:26.760416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50125364-1c55-4de4-9ad4-8e97aa9e7b07 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069130 Jul 25 19:32:26.761035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 436/842] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:27.564824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-670726da-765b-4d49-80aa-969ffc5703c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:27.567683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-670726da-765b-4d49-80aa-969ffc5703c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:27.575445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-670726da-765b-4d49-80aa-969ffc5703c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:27.575942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-670726da-765b-4d49-80aa-969ffc5703c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:27.576729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-670726da-765b-4d49-80aa-969ffc5703c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:27.577174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-670726da-765b-4d49-80aa-969ffc5703c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:27.615854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-670726da-765b-4d49-80aa-969ffc5703c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055103 Jul 25 19:32:27.616453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 407/843] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:27.774887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74529d00-1325-4cac-8c2e-1b92ba381628 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:27.777808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-74529d00-1325-4cac-8c2e-1b92ba381628 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:27.787339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74529d00-1325-4cac-8c2e-1b92ba381628 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:27.788153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74529d00-1325-4cac-8c2e-1b92ba381628 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:27.789560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74529d00-1325-4cac-8c2e-1b92ba381628 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:27.790343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74529d00-1325-4cac-8c2e-1b92ba381628 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:27.850897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74529d00-1325-4cac-8c2e-1b92ba381628 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080514 Jul 25 19:32:27.851927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 437/844] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:28.633870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-34823857-9ae8-41ef-9a1a-70035586d5e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:28.636242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-34823857-9ae8-41ef-9a1a-70035586d5e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:28.643886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34823857-9ae8-41ef-9a1a-70035586d5e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:28.644453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34823857-9ae8-41ef-9a1a-70035586d5e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:28.645889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34823857-9ae8-41ef-9a1a-70035586d5e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:28.646037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34823857-9ae8-41ef-9a1a-70035586d5e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:28.683920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-34823857-9ae8-41ef-9a1a-70035586d5e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055619 Jul 25 19:32:28.684542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 408/845] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:28.870647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc6b05ba-7139-4f01-87bb-c193431d3682 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:28.874010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cc6b05ba-7139-4f01-87bb-c193431d3682 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:28.886796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc6b05ba-7139-4f01-87bb-c193431d3682 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:28.887437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc6b05ba-7139-4f01-87bb-c193431d3682 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:28.888752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc6b05ba-7139-4f01-87bb-c193431d3682 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:28.889482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc6b05ba-7139-4f01-87bb-c193431d3682 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:28.933834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cc6b05ba-7139-4f01-87bb-c193431d3682 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070037 Jul 25 19:32:28.934440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 438/846] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:29.699425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8f04acb6-b77f-4a17-8cff-73cb77ec01c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:29.702192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8f04acb6-b77f-4a17-8cff-73cb77ec01c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:29.709863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f04acb6-b77f-4a17-8cff-73cb77ec01c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:29.710306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f04acb6-b77f-4a17-8cff-73cb77ec01c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:29.711115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f04acb6-b77f-4a17-8cff-73cb77ec01c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:29.711595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f04acb6-b77f-4a17-8cff-73cb77ec01c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:29.749701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8f04acb6-b77f-4a17-8cff-73cb77ec01c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055602 Jul 25 19:32:29.750688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 409/847] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:29 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:29.952700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-25c1b970-3410-4c6a-a8b4-5fa5548ca394 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:29.956718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-25c1b970-3410-4c6a-a8b4-5fa5548ca394 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:29.970045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25c1b970-3410-4c6a-a8b4-5fa5548ca394 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:29.970821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25c1b970-3410-4c6a-a8b4-5fa5548ca394 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:29.972265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25c1b970-3410-4c6a-a8b4-5fa5548ca394 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:29.973804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25c1b970-3410-4c6a-a8b4-5fa5548ca394 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:30.036139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-25c1b970-3410-4c6a-a8b4-5fa5548ca394 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089539 Jul 25 19:32:30.037123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 439/848] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:29 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:30.765150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f27f9918-22ee-4c44-b59e-f28930a2a94d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:30.767371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f27f9918-22ee-4c44-b59e-f28930a2a94d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:30.776035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f27f9918-22ee-4c44-b59e-f28930a2a94d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:30.776810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f27f9918-22ee-4c44-b59e-f28930a2a94d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:30.777724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f27f9918-22ee-4c44-b59e-f28930a2a94d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:30.778260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f27f9918-22ee-4c44-b59e-f28930a2a94d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:30.821240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f27f9918-22ee-4c44-b59e-f28930a2a94d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059979 Jul 25 19:32:30.822081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 410/849] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:31.053937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a1c9ef25-081c-4248-a0c3-43ee4a41eb74 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:31.056176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a1c9ef25-081c-4248-a0c3-43ee4a41eb74 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:31.063271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1c9ef25-081c-4248-a0c3-43ee4a41eb74 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:31.063726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1c9ef25-081c-4248-a0c3-43ee4a41eb74 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:31.064505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1c9ef25-081c-4248-a0c3-43ee4a41eb74 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:31.064934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1c9ef25-081c-4248-a0c3-43ee4a41eb74 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:31.104853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a1c9ef25-081c-4248-a0c3-43ee4a41eb74 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056097 Jul 25 19:32:31.105639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 440/850] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:31.837281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3cc45a6e-bee4-4e9b-82c9-e88c516036d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:31.840227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3cc45a6e-bee4-4e9b-82c9-e88c516036d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:31.848069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3cc45a6e-bee4-4e9b-82c9-e88c516036d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:31.848580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3cc45a6e-bee4-4e9b-82c9-e88c516036d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:31.850303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3cc45a6e-bee4-4e9b-82c9-e88c516036d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:31.850806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3cc45a6e-bee4-4e9b-82c9-e88c516036d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:31.889242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3cc45a6e-bee4-4e9b-82c9-e88c516036d1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057598 Jul 25 19:32:31.889836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 411/851] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:32.123165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-67781fd9-625d-4186-900d-217f63e8e367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:32.127027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-67781fd9-625d-4186-900d-217f63e8e367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:32.136723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67781fd9-625d-4186-900d-217f63e8e367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:32.137212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67781fd9-625d-4186-900d-217f63e8e367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:32.138075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67781fd9-625d-4186-900d-217f63e8e367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:32.138522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67781fd9-625d-4186-900d-217f63e8e367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:32.182098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-67781fd9-625d-4186-900d-217f63e8e367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066721 Jul 25 19:32:32.182755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 441/852] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:32.908713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-37797bc4-66a5-46ac-96d6-d7464a18d32d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:32.912728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-37797bc4-66a5-46ac-96d6-d7464a18d32d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:32.925629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37797bc4-66a5-46ac-96d6-d7464a18d32d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:32.927253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37797bc4-66a5-46ac-96d6-d7464a18d32d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:32.928715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37797bc4-66a5-46ac-96d6-d7464a18d32d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:32.929502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37797bc4-66a5-46ac-96d6-d7464a18d32d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:32.996088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-37797bc4-66a5-46ac-96d6-d7464a18d32d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095263 Jul 25 19:32:32.997197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 412/853] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:32 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:33.201306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3fd0fc20-98a3-4100-b1f5-8a64b82b9af6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:33.205612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3fd0fc20-98a3-4100-b1f5-8a64b82b9af6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:33.218781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fd0fc20-98a3-4100-b1f5-8a64b82b9af6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:33.219646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fd0fc20-98a3-4100-b1f5-8a64b82b9af6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:33.221136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fd0fc20-98a3-4100-b1f5-8a64b82b9af6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:33.221886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fd0fc20-98a3-4100-b1f5-8a64b82b9af6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:33.277715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3fd0fc20-98a3-4100-b1f5-8a64b82b9af6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085922 Jul 25 19:32:33.278325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 442/854] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:34.015496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-80a62363-9164-4d45-b9db-8e090fc9d748 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:34.017857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-80a62363-9164-4d45-b9db-8e090fc9d748 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:34.021116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=56 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:34.027302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-80a62363-9164-4d45-b9db-8e090fc9d748 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:34.027776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-80a62363-9164-4d45-b9db-8e090fc9d748 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:34.028601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-80a62363-9164-4d45-b9db-8e090fc9d748 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:34.029160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-80a62363-9164-4d45-b9db-8e090fc9d748 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:34.071029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-80a62363-9164-4d45-b9db-8e090fc9d748 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059847 Jul 25 19:32:34.071665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 413/855] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:34.292544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3c6960ac-a556-48a5-a290-14a48637b481 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:34.295390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3c6960ac-a556-48a5-a290-14a48637b481 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:34.303670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c6960ac-a556-48a5-a290-14a48637b481 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:34.304118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c6960ac-a556-48a5-a290-14a48637b481 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:34.304978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c6960ac-a556-48a5-a290-14a48637b481 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:34.305414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c6960ac-a556-48a5-a290-14a48637b481 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:34.346099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3c6960ac-a556-48a5-a290-14a48637b481 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058240 Jul 25 19:32:34.346682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 443/856] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:35.085601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c90c2962-63a0-4b02-9f98-ecb5755c0bc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:35.088112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c90c2962-63a0-4b02-9f98-ecb5755c0bc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:35.095387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c90c2962-63a0-4b02-9f98-ecb5755c0bc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:35.095934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c90c2962-63a0-4b02-9f98-ecb5755c0bc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:35.096737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c90c2962-63a0-4b02-9f98-ecb5755c0bc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:35.097177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c90c2962-63a0-4b02-9f98-ecb5755c0bc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:35.134074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c90c2962-63a0-4b02-9f98-ecb5755c0bc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053696 Jul 25 19:32:35.134686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 414/857] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:35.365029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c07218fa-2918-4674-865e-6d81059765a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:35.368313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c07218fa-2918-4674-865e-6d81059765a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:35.378578 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c07218fa-2918-4674-865e-6d81059765a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:35.379256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c07218fa-2918-4674-865e-6d81059765a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:35.380509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c07218fa-2918-4674-865e-6d81059765a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:35.381138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c07218fa-2918-4674-865e-6d81059765a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:35.431825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c07218fa-2918-4674-865e-6d81059765a4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072884 Jul 25 19:32:35.432487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 444/858] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:35 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:36.070388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aec736a6-6d32-4f83-86da-1208308d2d96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:32:36.071134 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aec736a6-6d32-4f83-86da-1208308d2d96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:36.078544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aec736a6-6d32-4f83-86da-1208308d2d96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:36.079002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aec736a6-6d32-4f83-86da-1208308d2d96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:36.079835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aec736a6-6d32-4f83-86da-1208308d2d96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:36.080286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aec736a6-6d32-4f83-86da-1208308d2d96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:36.127425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-aec736a6-6d32-4f83-86da-1208308d2d96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lazy-loading 'flavor' on Instance uuid a44f6c42-c9a6-4a85-8776-d2f694f0ac8e {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:32:36.150947 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c4f7f6f-0ba0-4ecc-ba65-9cf52cee82ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:36.156084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c4f7f6f-0ba0-4ecc-ba65-9cf52cee82ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:36.170134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c4f7f6f-0ba0-4ecc-ba65-9cf52cee82ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:36.170935 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c4f7f6f-0ba0-4ecc-ba65-9cf52cee82ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:36.172405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c4f7f6f-0ba0-4ecc-ba65-9cf52cee82ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:36.173802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c4f7f6f-0ba0-4ecc-ba65-9cf52cee82ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:36.242734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aec736a6-6d32-4f83-86da-1208308d2d96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "POST /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e/action" status: 202 len: 0 microversion: 2.1 time: 0.176494 Jul 25 19:32:36.243082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c4f7f6f-0ba0-4ecc-ba65-9cf52cee82ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099797 Jul 25 19:32:36.243702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 445/859] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:36.243918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 415/860] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 19:32:36 2022] POST /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 19:32:36.252850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-384125cc-4414-482c-a5ea-c3e37b7c98f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:36.253568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-384125cc-4414-482c-a5ea-c3e37b7c98f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:36.264090 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-384125cc-4414-482c-a5ea-c3e37b7c98f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:36.264850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-384125cc-4414-482c-a5ea-c3e37b7c98f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:36.266085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-384125cc-4414-482c-a5ea-c3e37b7c98f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:36.266795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-384125cc-4414-482c-a5ea-c3e37b7c98f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:36.447443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-185269e0-0815-4c46-9e65-f954d04ac6f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:36.450417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-185269e0-0815-4c46-9e65-f954d04ac6f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:36.460715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-185269e0-0815-4c46-9e65-f954d04ac6f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:36.461419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-185269e0-0815-4c46-9e65-f954d04ac6f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:36.462385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-185269e0-0815-4c46-9e65-f954d04ac6f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:36.463038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-185269e0-0815-4c46-9e65-f954d04ac6f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:36.498022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-384125cc-4414-482c-a5ea-c3e37b7c98f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:36.507567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-384125cc-4414-482c-a5ea-c3e37b7c98f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.258737 Jul 25 19:32:36.508174 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 446/861] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:36 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:32:36.521372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-185269e0-0815-4c46-9e65-f954d04ac6f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078764 Jul 25 19:32:36.522410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 416/862] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:37.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a423f7e2-08e2-4be2-ba2c-db920b97a3d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:37.261819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a423f7e2-08e2-4be2-ba2c-db920b97a3d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:37.270560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a423f7e2-08e2-4be2-ba2c-db920b97a3d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:37.271769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a423f7e2-08e2-4be2-ba2c-db920b97a3d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:37.272709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a423f7e2-08e2-4be2-ba2c-db920b97a3d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:37.273242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a423f7e2-08e2-4be2-ba2c-db920b97a3d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:37.307639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a423f7e2-08e2-4be2-ba2c-db920b97a3d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053067 Jul 25 19:32:37.308237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 447/863] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:37.536449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f9b0aa7e-107b-4e19-a73c-99d89f1e1c93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:37.537116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3648a7b2-2bbf-4467-86ae-e3ce5237294a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:37.537650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3648a7b2-2bbf-4467-86ae-e3ce5237294a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:37.538810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f9b0aa7e-107b-4e19-a73c-99d89f1e1c93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:37.545685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3648a7b2-2bbf-4467-86ae-e3ce5237294a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:37.546140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3648a7b2-2bbf-4467-86ae-e3ce5237294a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:37.546996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3648a7b2-2bbf-4467-86ae-e3ce5237294a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:37.547445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3648a7b2-2bbf-4467-86ae-e3ce5237294a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:37.549676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9b0aa7e-107b-4e19-a73c-99d89f1e1c93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:37.552271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9b0aa7e-107b-4e19-a73c-99d89f1e1c93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:37.552659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:37.553897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9b0aa7e-107b-4e19-a73c-99d89f1e1c93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:37.554691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9b0aa7e-107b-4e19-a73c-99d89f1e1c93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:37.619937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f9b0aa7e-107b-4e19-a73c-99d89f1e1c93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087812 Jul 25 19:32:37.621214 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 417/864] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:37.704768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3648a7b2-2bbf-4467-86ae-e3ce5237294a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:37.714340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3648a7b2-2bbf-4467-86ae-e3ce5237294a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.181984 Jul 25 19:32:37.714923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 448/865] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:37 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:32:38.321693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aee33500-01d8-4c3d-9eff-19e0014b93c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:38.324099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aee33500-01d8-4c3d-9eff-19e0014b93c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:38.331678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee33500-01d8-4c3d-9eff-19e0014b93c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:38.332187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee33500-01d8-4c3d-9eff-19e0014b93c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:38.333619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee33500-01d8-4c3d-9eff-19e0014b93c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:38.334110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee33500-01d8-4c3d-9eff-19e0014b93c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:38.372477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aee33500-01d8-4c3d-9eff-19e0014b93c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055654 Jul 25 19:32:38.373076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 418/866] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:38 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:38.641460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bf570cae-2f70-47cc-aa05-841dc3f5eb85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:38.643806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bf570cae-2f70-47cc-aa05-841dc3f5eb85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:38.652170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf570cae-2f70-47cc-aa05-841dc3f5eb85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:38.652611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf570cae-2f70-47cc-aa05-841dc3f5eb85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:38.653392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf570cae-2f70-47cc-aa05-841dc3f5eb85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:38.653825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf570cae-2f70-47cc-aa05-841dc3f5eb85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:38.691416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bf570cae-2f70-47cc-aa05-841dc3f5eb85 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055846 Jul 25 19:32:38.693139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 449/867] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:38.737414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7fe8b502-5675-40ad-ae26-505cd15da0e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:38.738231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7fe8b502-5675-40ad-ae26-505cd15da0e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:38.747162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe8b502-5675-40ad-ae26-505cd15da0e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:38.747781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe8b502-5675-40ad-ae26-505cd15da0e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:38.748629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe8b502-5675-40ad-ae26-505cd15da0e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:38.749179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe8b502-5675-40ad-ae26-505cd15da0e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:38.965620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7fe8b502-5675-40ad-ae26-505cd15da0e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:38.969481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:38.980390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7fe8b502-5675-40ad-ae26-505cd15da0e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.247126 Jul 25 19:32:38.980995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 419/868] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:38 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:39.390911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd90ab75-7ef0-4636-9ae8-941a77da79b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:39.393540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd90ab75-7ef0-4636-9ae8-941a77da79b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:39.400572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd90ab75-7ef0-4636-9ae8-941a77da79b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:39.401151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd90ab75-7ef0-4636-9ae8-941a77da79b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:39.402038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd90ab75-7ef0-4636-9ae8-941a77da79b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:39.402660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd90ab75-7ef0-4636-9ae8-941a77da79b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:39.442626 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd90ab75-7ef0-4636-9ae8-941a77da79b4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055741 Jul 25 19:32:39.443339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 450/869] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:39.712611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ff8c8081-c125-4042-b448-8e9b48a33d45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:39.715064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ff8c8081-c125-4042-b448-8e9b48a33d45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:39.724145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff8c8081-c125-4042-b448-8e9b48a33d45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:39.724772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff8c8081-c125-4042-b448-8e9b48a33d45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:39.725638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff8c8081-c125-4042-b448-8e9b48a33d45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:39.726120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff8c8081-c125-4042-b448-8e9b48a33d45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:39.775165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ff8c8081-c125-4042-b448-8e9b48a33d45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067674 Jul 25 19:32:39.776368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 420/870] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:40.006611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-11357880-29e9-4d32-83a7-6c8170f00e1c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:40.007216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-11357880-29e9-4d32-83a7-6c8170f00e1c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:40.013835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11357880-29e9-4d32-83a7-6c8170f00e1c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:40.014385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11357880-29e9-4d32-83a7-6c8170f00e1c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:40.015273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11357880-29e9-4d32-83a7-6c8170f00e1c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:40.015867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11357880-29e9-4d32-83a7-6c8170f00e1c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:40.216046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-11357880-29e9-4d32-83a7-6c8170f00e1c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:40.229315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-11357880-29e9-4d32-83a7-6c8170f00e1c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.227961 Jul 25 19:32:40.230173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 451/871] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:39 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:32:40.458341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-04eb5956-0dc4-47f8-a822-f517d94699ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:40.461027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-04eb5956-0dc4-47f8-a822-f517d94699ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:40.468958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04eb5956-0dc4-47f8-a822-f517d94699ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:40.469619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04eb5956-0dc4-47f8-a822-f517d94699ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:40.470791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04eb5956-0dc4-47f8-a822-f517d94699ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:40.471236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04eb5956-0dc4-47f8-a822-f517d94699ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:40.512069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-04eb5956-0dc4-47f8-a822-f517d94699ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059672 Jul 25 19:32:40.512800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 421/872] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:40.790024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-386a687e-f704-46fc-ba0c-002d0b1cdbe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:40.792774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-386a687e-f704-46fc-ba0c-002d0b1cdbe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:40.799544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-386a687e-f704-46fc-ba0c-002d0b1cdbe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:40.800055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-386a687e-f704-46fc-ba0c-002d0b1cdbe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:40.800910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-386a687e-f704-46fc-ba0c-002d0b1cdbe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:40.801389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-386a687e-f704-46fc-ba0c-002d0b1cdbe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:40.838930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-386a687e-f704-46fc-ba0c-002d0b1cdbe8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053960 Jul 25 19:32:40.839541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 452/873] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:41.253179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8f6f76ef-0db9-4966-b4f9-d6bed345a02c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:41.254525 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8f6f76ef-0db9-4966-b4f9-d6bed345a02c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:41.263321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f6f76ef-0db9-4966-b4f9-d6bed345a02c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:41.264035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f6f76ef-0db9-4966-b4f9-d6bed345a02c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:41.265482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f6f76ef-0db9-4966-b4f9-d6bed345a02c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:41.266244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f6f76ef-0db9-4966-b4f9-d6bed345a02c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:41.449588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8f6f76ef-0db9-4966-b4f9-d6bed345a02c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:41.458994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8f6f76ef-0db9-4966-b4f9-d6bed345a02c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.209796 Jul 25 19:32:41.459974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 422/874] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:41 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:32:41.525667 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ef570d9-1083-461e-861e-730539fbf90a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:41.528834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ef570d9-1083-461e-861e-730539fbf90a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:41.536172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ef570d9-1083-461e-861e-730539fbf90a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:41.536620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ef570d9-1083-461e-861e-730539fbf90a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:41.537465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ef570d9-1083-461e-861e-730539fbf90a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:41.537905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ef570d9-1083-461e-861e-730539fbf90a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:41.584882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ef570d9-1083-461e-861e-730539fbf90a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062960 Jul 25 19:32:41.585936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 453/875] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:41.856644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4cd2fe25-c7b6-4555-8691-b2143304d984 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:41.860486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4cd2fe25-c7b6-4555-8691-b2143304d984 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:41.872078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cd2fe25-c7b6-4555-8691-b2143304d984 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:41.872851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cd2fe25-c7b6-4555-8691-b2143304d984 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:41.874274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cd2fe25-c7b6-4555-8691-b2143304d984 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:41.875047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cd2fe25-c7b6-4555-8691-b2143304d984 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:41.933786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4cd2fe25-c7b6-4555-8691-b2143304d984 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085222 Jul 25 19:32:41.934894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 423/876] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:42.485564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-847158b9-eef9-4254-bb7e-ba6696c908e4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:42.486579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-847158b9-eef9-4254-bb7e-ba6696c908e4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:42.497503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-847158b9-eef9-4254-bb7e-ba6696c908e4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:42.498114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-847158b9-eef9-4254-bb7e-ba6696c908e4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:42.499498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-847158b9-eef9-4254-bb7e-ba6696c908e4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:42.500262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-847158b9-eef9-4254-bb7e-ba6696c908e4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:42.607810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e35d9c88-98b3-4f76-a70a-5f53d4aa2596 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:42.612061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e35d9c88-98b3-4f76-a70a-5f53d4aa2596 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:42.624881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e35d9c88-98b3-4f76-a70a-5f53d4aa2596 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:42.625711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e35d9c88-98b3-4f76-a70a-5f53d4aa2596 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:42.627244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e35d9c88-98b3-4f76-a70a-5f53d4aa2596 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:42.628066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e35d9c88-98b3-4f76-a70a-5f53d4aa2596 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:42.685290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e35d9c88-98b3-4f76-a70a-5f53d4aa2596 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085376 Jul 25 19:32:42.686935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 424/877] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:42.735848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-847158b9-eef9-4254-bb7e-ba6696c908e4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:42.744843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-847158b9-eef9-4254-bb7e-ba6696c908e4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.265716 Jul 25 19:32:42.745631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 454/878] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:42 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:42.882331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:32:42.882650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:32:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:32:42.956548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-71441470-f667-4d05-a395-bca71e15f6c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:42.961023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-71441470-f667-4d05-a395-bca71e15f6c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:42.971737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71441470-f667-4d05-a395-bca71e15f6c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:42.972306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71441470-f667-4d05-a395-bca71e15f6c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:42.973538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71441470-f667-4d05-a395-bca71e15f6c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:42.974146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71441470-f667-4d05-a395-bca71e15f6c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:43.019096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-71441470-f667-4d05-a395-bca71e15f6c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069627 Jul 25 19:32:43.019772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 425/879] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:42 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:43.701911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-55b34b07-9536-4bbc-9190-6b8893182b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:43.704182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-55b34b07-9536-4bbc-9190-6b8893182b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:43.714093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55b34b07-9536-4bbc-9190-6b8893182b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:43.714607 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55b34b07-9536-4bbc-9190-6b8893182b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:43.715467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55b34b07-9536-4bbc-9190-6b8893182b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:43.715996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55b34b07-9536-4bbc-9190-6b8893182b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:43.755037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-55b34b07-9536-4bbc-9190-6b8893182b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056478 Jul 25 19:32:43.756434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 455/880] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:43.768291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3d8baeed-73d8-43e0-a547-8e760e16f7fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:43.769303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3d8baeed-73d8-43e0-a547-8e760e16f7fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:43.777874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d8baeed-73d8-43e0-a547-8e760e16f7fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:43.778378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d8baeed-73d8-43e0-a547-8e760e16f7fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:43.779312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d8baeed-73d8-43e0-a547-8e760e16f7fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:43.779865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d8baeed-73d8-43e0-a547-8e760e16f7fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:43.967837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3d8baeed-73d8-43e0-a547-8e760e16f7fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:43.977073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3d8baeed-73d8-43e0-a547-8e760e16f7fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.212868 Jul 25 19:32:43.977776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 426/881] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:43 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:44.038741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-39e1e7d3-48e5-4cdd-a897-43040204092a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:44.043046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-39e1e7d3-48e5-4cdd-a897-43040204092a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:44.056350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39e1e7d3-48e5-4cdd-a897-43040204092a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:44.057202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39e1e7d3-48e5-4cdd-a897-43040204092a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:44.058462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39e1e7d3-48e5-4cdd-a897-43040204092a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:44.058462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39e1e7d3-48e5-4cdd-a897-43040204092a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:44.105753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-39e1e7d3-48e5-4cdd-a897-43040204092a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075222 Jul 25 19:32:44.106342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 456/882] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:44.773423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b1da5d1f-8329-4511-b0c6-43d11e6b73a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:44.775866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b1da5d1f-8329-4511-b0c6-43d11e6b73a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:44.783480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1da5d1f-8329-4511-b0c6-43d11e6b73a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:44.784141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1da5d1f-8329-4511-b0c6-43d11e6b73a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:44.785166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1da5d1f-8329-4511-b0c6-43d11e6b73a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:44.786545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1da5d1f-8329-4511-b0c6-43d11e6b73a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:44.830221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b1da5d1f-8329-4511-b0c6-43d11e6b73a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062738 Jul 25 19:32:44.831054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 427/883] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:45.005962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-43bfc7be-eba5-4d97-875c-e84be09dba21 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:45.006900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-43bfc7be-eba5-4d97-875c-e84be09dba21 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:45.014727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43bfc7be-eba5-4d97-875c-e84be09dba21 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:45.015293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43bfc7be-eba5-4d97-875c-e84be09dba21 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:45.016197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43bfc7be-eba5-4d97-875c-e84be09dba21 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:45.016729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43bfc7be-eba5-4d97-875c-e84be09dba21 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:45.124120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cb2cca2f-62cc-4359-bdc4-1129f8ac3cd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:45.127867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cb2cca2f-62cc-4359-bdc4-1129f8ac3cd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:45.139726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb2cca2f-62cc-4359-bdc4-1129f8ac3cd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:45.140413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb2cca2f-62cc-4359-bdc4-1129f8ac3cd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:45.141649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb2cca2f-62cc-4359-bdc4-1129f8ac3cd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:45.142347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb2cca2f-62cc-4359-bdc4-1129f8ac3cd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:45.198674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-43bfc7be-eba5-4d97-875c-e84be09dba21 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:45.205193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cb2cca2f-62cc-4359-bdc4-1129f8ac3cd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087643 Jul 25 19:32:45.206786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 428/884] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:45.210693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-43bfc7be-eba5-4d97-875c-e84be09dba21 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.209531 Jul 25 19:32:45.211411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 457/885] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:44 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:45.845197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6c3c3d06-2e18-4c91-989d-42eee888121a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:45.849360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6c3c3d06-2e18-4c91-989d-42eee888121a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:45.858587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c3c3d06-2e18-4c91-989d-42eee888121a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:45.859092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c3c3d06-2e18-4c91-989d-42eee888121a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:45.860279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c3c3d06-2e18-4c91-989d-42eee888121a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:45.861006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c3c3d06-2e18-4c91-989d-42eee888121a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:45.907209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6c3c3d06-2e18-4c91-989d-42eee888121a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067029 Jul 25 19:32:45.907880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 429/886] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:46.228667 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f1e99ea8-cee5-454a-98f7-57749da6de54 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:46.231433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f1e99ea8-cee5-454a-98f7-57749da6de54 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:46.243635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1e99ea8-cee5-454a-98f7-57749da6de54 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:46.244381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1e99ea8-cee5-454a-98f7-57749da6de54 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:46.245692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1e99ea8-cee5-454a-98f7-57749da6de54 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:46.246412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1e99ea8-cee5-454a-98f7-57749da6de54 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:46.250043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1c5e3272-ba36-47e4-a8c0-e7ee5405527f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:46.251078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1c5e3272-ba36-47e4-a8c0-e7ee5405527f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:46.260653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c5e3272-ba36-47e4-a8c0-e7ee5405527f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:46.261430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c5e3272-ba36-47e4-a8c0-e7ee5405527f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:46.262782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c5e3272-ba36-47e4-a8c0-e7ee5405527f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:46.263485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c5e3272-ba36-47e4-a8c0-e7ee5405527f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:46.300294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f1e99ea8-cee5-454a-98f7-57749da6de54 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084057 Jul 25 19:32:46.301236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 458/887] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:46.490398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1c5e3272-ba36-47e4-a8c0-e7ee5405527f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:46.500460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1c5e3272-ba36-47e4-a8c0-e7ee5405527f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.257062 Jul 25 19:32:46.501061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 430/888] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:46 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:46.925952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-deb9d925-7ab3-4675-9680-2f99bcf380a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:46.929226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-deb9d925-7ab3-4675-9680-2f99bcf380a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:46.937111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-deb9d925-7ab3-4675-9680-2f99bcf380a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:46.937744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-deb9d925-7ab3-4675-9680-2f99bcf380a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:46.938968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-deb9d925-7ab3-4675-9680-2f99bcf380a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:46.939586 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-deb9d925-7ab3-4675-9680-2f99bcf380a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:46.986457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-deb9d925-7ab3-4675-9680-2f99bcf380a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065275 Jul 25 19:32:46.987049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 459/889] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:47.319108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c4fc59bc-026d-4c58-8e0e-0eee46c0ead3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:47.321528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c4fc59bc-026d-4c58-8e0e-0eee46c0ead3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:47.329356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4fc59bc-026d-4c58-8e0e-0eee46c0ead3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:47.329857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4fc59bc-026d-4c58-8e0e-0eee46c0ead3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:47.330700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4fc59bc-026d-4c58-8e0e-0eee46c0ead3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:47.331196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4fc59bc-026d-4c58-8e0e-0eee46c0ead3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:47.389582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c4fc59bc-026d-4c58-8e0e-0eee46c0ead3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077184 Jul 25 19:32:47.390181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 431/890] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:47.525470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e5c219b3-2e87-4c4e-b8f5-67e4ecd7b191 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:47.526221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e5c219b3-2e87-4c4e-b8f5-67e4ecd7b191 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:47.534116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5c219b3-2e87-4c4e-b8f5-67e4ecd7b191 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:47.534614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5c219b3-2e87-4c4e-b8f5-67e4ecd7b191 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:47.536563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5c219b3-2e87-4c4e-b8f5-67e4ecd7b191 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:47.537411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5c219b3-2e87-4c4e-b8f5-67e4ecd7b191 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:48.008434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c512efdd-4298-47e4-8f14-456cc9ec709c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:48.012659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c512efdd-4298-47e4-8f14-456cc9ec709c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:48.024359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c512efdd-4298-47e4-8f14-456cc9ec709c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:48.025264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c512efdd-4298-47e4-8f14-456cc9ec709c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:48.026717 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c512efdd-4298-47e4-8f14-456cc9ec709c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:48.027499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c512efdd-4298-47e4-8f14-456cc9ec709c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:48.062243 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e5c219b3-2e87-4c4e-b8f5-67e4ecd7b191 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:48.077474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c512efdd-4298-47e4-8f14-456cc9ec709c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078479 Jul 25 19:32:48.078080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 432/891] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:48.079409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e5c219b3-2e87-4c4e-b8f5-67e4ecd7b191 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.559168 Jul 25 19:32:48.080557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 460/892] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:47 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:32:48.405025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e7591b57-e207-45a5-8dc0-172ca6437c7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:48.407343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e7591b57-e207-45a5-8dc0-172ca6437c7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:48.415371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7591b57-e207-45a5-8dc0-172ca6437c7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:48.416194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7591b57-e207-45a5-8dc0-172ca6437c7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:48.417628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7591b57-e207-45a5-8dc0-172ca6437c7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:48.418348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7591b57-e207-45a5-8dc0-172ca6437c7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:48.457245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e7591b57-e207-45a5-8dc0-172ca6437c7e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058044 Jul 25 19:32:48.458431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 433/893] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:49.092442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3051f2b5-df93-406a-9818-2c6f1124003d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:49.096235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3051f2b5-df93-406a-9818-2c6f1124003d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:49.100135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=66 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:49.107063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3051f2b5-df93-406a-9818-2c6f1124003d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:49.107883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3051f2b5-df93-406a-9818-2c6f1124003d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:49.109328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3051f2b5-df93-406a-9818-2c6f1124003d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:49.109874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3051f2b5-df93-406a-9818-2c6f1124003d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:49.120756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cd7a4e03-b1bb-47ae-877d-f12480510509 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:49.121840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cd7a4e03-b1bb-47ae-877d-f12480510509 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:49.133011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd7a4e03-b1bb-47ae-877d-f12480510509 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:49.133735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd7a4e03-b1bb-47ae-877d-f12480510509 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:49.135089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd7a4e03-b1bb-47ae-877d-f12480510509 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:49.135859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd7a4e03-b1bb-47ae-877d-f12480510509 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:49.170048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3051f2b5-df93-406a-9818-2c6f1124003d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082160 Jul 25 19:32:49.175131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 461/894] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:49.336598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cd7a4e03-b1bb-47ae-877d-f12480510509 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:49.352098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cd7a4e03-b1bb-47ae-877d-f12480510509 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.238168 Jul 25 19:32:49.362525 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 434/895] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:49 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:49.471915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4750daf0-7e87-4dad-a7c9-83b13494b714 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:49.475067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4750daf0-7e87-4dad-a7c9-83b13494b714 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:49.482412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4750daf0-7e87-4dad-a7c9-83b13494b714 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:49.482942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4750daf0-7e87-4dad-a7c9-83b13494b714 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:49.483836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4750daf0-7e87-4dad-a7c9-83b13494b714 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:49.484322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4750daf0-7e87-4dad-a7c9-83b13494b714 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:49.522791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4750daf0-7e87-4dad-a7c9-83b13494b714 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054877 Jul 25 19:32:49.523715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 462/896] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:50.187476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c16d2616-2f24-45c9-92cb-52c4ac33b841 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:50.189913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c16d2616-2f24-45c9-92cb-52c4ac33b841 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:50.202143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c16d2616-2f24-45c9-92cb-52c4ac33b841 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:50.202995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c16d2616-2f24-45c9-92cb-52c4ac33b841 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:50.204513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c16d2616-2f24-45c9-92cb-52c4ac33b841 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:50.205323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c16d2616-2f24-45c9-92cb-52c4ac33b841 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:50.245167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c16d2616-2f24-45c9-92cb-52c4ac33b841 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064924 Jul 25 19:32:50.245754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 435/897] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:50.386066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a100ba11-b6bb-4c48-bfc7-5ad487af1885 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:50.386932 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a100ba11-b6bb-4c48-bfc7-5ad487af1885 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:50.398057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a100ba11-b6bb-4c48-bfc7-5ad487af1885 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:50.398535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a100ba11-b6bb-4c48-bfc7-5ad487af1885 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:50.399927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a100ba11-b6bb-4c48-bfc7-5ad487af1885 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:50.400419 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a100ba11-b6bb-4c48-bfc7-5ad487af1885 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:50.545420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-55a078a1-b213-411a-9eda-2fa9630c73ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:50.549417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-55a078a1-b213-411a-9eda-2fa9630c73ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:50.561602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-55a078a1-b213-411a-9eda-2fa9630c73ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:50.562392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-55a078a1-b213-411a-9eda-2fa9630c73ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:50.563864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-55a078a1-b213-411a-9eda-2fa9630c73ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:50.564669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-55a078a1-b213-411a-9eda-2fa9630c73ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:50.577024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a100ba11-b6bb-4c48-bfc7-5ad487af1885 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:50.587647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:50.592274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a100ba11-b6bb-4c48-bfc7-5ad487af1885 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.209692 Jul 25 19:32:50.593275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 463/898] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:50 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:50.610673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-55a078a1-b213-411a-9eda-2fa9630c73ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074059 Jul 25 19:32:50.611261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 436/899] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:51.264315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d63513a0-36bf-414d-bca8-d05dc467a0a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:51.267574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d63513a0-36bf-414d-bca8-d05dc467a0a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:51.277990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d63513a0-36bf-414d-bca8-d05dc467a0a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:51.278616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d63513a0-36bf-414d-bca8-d05dc467a0a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:51.279612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d63513a0-36bf-414d-bca8-d05dc467a0a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:51.280237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d63513a0-36bf-414d-bca8-d05dc467a0a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:51.310674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:51.322303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d63513a0-36bf-414d-bca8-d05dc467a0a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063990 Jul 25 19:32:51.322303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 464/900] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:51.620195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0dc11ea2-540b-4a0c-be7b-3ffde3388566 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:51.621108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0dc11ea2-540b-4a0c-be7b-3ffde3388566 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:51.626273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd1c223f-658e-459d-8f89-518338ff372e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:51.628193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dc11ea2-540b-4a0c-be7b-3ffde3388566 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:51.628640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dc11ea2-540b-4a0c-be7b-3ffde3388566 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:51.629223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd1c223f-658e-459d-8f89-518338ff372e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:51.630094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dc11ea2-540b-4a0c-be7b-3ffde3388566 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:51.631144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dc11ea2-540b-4a0c-be7b-3ffde3388566 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:51.638965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd1c223f-658e-459d-8f89-518338ff372e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:51.639604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd1c223f-658e-459d-8f89-518338ff372e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:51.640630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd1c223f-658e-459d-8f89-518338ff372e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:51.641215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd1c223f-658e-459d-8f89-518338ff372e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:51.680290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd1c223f-658e-459d-8f89-518338ff372e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058558 Jul 25 19:32:51.681387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 465/901] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:32:51.837655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0dc11ea2-540b-4a0c-be7b-3ffde3388566 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:51.851881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0dc11ea2-540b-4a0c-be7b-3ffde3388566 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.237931 Jul 25 19:32:51.852789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 437/902] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:51 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:32:52.339310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-edbe1451-87d0-40a5-bc2f-3f9a7f99df4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:52.343280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-edbe1451-87d0-40a5-bc2f-3f9a7f99df4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:52.357200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edbe1451-87d0-40a5-bc2f-3f9a7f99df4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:52.358004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edbe1451-87d0-40a5-bc2f-3f9a7f99df4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:52.359427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edbe1451-87d0-40a5-bc2f-3f9a7f99df4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:52.360220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edbe1451-87d0-40a5-bc2f-3f9a7f99df4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:52.419621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-edbe1451-87d0-40a5-bc2f-3f9a7f99df4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088343 Jul 25 19:32:52.420299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 466/903] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:52 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:52.697156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7b062f35-7295-44c0-a18e-6e63bf1e8de7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:52.700100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7b062f35-7295-44c0-a18e-6e63bf1e8de7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:52.708977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7b062f35-7295-44c0-a18e-6e63bf1e8de7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:52.709429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7b062f35-7295-44c0-a18e-6e63bf1e8de7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:52.710225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7b062f35-7295-44c0-a18e-6e63bf1e8de7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:52.710663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7b062f35-7295-44c0-a18e-6e63bf1e8de7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:52.755543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7b062f35-7295-44c0-a18e-6e63bf1e8de7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062459 Jul 25 19:32:52.756345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 438/904] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:52 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:52.889127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8d171607-b837-4650-9824-282df5e33404 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:52.890156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8d171607-b837-4650-9824-282df5e33404 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:52.903066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d171607-b837-4650-9824-282df5e33404 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:52.909073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d171607-b837-4650-9824-282df5e33404 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:52.909073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d171607-b837-4650-9824-282df5e33404 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:52.909073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d171607-b837-4650-9824-282df5e33404 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:53.130391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d171607-b837-4650-9824-282df5e33404 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:53.143675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8d171607-b837-4650-9824-282df5e33404 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.261477 Jul 25 19:32:53.144587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 467/905] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:52 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:53.376287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-b32e8a36-3c51-461d-8a9c-59b24eaaf326 req-2d097e06-6da0-46d7-baf8-69e29f1faf0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44f6c42-c9a6-4a85-8776-d2f694f0ac8e", "name": "network-vif-unplugged", "status": "completed", "tag": "7198e141-c0f4-476e-81a3-f0ece4990c63"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:32:53.393333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-b32e8a36-3c51-461d-8a9c-59b24eaaf326 req-2d097e06-6da0-46d7-baf8-69e29f1faf0d service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:53.393868 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-b32e8a36-3c51-461d-8a9c-59b24eaaf326 req-2d097e06-6da0-46d7-baf8-69e29f1faf0d service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:53.417228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-b32e8a36-3c51-461d-8a9c-59b24eaaf326 req-2d097e06-6da0-46d7-baf8-69e29f1faf0d service nova] Creating event network-vif-unplugged:7198e141-c0f4-476e-81a3-f0ece4990c63 for instance a44f6c42-c9a6-4a85-8776-d2f694f0ac8e on hv-cinder-85093 Jul 25 19:32:53.425843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-b32e8a36-3c51-461d-8a9c-59b24eaaf326 req-2d097e06-6da0-46d7-baf8-69e29f1faf0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.200366 Jul 25 19:32:53.427567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 439/906] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:53.438916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e78cc17-3201-4a53-a49e-7b0888f684d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:53.443693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e78cc17-3201-4a53-a49e-7b0888f684d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:53.455288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e78cc17-3201-4a53-a49e-7b0888f684d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:53.456131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e78cc17-3201-4a53-a49e-7b0888f684d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:53.458114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e78cc17-3201-4a53-a49e-7b0888f684d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:53.458925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e78cc17-3201-4a53-a49e-7b0888f684d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:53.529711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e78cc17-3201-4a53-a49e-7b0888f684d8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098404 Jul 25 19:32:53.530782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 468/907] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:53.777573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e9b524a2-1425-4364-846e-b67f4b6583c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:53.781001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e9b524a2-1425-4364-846e-b67f4b6583c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:53.791047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e9b524a2-1425-4364-846e-b67f4b6583c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:53.791494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e9b524a2-1425-4364-846e-b67f4b6583c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:53.792332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e9b524a2-1425-4364-846e-b67f4b6583c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:53.792765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e9b524a2-1425-4364-846e-b67f4b6583c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:53.836183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e9b524a2-1425-4364-846e-b67f4b6583c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068167 Jul 25 19:32:53.837199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 440/908] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:54.177729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c321e1dd-70d3-43f0-930b-f552ccda2305 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:54.178429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c321e1dd-70d3-43f0-930b-f552ccda2305 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:54.185855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c321e1dd-70d3-43f0-930b-f552ccda2305 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:54.186302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c321e1dd-70d3-43f0-930b-f552ccda2305 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:54.187096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c321e1dd-70d3-43f0-930b-f552ccda2305 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:54.187586 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c321e1dd-70d3-43f0-930b-f552ccda2305 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:54.381255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c321e1dd-70d3-43f0-930b-f552ccda2305 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:54.391462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c321e1dd-70d3-43f0-930b-f552ccda2305 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.218530 Jul 25 19:32:54.392113 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 469/909] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:54 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:54.547051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5d24ace3-9f94-4a25-b975-e1613ec5a2a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:54.549427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5d24ace3-9f94-4a25-b975-e1613ec5a2a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:54.558729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d24ace3-9f94-4a25-b975-e1613ec5a2a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:54.559383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d24ace3-9f94-4a25-b975-e1613ec5a2a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:54.560616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d24ace3-9f94-4a25-b975-e1613ec5a2a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:54.561368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d24ace3-9f94-4a25-b975-e1613ec5a2a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:54.603887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5d24ace3-9f94-4a25-b975-e1613ec5a2a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061914 Jul 25 19:32:54.604490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 441/910] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:54.853244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9512dabf-3017-4347-b83d-b0e4c898f2e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:54.856775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9512dabf-3017-4347-b83d-b0e4c898f2e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:54.864900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9512dabf-3017-4347-b83d-b0e4c898f2e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:54.865346 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9512dabf-3017-4347-b83d-b0e4c898f2e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:54.866125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9512dabf-3017-4347-b83d-b0e4c898f2e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:54.866556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9512dabf-3017-4347-b83d-b0e4c898f2e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:54.904364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9512dabf-3017-4347-b83d-b0e4c898f2e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057084 Jul 25 19:32:54.905114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 470/911] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:55.418484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-684b2200-db40-4eb6-8460-2ccfadd43418 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:55.419475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-684b2200-db40-4eb6-8460-2ccfadd43418 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:55.428199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-684b2200-db40-4eb6-8460-2ccfadd43418 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:55.428709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-684b2200-db40-4eb6-8460-2ccfadd43418 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:55.429625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-684b2200-db40-4eb6-8460-2ccfadd43418 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:55.430162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-684b2200-db40-4eb6-8460-2ccfadd43418 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:55.623760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-684dc44f-0d4d-40e3-bdc1-18c5eda9081c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:55.628016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-684dc44f-0d4d-40e3-bdc1-18c5eda9081c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:55.630334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-684b2200-db40-4eb6-8460-2ccfadd43418 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:55.640878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-684b2200-db40-4eb6-8460-2ccfadd43418 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.226360 Jul 25 19:32:55.641263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-684dc44f-0d4d-40e3-bdc1-18c5eda9081c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:55.641669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 442/912] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:55 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:55.642032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-684dc44f-0d4d-40e3-bdc1-18c5eda9081c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:55.643386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-684dc44f-0d4d-40e3-bdc1-18c5eda9081c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:55.644161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-684dc44f-0d4d-40e3-bdc1-18c5eda9081c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:55.703663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-684dc44f-0d4d-40e3-bdc1-18c5eda9081c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086810 Jul 25 19:32:55.704653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 471/913] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:55.922488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0abfaba2-48e3-460a-b733-c23c1564e94f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:55.927280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0abfaba2-48e3-460a-b733-c23c1564e94f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:55.938757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0abfaba2-48e3-460a-b733-c23c1564e94f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:55.939552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0abfaba2-48e3-460a-b733-c23c1564e94f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:55.940994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0abfaba2-48e3-460a-b733-c23c1564e94f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:55.942489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0abfaba2-48e3-460a-b733-c23c1564e94f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:56.001760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0abfaba2-48e3-460a-b733-c23c1564e94f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085994 Jul 25 19:32:56.002391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 443/914] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:56.668219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-96f44a00-ffbc-4932-9253-a556b330ea19 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:56.669327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-96f44a00-ffbc-4932-9253-a556b330ea19 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:56.689595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96f44a00-ffbc-4932-9253-a556b330ea19 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:56.690057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96f44a00-ffbc-4932-9253-a556b330ea19 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:56.691441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96f44a00-ffbc-4932-9253-a556b330ea19 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:56.693500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96f44a00-ffbc-4932-9253-a556b330ea19 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:56.726307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6b6ea4f2-88d0-407f-a13a-fed0151ed644 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:56.730089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6b6ea4f2-88d0-407f-a13a-fed0151ed644 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:56.742818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b6ea4f2-88d0-407f-a13a-fed0151ed644 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:56.743745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b6ea4f2-88d0-407f-a13a-fed0151ed644 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:56.745122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b6ea4f2-88d0-407f-a13a-fed0151ed644 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:56.745901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b6ea4f2-88d0-407f-a13a-fed0151ed644 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:56.806157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6b6ea4f2-88d0-407f-a13a-fed0151ed644 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090635 Jul 25 19:32:56.807223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 444/915] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:56 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:32:56.938601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-96f44a00-ffbc-4932-9253-a556b330ea19 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:56.959291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-96f44a00-ffbc-4932-9253-a556b330ea19 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.298066 Jul 25 19:32:56.960730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 472/916] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:56 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:57.022194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-87eb7d75-615b-4163-8942-31a8ffaab8b1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:57.026037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-87eb7d75-615b-4163-8942-31a8ffaab8b1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:57.037555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87eb7d75-615b-4163-8942-31a8ffaab8b1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:57.038487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87eb7d75-615b-4163-8942-31a8ffaab8b1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:57.039825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87eb7d75-615b-4163-8942-31a8ffaab8b1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:57.040692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87eb7d75-615b-4163-8942-31a8ffaab8b1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:57.108169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-87eb7d75-615b-4163-8942-31a8ffaab8b1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092732 Jul 25 19:32:57.109159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 445/917] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:57.824801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-031d0e9b-7890-4d08-8482-842ae7330258 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:57.827505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-031d0e9b-7890-4d08-8482-842ae7330258 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:57.835529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-031d0e9b-7890-4d08-8482-842ae7330258 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:57.836268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-031d0e9b-7890-4d08-8482-842ae7330258 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:57.837249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-031d0e9b-7890-4d08-8482-842ae7330258 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:57.837838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-031d0e9b-7890-4d08-8482-842ae7330258 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:57.874615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-031d0e9b-7890-4d08-8482-842ae7330258 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057735 Jul 25 19:32:57.875564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 473/918] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:57.994842 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-da2ff94c-c148-42af-8274-2de72351c98a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:57.995655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-da2ff94c-c148-42af-8274-2de72351c98a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:58.002823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da2ff94c-c148-42af-8274-2de72351c98a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:58.003277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da2ff94c-c148-42af-8274-2de72351c98a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:58.004177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da2ff94c-c148-42af-8274-2de72351c98a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:58.005142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da2ff94c-c148-42af-8274-2de72351c98a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:58.122989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f98da44e-ab47-464a-aa8b-b0c657f96614 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:58.125463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f98da44e-ab47-464a-aa8b-b0c657f96614 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:58.133504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f98da44e-ab47-464a-aa8b-b0c657f96614 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:58.133945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f98da44e-ab47-464a-aa8b-b0c657f96614 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:58.134741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f98da44e-ab47-464a-aa8b-b0c657f96614 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:58.135178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f98da44e-ab47-464a-aa8b-b0c657f96614 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:58.179309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f98da44e-ab47-464a-aa8b-b0c657f96614 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060631 Jul 25 19:32:58.180449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 474/919] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:58.218709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da2ff94c-c148-42af-8274-2de72351c98a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:58.230385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-da2ff94c-c148-42af-8274-2de72351c98a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.239525 Jul 25 19:32:58.231008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 446/920] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:57 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:58.890996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-72e342dc-0be0-48bf-8f28-dfd6d62e77a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:58.893270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-72e342dc-0be0-48bf-8f28-dfd6d62e77a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:58.903045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72e342dc-0be0-48bf-8f28-dfd6d62e77a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:58.903688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72e342dc-0be0-48bf-8f28-dfd6d62e77a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:58.904608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72e342dc-0be0-48bf-8f28-dfd6d62e77a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:58.905146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72e342dc-0be0-48bf-8f28-dfd6d62e77a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:58.942386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-72e342dc-0be0-48bf-8f28-dfd6d62e77a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054654 Jul 25 19:32:58.943177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 475/921] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:32:59.194080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8d4b3ffc-d3ca-4be1-882b-a1ac963624a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:59.196537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8d4b3ffc-d3ca-4be1-882b-a1ac963624a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:59.205046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d4b3ffc-d3ca-4be1-882b-a1ac963624a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:59.205768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d4b3ffc-d3ca-4be1-882b-a1ac963624a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:59.208258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d4b3ffc-d3ca-4be1-882b-a1ac963624a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:59.209109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d4b3ffc-d3ca-4be1-882b-a1ac963624a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:59.248716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8d4b3ffc-d3ca-4be1-882b-a1ac963624a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059176 Jul 25 19:32:59.249671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 447/922] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:32:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:32:59.254494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c128f260-49fe-4171-ac8d-029a17409d9d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:59.255326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c128f260-49fe-4171-ac8d-029a17409d9d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:59.265181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c128f260-49fe-4171-ac8d-029a17409d9d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:59.265830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c128f260-49fe-4171-ac8d-029a17409d9d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:59.267244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c128f260-49fe-4171-ac8d-029a17409d9d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:59.268060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c128f260-49fe-4171-ac8d-029a17409d9d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:59.450658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c128f260-49fe-4171-ac8d-029a17409d9d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:59.460549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c128f260-49fe-4171-ac8d-029a17409d9d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.210000 Jul 25 19:32:59.461206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 476/923] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:59 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:59.960319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c635c21d-fa11-47e8-a133-4e4780a0c434 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:59.964894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c635c21d-fa11-47e8-a133-4e4780a0c434 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:59.976078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c635c21d-fa11-47e8-a133-4e4780a0c434 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:59.976531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c635c21d-fa11-47e8-a133-4e4780a0c434 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:59.977334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c635c21d-fa11-47e8-a133-4e4780a0c434 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:59.977778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c635c21d-fa11-47e8-a133-4e4780a0c434 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:00.015271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c635c21d-fa11-47e8-a133-4e4780a0c434 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063620 Jul 25 19:33:00.016313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 448/924] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:32:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:00.265643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15913f2f-aa83-4799-a7cc-d911816f5d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:00.269204 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-15913f2f-aa83-4799-a7cc-d911816f5d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:00.278637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15913f2f-aa83-4799-a7cc-d911816f5d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:00.279083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15913f2f-aa83-4799-a7cc-d911816f5d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:00.279917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15913f2f-aa83-4799-a7cc-d911816f5d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:00.280362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15913f2f-aa83-4799-a7cc-d911816f5d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:00.319439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15913f2f-aa83-4799-a7cc-d911816f5d52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060369 Jul 25 19:33:00.320219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 477/925] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:00.488318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-de3a7ebc-aa0e-473c-b4b6-c1e0f1a3fd0f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:00.489472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-de3a7ebc-aa0e-473c-b4b6-c1e0f1a3fd0f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:00.497277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3a7ebc-aa0e-473c-b4b6-c1e0f1a3fd0f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:00.497878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3a7ebc-aa0e-473c-b4b6-c1e0f1a3fd0f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:00.498944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3a7ebc-aa0e-473c-b4b6-c1e0f1a3fd0f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:00.499379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3a7ebc-aa0e-473c-b4b6-c1e0f1a3fd0f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:00.682431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-de3a7ebc-aa0e-473c-b4b6-c1e0f1a3fd0f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:00.692830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-de3a7ebc-aa0e-473c-b4b6-c1e0f1a3fd0f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.211236 Jul 25 19:33:00.693609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 449/926] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:00 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:01.033654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b0fd2555-8d76-461a-90be-ac3c4bc2d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:01.038304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b0fd2555-8d76-461a-90be-ac3c4bc2d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:01.045961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0fd2555-8d76-461a-90be-ac3c4bc2d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:01.046340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0fd2555-8d76-461a-90be-ac3c4bc2d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:01.047298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0fd2555-8d76-461a-90be-ac3c4bc2d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:01.047811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0fd2555-8d76-461a-90be-ac3c4bc2d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:01.082157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b0fd2555-8d76-461a-90be-ac3c4bc2d1b5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055160 Jul 25 19:33:01.087835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 478/927] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:01 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:01.334744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a4c4070c-6968-40d4-9a90-965d1931de02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:01.337310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a4c4070c-6968-40d4-9a90-965d1931de02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:01.344824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a4c4070c-6968-40d4-9a90-965d1931de02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:01.345331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a4c4070c-6968-40d4-9a90-965d1931de02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:01.346241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a4c4070c-6968-40d4-9a90-965d1931de02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:01.346733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a4c4070c-6968-40d4-9a90-965d1931de02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:01.385451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a4c4070c-6968-40d4-9a90-965d1931de02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055647 Jul 25 19:33:01.386209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 450/928] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:01.715683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c882825e-49b3-41c9-a96d-8fda3102bc43 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:01.716622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c882825e-49b3-41c9-a96d-8fda3102bc43 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:01.726349 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c882825e-49b3-41c9-a96d-8fda3102bc43 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:01.727155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c882825e-49b3-41c9-a96d-8fda3102bc43 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:01.728641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c882825e-49b3-41c9-a96d-8fda3102bc43 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:01.729433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c882825e-49b3-41c9-a96d-8fda3102bc43 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:01.946446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c882825e-49b3-41c9-a96d-8fda3102bc43 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:01.959994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c882825e-49b3-41c9-a96d-8fda3102bc43 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.247916 Jul 25 19:33:01.960817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 479/929] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:01 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:02.100228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f3f5e3c1-fb2b-46bd-a747-b7e3f7e10e97 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:02.103917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f3f5e3c1-fb2b-46bd-a747-b7e3f7e10e97 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:02.115092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3f5e3c1-fb2b-46bd-a747-b7e3f7e10e97 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:02.115613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3f5e3c1-fb2b-46bd-a747-b7e3f7e10e97 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:02.116454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3f5e3c1-fb2b-46bd-a747-b7e3f7e10e97 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:02.116914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3f5e3c1-fb2b-46bd-a747-b7e3f7e10e97 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:02.159790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f3f5e3c1-fb2b-46bd-a747-b7e3f7e10e97 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065962 Jul 25 19:33:02.160944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 451/930] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:02.402261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bed7bff7-1ec0-429b-9dad-0813677a5eab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:02.404837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bed7bff7-1ec0-429b-9dad-0813677a5eab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:02.414154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bed7bff7-1ec0-429b-9dad-0813677a5eab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:02.414602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bed7bff7-1ec0-429b-9dad-0813677a5eab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:02.415413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bed7bff7-1ec0-429b-9dad-0813677a5eab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:02.415898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bed7bff7-1ec0-429b-9dad-0813677a5eab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:02.453743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bed7bff7-1ec0-429b-9dad-0813677a5eab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057164 Jul 25 19:33:02.454338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 480/931] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:02.988300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d8903471-f3bf-4ab3-8f66-09ec21020731 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:02.989723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d8903471-f3bf-4ab3-8f66-09ec21020731 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:02.997041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8903471-f3bf-4ab3-8f66-09ec21020731 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:02.997543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8903471-f3bf-4ab3-8f66-09ec21020731 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:02.998494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8903471-f3bf-4ab3-8f66-09ec21020731 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:02.998979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8903471-f3bf-4ab3-8f66-09ec21020731 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:03.181723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-33568a89-e60a-4b89-85e8-5be20f2cf801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:03.185331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-33568a89-e60a-4b89-85e8-5be20f2cf801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:03.194917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33568a89-e60a-4b89-85e8-5be20f2cf801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:03.195702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33568a89-e60a-4b89-85e8-5be20f2cf801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:03.196486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d8903471-f3bf-4ab3-8f66-09ec21020731 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:03.197179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33568a89-e60a-4b89-85e8-5be20f2cf801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:03.197794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33568a89-e60a-4b89-85e8-5be20f2cf801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:03.209938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d8903471-f3bf-4ab3-8f66-09ec21020731 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.225687 Jul 25 19:33:03.210911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 452/932] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:02 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:03.221194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:03.243788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-33568a89-e60a-4b89-85e8-5be20f2cf801 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070439 Jul 25 19:33:03.244415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 481/933] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:03.470500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c5e8d666-c8b6-42b1-be41-9fef945f00a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:03.475010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c5e8d666-c8b6-42b1-be41-9fef945f00a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:03.484979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5e8d666-c8b6-42b1-be41-9fef945f00a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:03.485699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5e8d666-c8b6-42b1-be41-9fef945f00a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:03.487001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5e8d666-c8b6-42b1-be41-9fef945f00a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:03.487739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5e8d666-c8b6-42b1-be41-9fef945f00a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:03.518281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:03.531985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c5e8d666-c8b6-42b1-be41-9fef945f00a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067574 Jul 25 19:33:03.533083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 453/934] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:03 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:04.248670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-117540f5-f195-471f-b88c-46500a894fb7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:04.249842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-117540f5-f195-471f-b88c-46500a894fb7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:04.263282 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-117540f5-f195-471f-b88c-46500a894fb7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:04.264126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-117540f5-f195-471f-b88c-46500a894fb7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:04.265585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-117540f5-f195-471f-b88c-46500a894fb7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:04.266389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-117540f5-f195-471f-b88c-46500a894fb7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:04.271414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-94025475-28c1-4e00-a41a-26a2e1ca311b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:04.273856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-94025475-28c1-4e00-a41a-26a2e1ca311b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:04.276429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=82 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:04.283017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94025475-28c1-4e00-a41a-26a2e1ca311b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:04.283468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94025475-28c1-4e00-a41a-26a2e1ca311b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:04.284302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94025475-28c1-4e00-a41a-26a2e1ca311b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:04.284739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94025475-28c1-4e00-a41a-26a2e1ca311b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:04.326061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-94025475-28c1-4e00-a41a-26a2e1ca311b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060477 Jul 25 19:33:04.326655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 454/935] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:04.459317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-117540f5-f195-471f-b88c-46500a894fb7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:04.467760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-117540f5-f195-471f-b88c-46500a894fb7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.226529 Jul 25 19:33:04.468348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 482/936] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:04 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:04.546408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ad7096c0-2916-40fd-a808-4167fa8dd80b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:04.548748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ad7096c0-2916-40fd-a808-4167fa8dd80b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:04.556946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7096c0-2916-40fd-a808-4167fa8dd80b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:04.557538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7096c0-2916-40fd-a808-4167fa8dd80b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:04.558383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7096c0-2916-40fd-a808-4167fa8dd80b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:04.558877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7096c0-2916-40fd-a808-4167fa8dd80b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:04.595485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ad7096c0-2916-40fd-a808-4167fa8dd80b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053140 Jul 25 19:33:04.596226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 455/937] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:05.346083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-75188e33-c1a5-413d-bbdb-e84adb9cb95f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:05.348876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-75188e33-c1a5-413d-bbdb-e84adb9cb95f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:05.356766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75188e33-c1a5-413d-bbdb-e84adb9cb95f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:05.357263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75188e33-c1a5-413d-bbdb-e84adb9cb95f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:05.358115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75188e33-c1a5-413d-bbdb-e84adb9cb95f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:05.358598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75188e33-c1a5-413d-bbdb-e84adb9cb95f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:05.397305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-75188e33-c1a5-413d-bbdb-e84adb9cb95f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057990 Jul 25 19:33:05.399768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 483/938] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:05.492713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-adf13d73-7a10-40a0-938c-71ec849d1896 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:05.493538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-adf13d73-7a10-40a0-938c-71ec849d1896 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:05.501396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adf13d73-7a10-40a0-938c-71ec849d1896 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:05.501917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adf13d73-7a10-40a0-938c-71ec849d1896 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:05.502735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adf13d73-7a10-40a0-938c-71ec849d1896 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:05.503178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adf13d73-7a10-40a0-938c-71ec849d1896 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:05.553682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:33:05.554004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e (ip 10.222.0.18) !!! Jul 25 19:33:05.615196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-571b83cb-456d-4560-9eee-9553b39d3a81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:05.619793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-571b83cb-456d-4560-9eee-9553b39d3a81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:05.628558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-571b83cb-456d-4560-9eee-9553b39d3a81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:05.629256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-571b83cb-456d-4560-9eee-9553b39d3a81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:05.630879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-571b83cb-456d-4560-9eee-9553b39d3a81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:05.631400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-571b83cb-456d-4560-9eee-9553b39d3a81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:05.687808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-571b83cb-456d-4560-9eee-9553b39d3a81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081750 Jul 25 19:33:05.688570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 484/939] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:05.714067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-adf13d73-7a10-40a0-938c-71ec849d1896 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:05.723937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-adf13d73-7a10-40a0-938c-71ec849d1896 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.234446 Jul 25 19:33:05.724705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 456/940] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:05 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:06.416192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7104af0a-2fab-445e-b915-69464e05b851 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:06.419734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7104af0a-2fab-445e-b915-69464e05b851 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:06.429840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7104af0a-2fab-445e-b915-69464e05b851 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:06.430405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7104af0a-2fab-445e-b915-69464e05b851 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:06.431623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7104af0a-2fab-445e-b915-69464e05b851 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:06.432258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7104af0a-2fab-445e-b915-69464e05b851 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:06.480796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7104af0a-2fab-445e-b915-69464e05b851 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071423 Jul 25 19:33:06.481467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 485/941] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:06.705534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b1005247-0215-4e16-b68c-5f9a35a23f88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:06.708977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b1005247-0215-4e16-b68c-5f9a35a23f88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:06.718307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1005247-0215-4e16-b68c-5f9a35a23f88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:06.718932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1005247-0215-4e16-b68c-5f9a35a23f88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:06.719994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1005247-0215-4e16-b68c-5f9a35a23f88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:06.720500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1005247-0215-4e16-b68c-5f9a35a23f88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:06.751894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2da46a7e-618b-4646-a723-4e530e4530df tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:06.752980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2da46a7e-618b-4646-a723-4e530e4530df tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:06.765044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b1005247-0215-4e16-b68c-5f9a35a23f88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065974 Jul 25 19:33:06.765378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2da46a7e-618b-4646-a723-4e530e4530df tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:06.765983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 457/942] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:06.766218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2da46a7e-618b-4646-a723-4e530e4530df tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:06.767471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2da46a7e-618b-4646-a723-4e530e4530df tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:06.768302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2da46a7e-618b-4646-a723-4e530e4530df tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:06.980821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2da46a7e-618b-4646-a723-4e530e4530df tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:06.990521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2da46a7e-618b-4646-a723-4e530e4530df tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.246136 Jul 25 19:33:06.991186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 486/943] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:06 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:07.498223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c1ab7dee-bee6-46f0-8402-30581fdb1ff5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:07.502060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c1ab7dee-bee6-46f0-8402-30581fdb1ff5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:07.514044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1ab7dee-bee6-46f0-8402-30581fdb1ff5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:07.514849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1ab7dee-bee6-46f0-8402-30581fdb1ff5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:07.516365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1ab7dee-bee6-46f0-8402-30581fdb1ff5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:07.517139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1ab7dee-bee6-46f0-8402-30581fdb1ff5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:07.579059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c1ab7dee-bee6-46f0-8402-30581fdb1ff5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088010 Jul 25 19:33:07.580175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 458/944] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:07.783012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8e994f35-3021-4c6d-bf8f-b93d6da4c518 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:07.787408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8e994f35-3021-4c6d-bf8f-b93d6da4c518 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:07.795506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e994f35-3021-4c6d-bf8f-b93d6da4c518 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:07.795991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e994f35-3021-4c6d-bf8f-b93d6da4c518 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:07.796801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e994f35-3021-4c6d-bf8f-b93d6da4c518 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:07.797241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e994f35-3021-4c6d-bf8f-b93d6da4c518 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:07.833983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8e994f35-3021-4c6d-bf8f-b93d6da4c518 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058653 Jul 25 19:33:07.834585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 487/945] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:08.015645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-13a69172-0b1a-4194-9dde-2b77c022eb69 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:08.016671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-13a69172-0b1a-4194-9dde-2b77c022eb69 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:08.027400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13a69172-0b1a-4194-9dde-2b77c022eb69 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:08.027898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13a69172-0b1a-4194-9dde-2b77c022eb69 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:08.029205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13a69172-0b1a-4194-9dde-2b77c022eb69 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:08.029960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13a69172-0b1a-4194-9dde-2b77c022eb69 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:08.264580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-13a69172-0b1a-4194-9dde-2b77c022eb69 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:08.275076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-13a69172-0b1a-4194-9dde-2b77c022eb69 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.264746 Jul 25 19:33:08.275970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 459/946] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:08 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:08.600737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-acd687c9-6b84-4fa9-ba52-97ff3093e86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:08.604792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-acd687c9-6b84-4fa9-ba52-97ff3093e86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:08.618787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-acd687c9-6b84-4fa9-ba52-97ff3093e86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:08.619240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-acd687c9-6b84-4fa9-ba52-97ff3093e86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:08.620115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-acd687c9-6b84-4fa9-ba52-97ff3093e86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:08.620565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-acd687c9-6b84-4fa9-ba52-97ff3093e86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:08.657271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-acd687c9-6b84-4fa9-ba52-97ff3093e86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066201 Jul 25 19:33:08.658161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 488/947] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:08.849227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-98fc6c0f-ee91-4d1b-950f-fdece8265d7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:08.852189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-98fc6c0f-ee91-4d1b-950f-fdece8265d7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:08.859300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98fc6c0f-ee91-4d1b-950f-fdece8265d7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:08.859783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98fc6c0f-ee91-4d1b-950f-fdece8265d7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:08.860588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98fc6c0f-ee91-4d1b-950f-fdece8265d7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:08.861034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98fc6c0f-ee91-4d1b-950f-fdece8265d7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:08.897730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-98fc6c0f-ee91-4d1b-950f-fdece8265d7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054040 Jul 25 19:33:08.898535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 460/948] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:09.299901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ca28dcd-a1d4-40fe-8c14-3fe3cc0e1633 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:09.300756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ca28dcd-a1d4-40fe-8c14-3fe3cc0e1633 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:09.309470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca28dcd-a1d4-40fe-8c14-3fe3cc0e1633 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:09.309920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca28dcd-a1d4-40fe-8c14-3fe3cc0e1633 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:09.310708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca28dcd-a1d4-40fe-8c14-3fe3cc0e1633 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:09.311143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca28dcd-a1d4-40fe-8c14-3fe3cc0e1633 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:09.522234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ca28dcd-a1d4-40fe-8c14-3fe3cc0e1633 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:09.533399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ca28dcd-a1d4-40fe-8c14-3fe3cc0e1633 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.238422 Jul 25 19:33:09.534058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 489/949] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:09 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:09.678509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0243ea29-63e9-42a6-bf44-3fa19bf55cc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:09.682378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0243ea29-63e9-42a6-bf44-3fa19bf55cc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:09.695132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0243ea29-63e9-42a6-bf44-3fa19bf55cc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:09.695848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0243ea29-63e9-42a6-bf44-3fa19bf55cc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:09.697232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0243ea29-63e9-42a6-bf44-3fa19bf55cc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:09.698670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0243ea29-63e9-42a6-bf44-3fa19bf55cc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:09.759649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0243ea29-63e9-42a6-bf44-3fa19bf55cc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088233 Jul 25 19:33:09.760707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 461/950] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:09.912051 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f82ac5e8-84a7-4f8f-a023-7942ac6e28c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:09.914598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f82ac5e8-84a7-4f8f-a023-7942ac6e28c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:09.922220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f82ac5e8-84a7-4f8f-a023-7942ac6e28c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:09.922731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f82ac5e8-84a7-4f8f-a023-7942ac6e28c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:09.923695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f82ac5e8-84a7-4f8f-a023-7942ac6e28c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:09.924278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f82ac5e8-84a7-4f8f-a023-7942ac6e28c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:09.961629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f82ac5e8-84a7-4f8f-a023-7942ac6e28c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053659 Jul 25 19:33:09.962398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 490/951] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:10.561315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d9f1655b-2a46-4d98-a960-54ae5fae4766 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:10.562463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d9f1655b-2a46-4d98-a960-54ae5fae4766 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:10.572393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9f1655b-2a46-4d98-a960-54ae5fae4766 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:10.572844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9f1655b-2a46-4d98-a960-54ae5fae4766 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:10.573658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9f1655b-2a46-4d98-a960-54ae5fae4766 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:10.574170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9f1655b-2a46-4d98-a960-54ae5fae4766 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:10.745521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d9f1655b-2a46-4d98-a960-54ae5fae4766 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:10.755397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d9f1655b-2a46-4d98-a960-54ae5fae4766 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.201315 Jul 25 19:33:10.756288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 462/952] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:10 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:10.777924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ff2630d-1d7a-4b31-bb03-56dfa6004270 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:10.780286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ff2630d-1d7a-4b31-bb03-56dfa6004270 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:10.788698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff2630d-1d7a-4b31-bb03-56dfa6004270 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:10.789293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff2630d-1d7a-4b31-bb03-56dfa6004270 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:10.790238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff2630d-1d7a-4b31-bb03-56dfa6004270 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:10.790769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff2630d-1d7a-4b31-bb03-56dfa6004270 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:10.828825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ff2630d-1d7a-4b31-bb03-56dfa6004270 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055101 Jul 25 19:33:10.829616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 491/953] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:10.983054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c1830271-b4d6-4529-8b34-32094397f856 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:10.987131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c1830271-b4d6-4529-8b34-32094397f856 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:11.000702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1830271-b4d6-4529-8b34-32094397f856 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:11.001505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1830271-b4d6-4529-8b34-32094397f856 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:11.002912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1830271-b4d6-4529-8b34-32094397f856 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:11.003768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1830271-b4d6-4529-8b34-32094397f856 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:11.052331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c1830271-b4d6-4529-8b34-32094397f856 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079083 Jul 25 19:33:11.053329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 463/954] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:11.786182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8be95d40-7866-4f94-ba28-0f0aff9f7bdc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:11.787350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8be95d40-7866-4f94-ba28-0f0aff9f7bdc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:11.799841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8be95d40-7866-4f94-ba28-0f0aff9f7bdc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:11.800642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8be95d40-7866-4f94-ba28-0f0aff9f7bdc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:11.802064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8be95d40-7866-4f94-ba28-0f0aff9f7bdc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:11.802851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8be95d40-7866-4f94-ba28-0f0aff9f7bdc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:11.844627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d752a932-7587-4d61-86e2-0e40c2b612c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:11.847279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d752a932-7587-4d61-86e2-0e40c2b612c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:11.857245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d752a932-7587-4d61-86e2-0e40c2b612c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:11.857704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d752a932-7587-4d61-86e2-0e40c2b612c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:11.858518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d752a932-7587-4d61-86e2-0e40c2b612c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:11.858966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d752a932-7587-4d61-86e2-0e40c2b612c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:11.901198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d752a932-7587-4d61-86e2-0e40c2b612c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060361 Jul 25 19:33:11.902641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 464/955] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:12.022939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8be95d40-7866-4f94-ba28-0f0aff9f7bdc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:12.032885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8be95d40-7866-4f94-ba28-0f0aff9f7bdc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.254631 Jul 25 19:33:12.033552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 492/956] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:11 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:12.070094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a7f38147-9883-45cf-b9db-d44e8305ca16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:12.072735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a7f38147-9883-45cf-b9db-d44e8305ca16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:12.080226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7f38147-9883-45cf-b9db-d44e8305ca16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:12.080679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7f38147-9883-45cf-b9db-d44e8305ca16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:12.081481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7f38147-9883-45cf-b9db-d44e8305ca16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:12.081922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7f38147-9883-45cf-b9db-d44e8305ca16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:12.122481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a7f38147-9883-45cf-b9db-d44e8305ca16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057434 Jul 25 19:33:12.123383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 465/957] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:12.916058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bc681fb3-9548-4d98-ab75-a5d701222475 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:12.918872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bc681fb3-9548-4d98-ab75-a5d701222475 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:12.930482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc681fb3-9548-4d98-ab75-a5d701222475 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:12.931700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc681fb3-9548-4d98-ab75-a5d701222475 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:12.933175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc681fb3-9548-4d98-ab75-a5d701222475 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:12.933970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc681fb3-9548-4d98-ab75-a5d701222475 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:12.998125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bc681fb3-9548-4d98-ab75-a5d701222475 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086129 Jul 25 19:33:12.999265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 493/958] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:13.061877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-99350661-b59f-40c2-9e62-a6f56c7cd445 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:13.062944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-99350661-b59f-40c2-9e62-a6f56c7cd445 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:13.078359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99350661-b59f-40c2-9e62-a6f56c7cd445 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:13.079317 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99350661-b59f-40c2-9e62-a6f56c7cd445 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:13.081105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99350661-b59f-40c2-9e62-a6f56c7cd445 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:13.081928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99350661-b59f-40c2-9e62-a6f56c7cd445 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:13.140161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ccc1374e-4023-4e1e-ac4d-de8b2f361ba8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:13.143370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ccc1374e-4023-4e1e-ac4d-de8b2f361ba8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:13.154188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccc1374e-4023-4e1e-ac4d-de8b2f361ba8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:13.154919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccc1374e-4023-4e1e-ac4d-de8b2f361ba8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:13.155901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccc1374e-4023-4e1e-ac4d-de8b2f361ba8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:13.156355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccc1374e-4023-4e1e-ac4d-de8b2f361ba8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:13.210049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ccc1374e-4023-4e1e-ac4d-de8b2f361ba8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075445 Jul 25 19:33:13.210920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 494/959] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:13.279303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-99350661-b59f-40c2-9e62-a6f56c7cd445 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:13.288880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-99350661-b59f-40c2-9e62-a6f56c7cd445 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.236483 Jul 25 19:33:13.289649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 466/960] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:13 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:14.016095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af20f266-71f4-4f96-9dea-2766b7ac2208 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:14.018345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af20f266-71f4-4f96-9dea-2766b7ac2208 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:14.026696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af20f266-71f4-4f96-9dea-2766b7ac2208 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:14.027165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af20f266-71f4-4f96-9dea-2766b7ac2208 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:14.027977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af20f266-71f4-4f96-9dea-2766b7ac2208 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:14.028420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af20f266-71f4-4f96-9dea-2766b7ac2208 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:14.065801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af20f266-71f4-4f96-9dea-2766b7ac2208 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056667 Jul 25 19:33:14.066380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 495/961] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:14.224361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c33d7412-60de-4e7e-8162-cb05c3eb8f7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:14.226837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c33d7412-60de-4e7e-8162-cb05c3eb8f7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:14.236226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c33d7412-60de-4e7e-8162-cb05c3eb8f7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:14.236674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c33d7412-60de-4e7e-8162-cb05c3eb8f7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:14.237479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c33d7412-60de-4e7e-8162-cb05c3eb8f7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:14.237966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c33d7412-60de-4e7e-8162-cb05c3eb8f7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:14.276895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c33d7412-60de-4e7e-8162-cb05c3eb8f7f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057604 Jul 25 19:33:14.277820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 467/962] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:14 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:14.314162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48f9538e-3b51-4cca-bcc9-42feaf425e48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:14.315064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48f9538e-3b51-4cca-bcc9-42feaf425e48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:14.323326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48f9538e-3b51-4cca-bcc9-42feaf425e48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:14.323814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48f9538e-3b51-4cca-bcc9-42feaf425e48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:14.324614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48f9538e-3b51-4cca-bcc9-42feaf425e48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:14.325061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48f9538e-3b51-4cca-bcc9-42feaf425e48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:14.500429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48f9538e-3b51-4cca-bcc9-42feaf425e48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:14.510784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48f9538e-3b51-4cca-bcc9-42feaf425e48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.202216 Jul 25 19:33:14.511496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 496/963] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:14 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:15.082188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1dab9b01-4c6e-4907-b5d2-794220217c6e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:15.086520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1dab9b01-4c6e-4907-b5d2-794220217c6e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:15.096738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1dab9b01-4c6e-4907-b5d2-794220217c6e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:15.097190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1dab9b01-4c6e-4907-b5d2-794220217c6e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:15.098056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1dab9b01-4c6e-4907-b5d2-794220217c6e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:15.098507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1dab9b01-4c6e-4907-b5d2-794220217c6e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:15.138088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1dab9b01-4c6e-4907-b5d2-794220217c6e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060497 Jul 25 19:33:15.138696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 468/964] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:15.291641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a691e0c-4c89-4852-a980-aac188259787 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:15.294803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a691e0c-4c89-4852-a980-aac188259787 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:15.302860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a691e0c-4c89-4852-a980-aac188259787 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:15.303320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a691e0c-4c89-4852-a980-aac188259787 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:15.304142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a691e0c-4c89-4852-a980-aac188259787 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:15.304580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a691e0c-4c89-4852-a980-aac188259787 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:15.343233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a691e0c-4c89-4852-a980-aac188259787 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056825 Jul 25 19:33:15.344009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 497/965] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:15.536315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3509c118-a068-426f-a8fe-449f4f55750d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:15.537259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3509c118-a068-426f-a8fe-449f4f55750d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:15.544309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3509c118-a068-426f-a8fe-449f4f55750d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:15.544763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3509c118-a068-426f-a8fe-449f4f55750d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:15.545568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3509c118-a068-426f-a8fe-449f4f55750d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:15.546010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3509c118-a068-426f-a8fe-449f4f55750d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:15.750166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3509c118-a068-426f-a8fe-449f4f55750d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:15.760588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3509c118-a068-426f-a8fe-449f4f55750d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.228043 Jul 25 19:33:15.761361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 469/966] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:15 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:16.155345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b369b0b-e699-464e-9d17-0bbde7f39fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:16.158040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b369b0b-e699-464e-9d17-0bbde7f39fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:16.171972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b369b0b-e699-464e-9d17-0bbde7f39fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:16.172290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b369b0b-e699-464e-9d17-0bbde7f39fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:16.173353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b369b0b-e699-464e-9d17-0bbde7f39fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:16.173967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b369b0b-e699-464e-9d17-0bbde7f39fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:16.178051 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:16.222999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b369b0b-e699-464e-9d17-0bbde7f39fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072403 Jul 25 19:33:16.229999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 498/967] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:16.361853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b70df5c1-07e6-45e1-b9d4-66f0b993541f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:16.366541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b70df5c1-07e6-45e1-b9d4-66f0b993541f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:16.377618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b70df5c1-07e6-45e1-b9d4-66f0b993541f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:16.378397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b70df5c1-07e6-45e1-b9d4-66f0b993541f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:16.381082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b70df5c1-07e6-45e1-b9d4-66f0b993541f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:16.381824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b70df5c1-07e6-45e1-b9d4-66f0b993541f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:16.412829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:16.445980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b70df5c1-07e6-45e1-b9d4-66f0b993541f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090662 Jul 25 19:33:16.447030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 470/968] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:16.799284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-29c3b834-89f7-4c5e-a434-e7f8a3d8d1ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:16.803436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-29c3b834-89f7-4c5e-a434-e7f8a3d8d1ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:16.815820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29c3b834-89f7-4c5e-a434-e7f8a3d8d1ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:16.816361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29c3b834-89f7-4c5e-a434-e7f8a3d8d1ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:16.817716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29c3b834-89f7-4c5e-a434-e7f8a3d8d1ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:16.818630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29c3b834-89f7-4c5e-a434-e7f8a3d8d1ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:17.049466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-29c3b834-89f7-4c5e-a434-e7f8a3d8d1ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:17.063457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-29c3b834-89f7-4c5e-a434-e7f8a3d8d1ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.273961 Jul 25 19:33:17.064498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 499/969] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:16 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:17.241773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-63cbdc39-d8e6-47fd-882e-27dfe80483b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:17.245579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-63cbdc39-d8e6-47fd-882e-27dfe80483b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:17.254021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63cbdc39-d8e6-47fd-882e-27dfe80483b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:17.255171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63cbdc39-d8e6-47fd-882e-27dfe80483b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:17.255970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63cbdc39-d8e6-47fd-882e-27dfe80483b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:17.256412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63cbdc39-d8e6-47fd-882e-27dfe80483b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:17.292514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-63cbdc39-d8e6-47fd-882e-27dfe80483b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058384 Jul 25 19:33:17.293254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 471/970] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:17.467881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ca357bf-ecb3-41b4-8fba-d61206e8630c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:17.471153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ca357bf-ecb3-41b4-8fba-d61206e8630c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:17.484013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ca357bf-ecb3-41b4-8fba-d61206e8630c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:17.484856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ca357bf-ecb3-41b4-8fba-d61206e8630c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:17.486276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ca357bf-ecb3-41b4-8fba-d61206e8630c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:17.487061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ca357bf-ecb3-41b4-8fba-d61206e8630c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:17.534653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4ca357bf-ecb3-41b4-8fba-d61206e8630c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074378 Jul 25 19:33:17.535257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 500/971] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:18.105869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2cad1ffe-e9bc-4ecf-955c-5cdc39a9befa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:18.106982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2cad1ffe-e9bc-4ecf-955c-5cdc39a9befa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:18.115097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2cad1ffe-e9bc-4ecf-955c-5cdc39a9befa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:18.115910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2cad1ffe-e9bc-4ecf-955c-5cdc39a9befa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:18.116805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2cad1ffe-e9bc-4ecf-955c-5cdc39a9befa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:18.117457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2cad1ffe-e9bc-4ecf-955c-5cdc39a9befa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:18.313472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b88675b-b5f6-4fb6-99d3-4b6a0af795e8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:18.316163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b88675b-b5f6-4fb6-99d3-4b6a0af795e8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:18.325675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b88675b-b5f6-4fb6-99d3-4b6a0af795e8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:18.326290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2cad1ffe-e9bc-4ecf-955c-5cdc39a9befa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:18.327039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b88675b-b5f6-4fb6-99d3-4b6a0af795e8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:18.327388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b88675b-b5f6-4fb6-99d3-4b6a0af795e8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:18.328078 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b88675b-b5f6-4fb6-99d3-4b6a0af795e8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:18.342722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2cad1ffe-e9bc-4ecf-955c-5cdc39a9befa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.243911 Jul 25 19:33:18.343834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 472/972] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:18 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:18.371190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b88675b-b5f6-4fb6-99d3-4b6a0af795e8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068520 Jul 25 19:33:18.371905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 501/973] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:18.550493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0254e82c-72e7-46a5-bd60-e0fde85784cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:18.554472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0254e82c-72e7-46a5-bd60-e0fde85784cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:18.561908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0254e82c-72e7-46a5-bd60-e0fde85784cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:18.562357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0254e82c-72e7-46a5-bd60-e0fde85784cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:18.563166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0254e82c-72e7-46a5-bd60-e0fde85784cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:18.563644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0254e82c-72e7-46a5-bd60-e0fde85784cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:18.601750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0254e82c-72e7-46a5-bd60-e0fde85784cd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056689 Jul 25 19:33:18.602357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 473/974] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:19.384443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-454ad3d3-87c8-4088-9ec2-756a88e6e06c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:19.385278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-454ad3d3-87c8-4088-9ec2-756a88e6e06c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:19.388290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=82 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:19.389416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-75873195-0ef9-41c2-91fb-368d9e45fe7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:19.393419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-75873195-0ef9-41c2-91fb-368d9e45fe7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:19.396130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-454ad3d3-87c8-4088-9ec2-756a88e6e06c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:19.396400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-454ad3d3-87c8-4088-9ec2-756a88e6e06c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:19.398030 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-454ad3d3-87c8-4088-9ec2-756a88e6e06c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:19.398212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-454ad3d3-87c8-4088-9ec2-756a88e6e06c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:19.411716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75873195-0ef9-41c2-91fb-368d9e45fe7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:19.411716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75873195-0ef9-41c2-91fb-368d9e45fe7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:19.412836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75873195-0ef9-41c2-91fb-368d9e45fe7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:19.413838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75873195-0ef9-41c2-91fb-368d9e45fe7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:19.478326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-75873195-0ef9-41c2-91fb-368d9e45fe7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096257 Jul 25 19:33:19.483926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 474/975] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:19.624011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-454ad3d3-87c8-4088-9ec2-756a88e6e06c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:19.626699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2de0b373-b76a-4285-9fa0-fdaa8f29a367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:19.633070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2de0b373-b76a-4285-9fa0-fdaa8f29a367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:19.635720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-454ad3d3-87c8-4088-9ec2-756a88e6e06c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.258495 Jul 25 19:33:19.636779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 502/976] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:19 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:19.663020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2de0b373-b76a-4285-9fa0-fdaa8f29a367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:19.663842 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2de0b373-b76a-4285-9fa0-fdaa8f29a367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:19.665296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2de0b373-b76a-4285-9fa0-fdaa8f29a367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:19.666085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2de0b373-b76a-4285-9fa0-fdaa8f29a367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:19.732961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2de0b373-b76a-4285-9fa0-fdaa8f29a367 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119148 Jul 25 19:33:19.733921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 475/977] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:20.493062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-383400d6-7a61-4f47-8d6b-b4e61091853b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:20.495203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-383400d6-7a61-4f47-8d6b-b4e61091853b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:20.506155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-383400d6-7a61-4f47-8d6b-b4e61091853b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:20.506935 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-383400d6-7a61-4f47-8d6b-b4e61091853b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:20.508422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-383400d6-7a61-4f47-8d6b-b4e61091853b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:20.509176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-383400d6-7a61-4f47-8d6b-b4e61091853b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:20.562529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-383400d6-7a61-4f47-8d6b-b4e61091853b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074708 Jul 25 19:33:20.563225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 503/978] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:20.675285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c47ebbdd-4f2c-4d93-af66-fb0e18ced58d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:20.677071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c47ebbdd-4f2c-4d93-af66-fb0e18ced58d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:20.684933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47ebbdd-4f2c-4d93-af66-fb0e18ced58d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:20.685472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47ebbdd-4f2c-4d93-af66-fb0e18ced58d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:20.686301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47ebbdd-4f2c-4d93-af66-fb0e18ced58d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:20.686758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47ebbdd-4f2c-4d93-af66-fb0e18ced58d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:20.749906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-01bf0bff-e413-49be-9a65-25087b40da27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:20.752235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-01bf0bff-e413-49be-9a65-25087b40da27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:20.762065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01bf0bff-e413-49be-9a65-25087b40da27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:20.762515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01bf0bff-e413-49be-9a65-25087b40da27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:20.763438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01bf0bff-e413-49be-9a65-25087b40da27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:20.763929 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01bf0bff-e413-49be-9a65-25087b40da27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:20.800596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-01bf0bff-e413-49be-9a65-25087b40da27 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054725 Jul 25 19:33:20.801825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 504/979] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:20.873274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c47ebbdd-4f2c-4d93-af66-fb0e18ced58d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:20.888275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c47ebbdd-4f2c-4d93-af66-fb0e18ced58d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.216578 Jul 25 19:33:20.889787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 476/980] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:20 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:21.580600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3808ac1e-3c3d-409c-ae37-3a90afaa472b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:21.584349 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3808ac1e-3c3d-409c-ae37-3a90afaa472b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:21.592300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3808ac1e-3c3d-409c-ae37-3a90afaa472b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:21.592750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3808ac1e-3c3d-409c-ae37-3a90afaa472b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:21.593548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3808ac1e-3c3d-409c-ae37-3a90afaa472b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:21.594008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3808ac1e-3c3d-409c-ae37-3a90afaa472b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:21.634107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3808ac1e-3c3d-409c-ae37-3a90afaa472b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057998 Jul 25 19:33:21.634697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 505/981] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:21.821613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fa247ccf-3827-4445-87a3-45fb43d72fb7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:21.825572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fa247ccf-3827-4445-87a3-45fb43d72fb7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:21.838884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa247ccf-3827-4445-87a3-45fb43d72fb7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:21.839595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa247ccf-3827-4445-87a3-45fb43d72fb7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:21.841052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa247ccf-3827-4445-87a3-45fb43d72fb7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:21.841852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa247ccf-3827-4445-87a3-45fb43d72fb7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:21.884679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fa247ccf-3827-4445-87a3-45fb43d72fb7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071193 Jul 25 19:33:21.885309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 477/982] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:21.918228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f0e7e332-91f8-4950-828f-10e01a640b3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:21.918702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f0e7e332-91f8-4950-828f-10e01a640b3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:21.926546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0e7e332-91f8-4950-828f-10e01a640b3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:21.927162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0e7e332-91f8-4950-828f-10e01a640b3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:21.928418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0e7e332-91f8-4950-828f-10e01a640b3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:21.928938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0e7e332-91f8-4950-828f-10e01a640b3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:22.098445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f0e7e332-91f8-4950-828f-10e01a640b3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:22.114668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f0e7e332-91f8-4950-828f-10e01a640b3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.199626 Jul 25 19:33:22.115750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 506/983] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:21 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:22.651882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d4433608-cad9-469b-a25a-3aa2a0639518 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:22.654119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d4433608-cad9-469b-a25a-3aa2a0639518 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:22.661174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4433608-cad9-469b-a25a-3aa2a0639518 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:22.661959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4433608-cad9-469b-a25a-3aa2a0639518 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:22.662822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4433608-cad9-469b-a25a-3aa2a0639518 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:22.663265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4433608-cad9-469b-a25a-3aa2a0639518 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:22.699095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d4433608-cad9-469b-a25a-3aa2a0639518 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051917 Jul 25 19:33:22.699898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 478/984] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:22.905981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b956b38-3d9d-4848-bd23-1c2a460dfbd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:22.909890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b956b38-3d9d-4848-bd23-1c2a460dfbd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:22.923205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b956b38-3d9d-4848-bd23-1c2a460dfbd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:22.924081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b956b38-3d9d-4848-bd23-1c2a460dfbd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:22.925561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b956b38-3d9d-4848-bd23-1c2a460dfbd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:22.927369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b956b38-3d9d-4848-bd23-1c2a460dfbd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:22.991694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b956b38-3d9d-4848-bd23-1c2a460dfbd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093335 Jul 25 19:33:22.992792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 507/985] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:23.145407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c18eb535-2d16-475e-ac79-e1c2ca328e81 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:23.146504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c18eb535-2d16-475e-ac79-e1c2ca328e81 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:23.155131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c18eb535-2d16-475e-ac79-e1c2ca328e81 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:23.155755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c18eb535-2d16-475e-ac79-e1c2ca328e81 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:23.156745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c18eb535-2d16-475e-ac79-e1c2ca328e81 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:23.157224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c18eb535-2d16-475e-ac79-e1c2ca328e81 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:23.371066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c18eb535-2d16-475e-ac79-e1c2ca328e81 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:23.384999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c18eb535-2d16-475e-ac79-e1c2ca328e81 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.244170 Jul 25 19:33:23.385920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 479/986] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:23 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:23.714533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-542bd92a-0ef5-4342-bc54-df46e494ce53 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:23.718426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-542bd92a-0ef5-4342-bc54-df46e494ce53 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:23.726782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-542bd92a-0ef5-4342-bc54-df46e494ce53 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:23.727356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-542bd92a-0ef5-4342-bc54-df46e494ce53 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:23.728331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-542bd92a-0ef5-4342-bc54-df46e494ce53 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:23.728875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-542bd92a-0ef5-4342-bc54-df46e494ce53 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:23.764289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-542bd92a-0ef5-4342-bc54-df46e494ce53 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054320 Jul 25 19:33:23.764891 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 508/987] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:24.010713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-89a55be4-399a-4829-8109-49719b7e8ef2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:24.014557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-89a55be4-399a-4829-8109-49719b7e8ef2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:24.026312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89a55be4-399a-4829-8109-49719b7e8ef2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:24.027082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89a55be4-399a-4829-8109-49719b7e8ef2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:24.028650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89a55be4-399a-4829-8109-49719b7e8ef2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:24.029446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89a55be4-399a-4829-8109-49719b7e8ef2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:24.094886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-89a55be4-399a-4829-8109-49719b7e8ef2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090744 Jul 25 19:33:24.096024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 480/988] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:24.419293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-865e5bca-4c61-47db-afe7-7c3a68b04e15 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:24.420296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-865e5bca-4c61-47db-afe7-7c3a68b04e15 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:24.429206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-865e5bca-4c61-47db-afe7-7c3a68b04e15 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:24.429652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-865e5bca-4c61-47db-afe7-7c3a68b04e15 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:24.430442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-865e5bca-4c61-47db-afe7-7c3a68b04e15 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:24.430878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-865e5bca-4c61-47db-afe7-7c3a68b04e15 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:24.629457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-865e5bca-4c61-47db-afe7-7c3a68b04e15 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:24.640074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-865e5bca-4c61-47db-afe7-7c3a68b04e15 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.225340 Jul 25 19:33:24.640777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 509/989] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:24 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:24.778139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b6c7b0bf-ba86-4e8f-8fcb-484d263402bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:24.780630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b6c7b0bf-ba86-4e8f-8fcb-484d263402bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:24.791876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6c7b0bf-ba86-4e8f-8fcb-484d263402bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:24.792337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6c7b0bf-ba86-4e8f-8fcb-484d263402bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:24.793159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6c7b0bf-ba86-4e8f-8fcb-484d263402bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:24.793602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6c7b0bf-ba86-4e8f-8fcb-484d263402bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:24.835877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b6c7b0bf-ba86-4e8f-8fcb-484d263402bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062286 Jul 25 19:33:24.836751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 481/990] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:25.112934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-82c8637a-fd2e-45c5-81be-882daff53274 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:25.117446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-82c8637a-fd2e-45c5-81be-882daff53274 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:25.125261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82c8637a-fd2e-45c5-81be-882daff53274 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:25.125857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82c8637a-fd2e-45c5-81be-882daff53274 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:25.127019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82c8637a-fd2e-45c5-81be-882daff53274 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:25.127604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82c8637a-fd2e-45c5-81be-882daff53274 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:25.166695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-82c8637a-fd2e-45c5-81be-882daff53274 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058022 Jul 25 19:33:25.168039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 510/991] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:25.667027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1352f92b-70f6-4665-83d9-4f81b77dd42e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:25.667689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1352f92b-70f6-4665-83d9-4f81b77dd42e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:25.674305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1352f92b-70f6-4665-83d9-4f81b77dd42e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:25.674753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1352f92b-70f6-4665-83d9-4f81b77dd42e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:25.675581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1352f92b-70f6-4665-83d9-4f81b77dd42e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:25.676155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1352f92b-70f6-4665-83d9-4f81b77dd42e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:25.854229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5e33a0f6-3d66-4a4b-9455-b6fddfc018e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:25.856901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5e33a0f6-3d66-4a4b-9455-b6fddfc018e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:25.866321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e33a0f6-3d66-4a4b-9455-b6fddfc018e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:25.867140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e33a0f6-3d66-4a4b-9455-b6fddfc018e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:25.868245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e33a0f6-3d66-4a4b-9455-b6fddfc018e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:25.868707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e33a0f6-3d66-4a4b-9455-b6fddfc018e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:25.881580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1352f92b-70f6-4665-83d9-4f81b77dd42e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:25.903780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1352f92b-70f6-4665-83d9-4f81b77dd42e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.240822 Jul 25 19:33:25.904572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 482/992] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:25 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:25.905220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5e33a0f6-3d66-4a4b-9455-b6fddfc018e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055568 Jul 25 19:33:25.905934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 511/993] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:26.185135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1004e4ec-2df0-47a0-bad2-77021144d583 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:26.188719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1004e4ec-2df0-47a0-bad2-77021144d583 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:26.198353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1004e4ec-2df0-47a0-bad2-77021144d583 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:26.199052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1004e4ec-2df0-47a0-bad2-77021144d583 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:26.200280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1004e4ec-2df0-47a0-bad2-77021144d583 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:26.200960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1004e4ec-2df0-47a0-bad2-77021144d583 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:26.253424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1004e4ec-2df0-47a0-bad2-77021144d583 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074679 Jul 25 19:33:26.255182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 483/994] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:26.918142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f1afdbf7-2a0b-478d-b5d2-88cd28488bbf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:26.920529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f1afdbf7-2a0b-478d-b5d2-88cd28488bbf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:26.926764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4196c7e4-984b-4b82-bab8-92f5c1693fcf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:26.927444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4196c7e4-984b-4b82-bab8-92f5c1693fcf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:26.928868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1afdbf7-2a0b-478d-b5d2-88cd28488bbf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:26.929390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1afdbf7-2a0b-478d-b5d2-88cd28488bbf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:26.930453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1afdbf7-2a0b-478d-b5d2-88cd28488bbf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:26.931148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1afdbf7-2a0b-478d-b5d2-88cd28488bbf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:26.938714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4196c7e4-984b-4b82-bab8-92f5c1693fcf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:26.939416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4196c7e4-984b-4b82-bab8-92f5c1693fcf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:26.940375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4196c7e4-984b-4b82-bab8-92f5c1693fcf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:26.940815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4196c7e4-984b-4b82-bab8-92f5c1693fcf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:26.969142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f1afdbf7-2a0b-478d-b5d2-88cd28488bbf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055289 Jul 25 19:33:26.969753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 512/995] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:27.135910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4196c7e4-984b-4b82-bab8-92f5c1693fcf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:27.148319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4196c7e4-984b-4b82-bab8-92f5c1693fcf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.225116 Jul 25 19:33:27.149269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 484/996] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:26 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:27.272148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9cd55467-bb08-4339-aa78-526d5bb8193c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:27.276163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9cd55467-bb08-4339-aa78-526d5bb8193c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:27.288395 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cd55467-bb08-4339-aa78-526d5bb8193c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:27.289173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cd55467-bb08-4339-aa78-526d5bb8193c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:27.290634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cd55467-bb08-4339-aa78-526d5bb8193c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:27.291424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cd55467-bb08-4339-aa78-526d5bb8193c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:27.353146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9cd55467-bb08-4339-aa78-526d5bb8193c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088988 Jul 25 19:33:27.354227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 513/997] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:27.986202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-af2e654f-617b-49e9-bc6c-f05fa90811f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:27.990014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-af2e654f-617b-49e9-bc6c-f05fa90811f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:27.999758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af2e654f-617b-49e9-bc6c-f05fa90811f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:28.000353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af2e654f-617b-49e9-bc6c-f05fa90811f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:28.001269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af2e654f-617b-49e9-bc6c-f05fa90811f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:28.001811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af2e654f-617b-49e9-bc6c-f05fa90811f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:28.043014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-af2e654f-617b-49e9-bc6c-f05fa90811f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062253 Jul 25 19:33:28.043925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 485/998] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:28.176406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae1076c7-096e-48cf-9fcb-12a478a6fcd8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:28.177390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae1076c7-096e-48cf-9fcb-12a478a6fcd8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:28.185022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae1076c7-096e-48cf-9fcb-12a478a6fcd8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:28.185610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae1076c7-096e-48cf-9fcb-12a478a6fcd8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:28.186507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae1076c7-096e-48cf-9fcb-12a478a6fcd8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:28.187213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae1076c7-096e-48cf-9fcb-12a478a6fcd8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:28.374674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0a44ff67-46bc-4cae-81dc-13b74a89c750 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:28.378589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0a44ff67-46bc-4cae-81dc-13b74a89c750 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:28.396084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a44ff67-46bc-4cae-81dc-13b74a89c750 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:28.396901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a44ff67-46bc-4cae-81dc-13b74a89c750 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:28.398351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a44ff67-46bc-4cae-81dc-13b74a89c750 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:28.399166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a44ff67-46bc-4cae-81dc-13b74a89c750 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:28.410750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae1076c7-096e-48cf-9fcb-12a478a6fcd8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:28.413460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:28.421126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae1076c7-096e-48cf-9fcb-12a478a6fcd8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.249695 Jul 25 19:33:28.421716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 514/999] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:28 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:28.460100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0a44ff67-46bc-4cae-81dc-13b74a89c750 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092535 Jul 25 19:33:28.461079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 486/1000] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:29.057718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f47d1502-9c41-4d69-ae8b-a04ad93b8707 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:29.060031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f47d1502-9c41-4d69-ae8b-a04ad93b8707 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:29.067940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f47d1502-9c41-4d69-ae8b-a04ad93b8707 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:29.068541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f47d1502-9c41-4d69-ae8b-a04ad93b8707 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:29.069545 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f47d1502-9c41-4d69-ae8b-a04ad93b8707 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:29.070084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f47d1502-9c41-4d69-ae8b-a04ad93b8707 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:29.116506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f47d1502-9c41-4d69-ae8b-a04ad93b8707 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063285 Jul 25 19:33:29.117096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 515/1001] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:29 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:29.446297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-94c12c23-1ffc-47a3-b171-ce09a9962fea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:29.447137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-94c12c23-1ffc-47a3-b171-ce09a9962fea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:29.454231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94c12c23-1ffc-47a3-b171-ce09a9962fea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:29.454685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94c12c23-1ffc-47a3-b171-ce09a9962fea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:29.455569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94c12c23-1ffc-47a3-b171-ce09a9962fea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:29.455987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94c12c23-1ffc-47a3-b171-ce09a9962fea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:29.459984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:29.481830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ef0f028-5e7a-4973-9912-4e3b744e686d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:29.485462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ef0f028-5e7a-4973-9912-4e3b744e686d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:29.497564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ef0f028-5e7a-4973-9912-4e3b744e686d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:29.498308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ef0f028-5e7a-4973-9912-4e3b744e686d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:29.499949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ef0f028-5e7a-4973-9912-4e3b744e686d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:29.500633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ef0f028-5e7a-4973-9912-4e3b744e686d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:29.553856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4ef0f028-5e7a-4973-9912-4e3b744e686d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078817 Jul 25 19:33:29.555004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 516/1002] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:29 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:29.652103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-94c12c23-1ffc-47a3-b171-ce09a9962fea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:29.667367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-94c12c23-1ffc-47a3-b171-ce09a9962fea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.225919 Jul 25 19:33:29.668475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 487/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:29 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:30.130646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d63e38d4-294e-48a1-9074-0edaba264e16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:30.133210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d63e38d4-294e-48a1-9074-0edaba264e16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:30.139910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d63e38d4-294e-48a1-9074-0edaba264e16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:30.140352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d63e38d4-294e-48a1-9074-0edaba264e16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:30.141139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d63e38d4-294e-48a1-9074-0edaba264e16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:30.141571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d63e38d4-294e-48a1-9074-0edaba264e16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:30.179992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d63e38d4-294e-48a1-9074-0edaba264e16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053810 Jul 25 19:33:30.180921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 517/1004] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:30.571840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-89d9e2a7-189d-4d96-8264-ac621194ecf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:30.575294 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-89d9e2a7-189d-4d96-8264-ac621194ecf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:30.584267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89d9e2a7-189d-4d96-8264-ac621194ecf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:30.584772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89d9e2a7-189d-4d96-8264-ac621194ecf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:30.585629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89d9e2a7-189d-4d96-8264-ac621194ecf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:30.586142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89d9e2a7-189d-4d96-8264-ac621194ecf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:30.629654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-89d9e2a7-189d-4d96-8264-ac621194ecf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062523 Jul 25 19:33:30.631578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 488/1005] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:30.703870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d472a8c-8eac-48d0-ac71-402ccfa9dce4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:30.704698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d472a8c-8eac-48d0-ac71-402ccfa9dce4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:30.712966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d472a8c-8eac-48d0-ac71-402ccfa9dce4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:30.713425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d472a8c-8eac-48d0-ac71-402ccfa9dce4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:30.714256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d472a8c-8eac-48d0-ac71-402ccfa9dce4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:30.714696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d472a8c-8eac-48d0-ac71-402ccfa9dce4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:30.892480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d472a8c-8eac-48d0-ac71-402ccfa9dce4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:30.907106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d472a8c-8eac-48d0-ac71-402ccfa9dce4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.207260 Jul 25 19:33:30.908185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 518/1006] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:30 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:31.199369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c0498d37-04ce-4ab2-8c90-80f8b55c07c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:31.203552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c0498d37-04ce-4ab2-8c90-80f8b55c07c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:31.217462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0498d37-04ce-4ab2-8c90-80f8b55c07c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:31.218280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0498d37-04ce-4ab2-8c90-80f8b55c07c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:31.219863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0498d37-04ce-4ab2-8c90-80f8b55c07c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:31.220720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0498d37-04ce-4ab2-8c90-80f8b55c07c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:31.285853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c0498d37-04ce-4ab2-8c90-80f8b55c07c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095534 Jul 25 19:33:31.287072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 489/1007] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:31.645205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-420a2653-1fff-4191-975a-f2cb72fb6700 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:31.648688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-420a2653-1fff-4191-975a-f2cb72fb6700 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:31.656274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-420a2653-1fff-4191-975a-f2cb72fb6700 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:31.656866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-420a2653-1fff-4191-975a-f2cb72fb6700 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:31.657791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-420a2653-1fff-4191-975a-f2cb72fb6700 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:31.658337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-420a2653-1fff-4191-975a-f2cb72fb6700 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:31.699199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-420a2653-1fff-4191-975a-f2cb72fb6700 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059021 Jul 25 19:33:31.699875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 519/1008] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:32.030607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-91139fdc-2b26-44ae-83a4-ed779bfabc9e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:32.031542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-91139fdc-2b26-44ae-83a4-ed779bfabc9e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:32.038891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91139fdc-2b26-44ae-83a4-ed779bfabc9e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:32.039493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91139fdc-2b26-44ae-83a4-ed779bfabc9e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:32.040447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91139fdc-2b26-44ae-83a4-ed779bfabc9e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:32.040992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91139fdc-2b26-44ae-83a4-ed779bfabc9e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:32.260615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-91139fdc-2b26-44ae-83a4-ed779bfabc9e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:32.275492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-91139fdc-2b26-44ae-83a4-ed779bfabc9e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.337614 Jul 25 19:33:32.275492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 490/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:31 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:32.300737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d5662df-5f44-4729-99a9-a8a7d5170e74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:32.303885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d5662df-5f44-4729-99a9-a8a7d5170e74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:32.312573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d5662df-5f44-4729-99a9-a8a7d5170e74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:32.313076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d5662df-5f44-4729-99a9-a8a7d5170e74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:32.314423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d5662df-5f44-4729-99a9-a8a7d5170e74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:32.314955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d5662df-5f44-4729-99a9-a8a7d5170e74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:32.354608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d5662df-5f44-4729-99a9-a8a7d5170e74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058158 Jul 25 19:33:32.355279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 520/1010] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:32 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:32.716273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0b6a6baf-fcf4-451c-ae80-816f93831866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:32.719448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0b6a6baf-fcf4-451c-ae80-816f93831866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:32.727908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b6a6baf-fcf4-451c-ae80-816f93831866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:32.728597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b6a6baf-fcf4-451c-ae80-816f93831866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:32.729469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b6a6baf-fcf4-451c-ae80-816f93831866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:32.729997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b6a6baf-fcf4-451c-ae80-816f93831866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:32.771707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0b6a6baf-fcf4-451c-ae80-816f93831866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062455 Jul 25 19:33:32.772960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 491/1011] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:33.298648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a250e0fc-6721-4cda-ab3a-f476266d7a8f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:33.299296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a250e0fc-6721-4cda-ab3a-f476266d7a8f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:33.308009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a250e0fc-6721-4cda-ab3a-f476266d7a8f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:33.309084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a250e0fc-6721-4cda-ab3a-f476266d7a8f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:33.309432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a250e0fc-6721-4cda-ab3a-f476266d7a8f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:33.309943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a250e0fc-6721-4cda-ab3a-f476266d7a8f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:33.370408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-53dc250a-9348-48e4-8b45-50f232ea1d2a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:33.373255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-53dc250a-9348-48e4-8b45-50f232ea1d2a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:33.382973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53dc250a-9348-48e4-8b45-50f232ea1d2a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:33.383485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53dc250a-9348-48e4-8b45-50f232ea1d2a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:33.384446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53dc250a-9348-48e4-8b45-50f232ea1d2a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:33.384940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53dc250a-9348-48e4-8b45-50f232ea1d2a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:33.437991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-53dc250a-9348-48e4-8b45-50f232ea1d2a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072052 Jul 25 19:33:33.438916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 492/1012] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:33.509261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a250e0fc-6721-4cda-ab3a-f476266d7a8f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:33.517385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a250e0fc-6721-4cda-ab3a-f476266d7a8f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.223235 Jul 25 19:33:33.517995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 521/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:33 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:33.789192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d225b751-731f-453d-a89a-6587918d3261 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:33.791793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d225b751-731f-453d-a89a-6587918d3261 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:33.798930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d225b751-731f-453d-a89a-6587918d3261 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:33.799545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d225b751-731f-453d-a89a-6587918d3261 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:33.800586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d225b751-731f-453d-a89a-6587918d3261 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:33.801270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d225b751-731f-453d-a89a-6587918d3261 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:33.839727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d225b751-731f-453d-a89a-6587918d3261 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055351 Jul 25 19:33:33.840417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 493/1014] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:34.456768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ca4ce72b-3a62-4037-aa6f-1f4cb5e53a59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:34.460145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ca4ce72b-3a62-4037-aa6f-1f4cb5e53a59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:34.467960 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca4ce72b-3a62-4037-aa6f-1f4cb5e53a59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:34.468415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca4ce72b-3a62-4037-aa6f-1f4cb5e53a59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:34.469220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca4ce72b-3a62-4037-aa6f-1f4cb5e53a59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:34.469664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca4ce72b-3a62-4037-aa6f-1f4cb5e53a59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:34.508527 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ca4ce72b-3a62-4037-aa6f-1f4cb5e53a59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057862 Jul 25 19:33:34.509138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 522/1015] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:34.546251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2c9c8b84-dd20-4dce-bd15-359c748bf828 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:34.547274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2c9c8b84-dd20-4dce-bd15-359c748bf828 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:34.550157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=80 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:34.556748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2c9c8b84-dd20-4dce-bd15-359c748bf828 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:34.557366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2c9c8b84-dd20-4dce-bd15-359c748bf828 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:34.558356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2c9c8b84-dd20-4dce-bd15-359c748bf828 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:34.558903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2c9c8b84-dd20-4dce-bd15-359c748bf828 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:34.725078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2c9c8b84-dd20-4dce-bd15-359c748bf828 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:34.733687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2c9c8b84-dd20-4dce-bd15-359c748bf828 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.192062 Jul 25 19:33:34.734287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 494/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:34 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:34.853633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ce1534d-6ae8-466d-a2d6-00f96f76d737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:34.855934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ce1534d-6ae8-466d-a2d6-00f96f76d737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:34.862707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce1534d-6ae8-466d-a2d6-00f96f76d737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:34.863153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce1534d-6ae8-466d-a2d6-00f96f76d737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:34.865056 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce1534d-6ae8-466d-a2d6-00f96f76d737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:34.865439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce1534d-6ae8-466d-a2d6-00f96f76d737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:34.902503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ce1534d-6ae8-466d-a2d6-00f96f76d737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052941 Jul 25 19:33:34.903312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 523/1017] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:35.522092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f76a1f5e-8a83-4fdd-a106-3eb871aeb301 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:35.524376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f76a1f5e-8a83-4fdd-a106-3eb871aeb301 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:35.531179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f76a1f5e-8a83-4fdd-a106-3eb871aeb301 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:35.531758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f76a1f5e-8a83-4fdd-a106-3eb871aeb301 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:35.532713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f76a1f5e-8a83-4fdd-a106-3eb871aeb301 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:35.533250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f76a1f5e-8a83-4fdd-a106-3eb871aeb301 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:35.578708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f76a1f5e-8a83-4fdd-a106-3eb871aeb301 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061154 Jul 25 19:33:35.579389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 495/1018] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:35.762108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-07508d70-dfdd-459d-9f61-90ebc5eddc3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:35.763197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-07508d70-dfdd-459d-9f61-90ebc5eddc3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:35.775244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07508d70-dfdd-459d-9f61-90ebc5eddc3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:35.776074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07508d70-dfdd-459d-9f61-90ebc5eddc3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:35.777484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07508d70-dfdd-459d-9f61-90ebc5eddc3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:35.778267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07508d70-dfdd-459d-9f61-90ebc5eddc3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:35.921862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-08f426f6-452d-4360-adb7-188933e0b297 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:35.924160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-08f426f6-452d-4360-adb7-188933e0b297 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:35.934344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08f426f6-452d-4360-adb7-188933e0b297 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:35.935155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08f426f6-452d-4360-adb7-188933e0b297 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:35.936805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08f426f6-452d-4360-adb7-188933e0b297 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:35.937648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08f426f6-452d-4360-adb7-188933e0b297 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:35.985024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-08f426f6-452d-4360-adb7-188933e0b297 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069568 Jul 25 19:33:35.986034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 496/1019] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:35 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:36.011346 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07508d70-dfdd-459d-9f61-90ebc5eddc3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:36.021702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-07508d70-dfdd-459d-9f61-90ebc5eddc3f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.265590 Jul 25 19:33:36.022345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 524/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:35 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:36.597286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-406335f1-a102-4ed0-9378-4951caf6abe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:36.600418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-406335f1-a102-4ed0-9378-4951caf6abe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:36.614979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-406335f1-a102-4ed0-9378-4951caf6abe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:36.615838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-406335f1-a102-4ed0-9378-4951caf6abe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:36.617249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-406335f1-a102-4ed0-9378-4951caf6abe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:36.618035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-406335f1-a102-4ed0-9378-4951caf6abe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:36.678719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-406335f1-a102-4ed0-9378-4951caf6abe0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088045 Jul 25 19:33:36.679820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 497/1021] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:37.007171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fdeb8f89-2598-4c61-a3fe-b1814cb8cbd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:37.011110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fdeb8f89-2598-4c61-a3fe-b1814cb8cbd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:37.024399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdeb8f89-2598-4c61-a3fe-b1814cb8cbd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:37.025143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdeb8f89-2598-4c61-a3fe-b1814cb8cbd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:37.026585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdeb8f89-2598-4c61-a3fe-b1814cb8cbd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:37.027400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdeb8f89-2598-4c61-a3fe-b1814cb8cbd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:37.048792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c257c82e-432c-4575-899d-de18db63fa46 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:37.050142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c257c82e-432c-4575-899d-de18db63fa46 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:37.062004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c257c82e-432c-4575-899d-de18db63fa46 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:37.062815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c257c82e-432c-4575-899d-de18db63fa46 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:37.064317 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c257c82e-432c-4575-899d-de18db63fa46 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:37.065089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c257c82e-432c-4575-899d-de18db63fa46 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:37.086966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fdeb8f89-2598-4c61-a3fe-b1814cb8cbd3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088058 Jul 25 19:33:37.088067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 525/1022] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:37.258149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c257c82e-432c-4575-899d-de18db63fa46 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:37.269140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c257c82e-432c-4575-899d-de18db63fa46 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.228197 Jul 25 19:33:37.270250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 498/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:37 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:37.695860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-59d5c3d6-d49b-4ab4-bf2d-bfbd23f0c9f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:37.698175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-59d5c3d6-d49b-4ab4-bf2d-bfbd23f0c9f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:37.704901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59d5c3d6-d49b-4ab4-bf2d-bfbd23f0c9f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:37.705351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59d5c3d6-d49b-4ab4-bf2d-bfbd23f0c9f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:37.706139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59d5c3d6-d49b-4ab4-bf2d-bfbd23f0c9f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:37.706580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59d5c3d6-d49b-4ab4-bf2d-bfbd23f0c9f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:37.741649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-59d5c3d6-d49b-4ab4-bf2d-bfbd23f0c9f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050552 Jul 25 19:33:37.742237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 526/1024] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:38.105074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ca37ab65-9793-4637-ac7b-e9954a683cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:38.108231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ca37ab65-9793-4637-ac7b-e9954a683cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:38.116454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca37ab65-9793-4637-ac7b-e9954a683cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:38.116908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca37ab65-9793-4637-ac7b-e9954a683cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:38.120516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca37ab65-9793-4637-ac7b-e9954a683cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:38.120516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca37ab65-9793-4637-ac7b-e9954a683cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:38.155408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ca37ab65-9793-4637-ac7b-e9954a683cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055088 Jul 25 19:33:38.156046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 499/1025] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:38.293795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c12c0dbd-b1ba-4a4d-baf5-f54508fd55ab tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:38.294455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c12c0dbd-b1ba-4a4d-baf5-f54508fd55ab tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:38.301617 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c12c0dbd-b1ba-4a4d-baf5-f54508fd55ab tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:38.302213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c12c0dbd-b1ba-4a4d-baf5-f54508fd55ab tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:38.303124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c12c0dbd-b1ba-4a4d-baf5-f54508fd55ab tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:38.303724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c12c0dbd-b1ba-4a4d-baf5-f54508fd55ab tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:38.477820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c12c0dbd-b1ba-4a4d-baf5-f54508fd55ab tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:38.487069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c12c0dbd-b1ba-4a4d-baf5-f54508fd55ab tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.197999 Jul 25 19:33:38.487807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 527/1026] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:38 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:38.758492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1cc77910-cbc0-47df-aaa6-d0da9b929b71 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:38.761335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1cc77910-cbc0-47df-aaa6-d0da9b929b71 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:38.768392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cc77910-cbc0-47df-aaa6-d0da9b929b71 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:38.768844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cc77910-cbc0-47df-aaa6-d0da9b929b71 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:38.769840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cc77910-cbc0-47df-aaa6-d0da9b929b71 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:38.770745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cc77910-cbc0-47df-aaa6-d0da9b929b71 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:38.809395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1cc77910-cbc0-47df-aaa6-d0da9b929b71 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055954 Jul 25 19:33:38.810014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 500/1027] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:38 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:39.172958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a70181ec-25b6-4031-94a3-b348e7c66ded tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:39.177492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a70181ec-25b6-4031-94a3-b348e7c66ded tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:39.188813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a70181ec-25b6-4031-94a3-b348e7c66ded tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:39.189577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a70181ec-25b6-4031-94a3-b348e7c66ded tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:39.190970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a70181ec-25b6-4031-94a3-b348e7c66ded tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:39.191802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a70181ec-25b6-4031-94a3-b348e7c66ded tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:39.251446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a70181ec-25b6-4031-94a3-b348e7c66ded tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085645 Jul 25 19:33:39.252574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 528/1028] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:39.516238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4b546bf1-840c-4230-8fec-092ceedecb6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:39.517293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4b546bf1-840c-4230-8fec-092ceedecb6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:39.530822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b546bf1-840c-4230-8fec-092ceedecb6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:39.531777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b546bf1-840c-4230-8fec-092ceedecb6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:39.533133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b546bf1-840c-4230-8fec-092ceedecb6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:39.533885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b546bf1-840c-4230-8fec-092ceedecb6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:39.778061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4b546bf1-840c-4230-8fec-092ceedecb6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:39.790720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4b546bf1-840c-4230-8fec-092ceedecb6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.282191 Jul 25 19:33:39.791417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 501/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:39 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:39.825243 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-73f86187-eb45-4063-bd84-0d11792ae7fe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:39.828543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-73f86187-eb45-4063-bd84-0d11792ae7fe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:39.839603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73f86187-eb45-4063-bd84-0d11792ae7fe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:39.840349 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73f86187-eb45-4063-bd84-0d11792ae7fe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:39.841676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73f86187-eb45-4063-bd84-0d11792ae7fe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:39.842356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73f86187-eb45-4063-bd84-0d11792ae7fe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:39.890469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-73f86187-eb45-4063-bd84-0d11792ae7fe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071158 Jul 25 19:33:39.891346 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 529/1030] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:40.270914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0c2088cf-383e-4f51-b462-6cb2753dde61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:40.274874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0c2088cf-383e-4f51-b462-6cb2753dde61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:40.286027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0c2088cf-383e-4f51-b462-6cb2753dde61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:40.286750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0c2088cf-383e-4f51-b462-6cb2753dde61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:40.288141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0c2088cf-383e-4f51-b462-6cb2753dde61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:40.288852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0c2088cf-383e-4f51-b462-6cb2753dde61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:40.333183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0c2088cf-383e-4f51-b462-6cb2753dde61 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069468 Jul 25 19:33:40.333779 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 502/1031] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:40.813169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-93df8ca0-9b5f-45d1-9dff-88316e11d641 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:40.813886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93df8ca0-9b5f-45d1-9dff-88316e11d641 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:40.821489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93df8ca0-9b5f-45d1-9dff-88316e11d641 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:40.821937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93df8ca0-9b5f-45d1-9dff-88316e11d641 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:40.822735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93df8ca0-9b5f-45d1-9dff-88316e11d641 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:40.823177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93df8ca0-9b5f-45d1-9dff-88316e11d641 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:40.912037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-24d46734-bc5b-4091-8de4-67ac4cc248cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:40.915805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-24d46734-bc5b-4091-8de4-67ac4cc248cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:40.930025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24d46734-bc5b-4091-8de4-67ac4cc248cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:40.930829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24d46734-bc5b-4091-8de4-67ac4cc248cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:40.932213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24d46734-bc5b-4091-8de4-67ac4cc248cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:40.933002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24d46734-bc5b-4091-8de4-67ac4cc248cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:40.966712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:40.975751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-24d46734-bc5b-4091-8de4-67ac4cc248cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071892 Jul 25 19:33:40.976642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 503/1032] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:41.056737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93df8ca0-9b5f-45d1-9dff-88316e11d641 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:41.067902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-93df8ca0-9b5f-45d1-9dff-88316e11d641 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.258600 Jul 25 19:33:41.068694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 530/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:40 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:41.347345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a39f1c16-8f01-45b8-b7f3-3efeb5766ffe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:41.350624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a39f1c16-8f01-45b8-b7f3-3efeb5766ffe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:41.359441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a39f1c16-8f01-45b8-b7f3-3efeb5766ffe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:41.359922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a39f1c16-8f01-45b8-b7f3-3efeb5766ffe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:41.360765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a39f1c16-8f01-45b8-b7f3-3efeb5766ffe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:41.361207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a39f1c16-8f01-45b8-b7f3-3efeb5766ffe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:41.396209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a39f1c16-8f01-45b8-b7f3-3efeb5766ffe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053318 Jul 25 19:33:41.396805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 504/1034] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:41.990088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b9046249-b55d-4ec5-bb48-04a260fdd848 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:41.992615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b9046249-b55d-4ec5-bb48-04a260fdd848 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:42.000200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9046249-b55d-4ec5-bb48-04a260fdd848 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:42.000653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9046249-b55d-4ec5-bb48-04a260fdd848 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:42.001450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9046249-b55d-4ec5-bb48-04a260fdd848 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:42.001891 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9046249-b55d-4ec5-bb48-04a260fdd848 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:42.020545 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:42.040382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b9046249-b55d-4ec5-bb48-04a260fdd848 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055137 Jul 25 19:33:42.041003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 531/1035] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:42.090182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-678ba968-7c03-4864-a4a6-7603849d1de1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:42.091076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-678ba968-7c03-4864-a4a6-7603849d1de1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:42.100049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-678ba968-7c03-4864-a4a6-7603849d1de1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:42.100684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-678ba968-7c03-4864-a4a6-7603849d1de1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:42.101613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-678ba968-7c03-4864-a4a6-7603849d1de1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:42.102186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-678ba968-7c03-4864-a4a6-7603849d1de1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:42.315490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-678ba968-7c03-4864-a4a6-7603849d1de1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:42.325301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-678ba968-7c03-4864-a4a6-7603849d1de1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.239136 Jul 25 19:33:42.326054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 505/1036] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:42 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:42.410413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ca1939f0-2fc2-4ae9-b6cd-57b2913aa10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:42.414054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ca1939f0-2fc2-4ae9-b6cd-57b2913aa10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:42.422073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca1939f0-2fc2-4ae9-b6cd-57b2913aa10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:42.422579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca1939f0-2fc2-4ae9-b6cd-57b2913aa10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:42.423504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca1939f0-2fc2-4ae9-b6cd-57b2913aa10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:42.424244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca1939f0-2fc2-4ae9-b6cd-57b2913aa10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:42.461441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ca1939f0-2fc2-4ae9-b6cd-57b2913aa10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055740 Jul 25 19:33:42.461955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 532/1037] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:42 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:43.060932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-84ceb747-52e6-4184-9e5b-fd087904d966 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:43.065912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-84ceb747-52e6-4184-9e5b-fd087904d966 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:43.078835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84ceb747-52e6-4184-9e5b-fd087904d966 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:43.079679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84ceb747-52e6-4184-9e5b-fd087904d966 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:43.081212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84ceb747-52e6-4184-9e5b-fd087904d966 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:43.082711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84ceb747-52e6-4184-9e5b-fd087904d966 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:43.143796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-84ceb747-52e6-4184-9e5b-fd087904d966 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092831 Jul 25 19:33:43.145405 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 506/1038] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:43.358831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d1805877-bae2-4e24-be79-9c1776d64f7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:43.359870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d1805877-bae2-4e24-be79-9c1776d64f7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:43.372106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1805877-bae2-4e24-be79-9c1776d64f7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:43.372889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1805877-bae2-4e24-be79-9c1776d64f7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:43.374279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1805877-bae2-4e24-be79-9c1776d64f7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:43.375040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1805877-bae2-4e24-be79-9c1776d64f7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:43.480655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-90ad304a-6305-4573-baae-d2d8f6ddd288 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:43.484502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-90ad304a-6305-4573-baae-d2d8f6ddd288 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:43.495330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-90ad304a-6305-4573-baae-d2d8f6ddd288 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:43.496067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-90ad304a-6305-4573-baae-d2d8f6ddd288 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:43.497277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-90ad304a-6305-4573-baae-d2d8f6ddd288 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:43.497783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-90ad304a-6305-4573-baae-d2d8f6ddd288 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:43.556323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-90ad304a-6305-4573-baae-d2d8f6ddd288 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083849 Jul 25 19:33:43.567788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 507/1039] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:43.571356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d1805877-bae2-4e24-be79-9c1776d64f7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:43.587286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d1805877-bae2-4e24-be79-9c1776d64f7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.235622 Jul 25 19:33:43.600105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 533/1040] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:43 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:44.164159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9559dbcd-ba4b-45c5-b741-b600c80b2cd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:44.167830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9559dbcd-ba4b-45c5-b741-b600c80b2cd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:44.178994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9559dbcd-ba4b-45c5-b741-b600c80b2cd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:44.179488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9559dbcd-ba4b-45c5-b741-b600c80b2cd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:44.180403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9559dbcd-ba4b-45c5-b741-b600c80b2cd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:44.180894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9559dbcd-ba4b-45c5-b741-b600c80b2cd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:44.215812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9559dbcd-ba4b-45c5-b741-b600c80b2cd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058726 Jul 25 19:33:44.216418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 508/1041] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:44.573326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1a96d98c-5f67-4061-b5c2-372f01ef6523 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:44.575634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1a96d98c-5f67-4061-b5c2-372f01ef6523 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:44.584156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a96d98c-5f67-4061-b5c2-372f01ef6523 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:44.584603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a96d98c-5f67-4061-b5c2-372f01ef6523 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:44.585488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a96d98c-5f67-4061-b5c2-372f01ef6523 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:44.585938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a96d98c-5f67-4061-b5c2-372f01ef6523 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:44.632253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c457db2d-dee6-40b9-8bae-9dbc7411ec89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:44.633044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c457db2d-dee6-40b9-8bae-9dbc7411ec89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:44.638903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1a96d98c-5f67-4061-b5c2-372f01ef6523 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069305 Jul 25 19:33:44.640045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 534/1042] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:44.642439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c457db2d-dee6-40b9-8bae-9dbc7411ec89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:44.643241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c457db2d-dee6-40b9-8bae-9dbc7411ec89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:44.644915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c457db2d-dee6-40b9-8bae-9dbc7411ec89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:44.645726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c457db2d-dee6-40b9-8bae-9dbc7411ec89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:44.861962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c457db2d-dee6-40b9-8bae-9dbc7411ec89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:44.874031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c457db2d-dee6-40b9-8bae-9dbc7411ec89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.248063 Jul 25 19:33:44.874703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 509/1043] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:44 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:33:45.235152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3136fd8c-e5a5-4735-9df7-46c0208a794e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:45.239171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3136fd8c-e5a5-4735-9df7-46c0208a794e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:45.248722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3136fd8c-e5a5-4735-9df7-46c0208a794e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:45.249556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3136fd8c-e5a5-4735-9df7-46c0208a794e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:45.250336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3136fd8c-e5a5-4735-9df7-46c0208a794e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:45.250857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3136fd8c-e5a5-4735-9df7-46c0208a794e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:45.296583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3136fd8c-e5a5-4735-9df7-46c0208a794e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066925 Jul 25 19:33:45.300476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 535/1044] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:45.659051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-861b39f3-531c-48ab-b9fd-77ef584afa4b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:45.662237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-861b39f3-531c-48ab-b9fd-77ef584afa4b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:45.672500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-861b39f3-531c-48ab-b9fd-77ef584afa4b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:45.672963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-861b39f3-531c-48ab-b9fd-77ef584afa4b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:45.673787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-861b39f3-531c-48ab-b9fd-77ef584afa4b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:45.674243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-861b39f3-531c-48ab-b9fd-77ef584afa4b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:45.717985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-861b39f3-531c-48ab-b9fd-77ef584afa4b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066168 Jul 25 19:33:45.718759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 510/1045] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:45.900828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-38b91c60-0aed-42c7-906d-df93c544dea0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:45.901449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-38b91c60-0aed-42c7-906d-df93c544dea0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:45.909431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38b91c60-0aed-42c7-906d-df93c544dea0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:45.910028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38b91c60-0aed-42c7-906d-df93c544dea0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:45.911993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38b91c60-0aed-42c7-906d-df93c544dea0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:45.912582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38b91c60-0aed-42c7-906d-df93c544dea0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:46.086544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-38b91c60-0aed-42c7-906d-df93c544dea0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:46.095272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-38b91c60-0aed-42c7-906d-df93c544dea0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.198352 Jul 25 19:33:46.095982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 536/1046] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:45 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:46.322769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-87976e0a-deb4-4d2d-be6c-e3841eda162f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:46.327321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-87976e0a-deb4-4d2d-be6c-e3841eda162f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:46.339780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87976e0a-deb4-4d2d-be6c-e3841eda162f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:46.340783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87976e0a-deb4-4d2d-be6c-e3841eda162f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:46.342193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87976e0a-deb4-4d2d-be6c-e3841eda162f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:46.342942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87976e0a-deb4-4d2d-be6c-e3841eda162f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:46.615986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-87976e0a-deb4-4d2d-be6c-e3841eda162f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.300281 Jul 25 19:33:46.617081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 511/1047] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:46.737852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c0ae3739-7b8f-40f8-bcd4-28ec55e3455d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:46.742581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c0ae3739-7b8f-40f8-bcd4-28ec55e3455d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:46.752862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0ae3739-7b8f-40f8-bcd4-28ec55e3455d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:46.753636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0ae3739-7b8f-40f8-bcd4-28ec55e3455d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:46.755620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0ae3739-7b8f-40f8-bcd4-28ec55e3455d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:46.756570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0ae3739-7b8f-40f8-bcd4-28ec55e3455d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:46.795682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c0ae3739-7b8f-40f8-bcd4-28ec55e3455d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064224 Jul 25 19:33:46.796291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 537/1048] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:47.123050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-06439be5-7c96-4583-9fd7-8b753183402a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:47.124160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-06439be5-7c96-4583-9fd7-8b753183402a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:47.136754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06439be5-7c96-4583-9fd7-8b753183402a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:47.137527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06439be5-7c96-4583-9fd7-8b753183402a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:47.138894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06439be5-7c96-4583-9fd7-8b753183402a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:47.139692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06439be5-7c96-4583-9fd7-8b753183402a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:47.346707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-06439be5-7c96-4583-9fd7-8b753183402a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:47.355703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-06439be5-7c96-4583-9fd7-8b753183402a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.239827 Jul 25 19:33:47.356493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 512/1049] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:47 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:47.638629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1ce8797e-80b1-4ac5-8802-1814eb23757d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:47.642450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1ce8797e-80b1-4ac5-8802-1814eb23757d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:47.656079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ce8797e-80b1-4ac5-8802-1814eb23757d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:47.656840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ce8797e-80b1-4ac5-8802-1814eb23757d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:47.658834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ce8797e-80b1-4ac5-8802-1814eb23757d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:47.659696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ce8797e-80b1-4ac5-8802-1814eb23757d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:47.724493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1ce8797e-80b1-4ac5-8802-1814eb23757d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093185 Jul 25 19:33:47.725803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 538/1050] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:47.813510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cb55f151-933f-4a78-9a1b-6c1318e264be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:47.817477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cb55f151-933f-4a78-9a1b-6c1318e264be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:47.828682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb55f151-933f-4a78-9a1b-6c1318e264be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:47.829538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb55f151-933f-4a78-9a1b-6c1318e264be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:47.831136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb55f151-933f-4a78-9a1b-6c1318e264be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:47.832326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb55f151-933f-4a78-9a1b-6c1318e264be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:47.893718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cb55f151-933f-4a78-9a1b-6c1318e264be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087361 Jul 25 19:33:47.895771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 513/1051] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:48.382050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-07806a49-a37a-4738-8742-f6cfbf0e07b8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:48.383169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-07806a49-a37a-4738-8742-f6cfbf0e07b8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:48.392540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07806a49-a37a-4738-8742-f6cfbf0e07b8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:48.392990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07806a49-a37a-4738-8742-f6cfbf0e07b8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:48.393844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07806a49-a37a-4738-8742-f6cfbf0e07b8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:48.394223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07806a49-a37a-4738-8742-f6cfbf0e07b8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:48.629087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07806a49-a37a-4738-8742-f6cfbf0e07b8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:48.640433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-07806a49-a37a-4738-8742-f6cfbf0e07b8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.265276 Jul 25 19:33:48.641454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 539/1052] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:48 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:48.744390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-57b3ee37-b72b-4d45-b312-a0c98aea7ef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:48.748151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-57b3ee37-b72b-4d45-b312-a0c98aea7ef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:48.757087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57b3ee37-b72b-4d45-b312-a0c98aea7ef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:48.757542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57b3ee37-b72b-4d45-b312-a0c98aea7ef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:48.758349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57b3ee37-b72b-4d45-b312-a0c98aea7ef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:48.758791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57b3ee37-b72b-4d45-b312-a0c98aea7ef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:48.802881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-57b3ee37-b72b-4d45-b312-a0c98aea7ef6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064433 Jul 25 19:33:48.803598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 514/1053] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:48 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:48.911875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ce5d6f2-0d35-4eed-8e7b-e5cd1c4d415c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:48.914181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ce5d6f2-0d35-4eed-8e7b-e5cd1c4d415c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:48.921582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ce5d6f2-0d35-4eed-8e7b-e5cd1c4d415c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:48.922038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ce5d6f2-0d35-4eed-8e7b-e5cd1c4d415c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:48.922837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ce5d6f2-0d35-4eed-8e7b-e5cd1c4d415c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:48.923277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ce5d6f2-0d35-4eed-8e7b-e5cd1c4d415c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:48.961234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4ce5d6f2-0d35-4eed-8e7b-e5cd1c4d415c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054094 Jul 25 19:33:48.961902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 540/1054] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:49.677213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1d5e5188-3773-427a-a2a1-821be5624d5e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:49.678193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1d5e5188-3773-427a-a2a1-821be5624d5e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:49.688866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d5e5188-3773-427a-a2a1-821be5624d5e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:49.689571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d5e5188-3773-427a-a2a1-821be5624d5e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:49.690844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d5e5188-3773-427a-a2a1-821be5624d5e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:49.692455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d5e5188-3773-427a-a2a1-821be5624d5e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:49.824478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb37e987-39bd-4fcb-9da7-7f4b4e5d094b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:49.828359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb37e987-39bd-4fcb-9da7-7f4b4e5d094b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:49.831673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:49.840926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb37e987-39bd-4fcb-9da7-7f4b4e5d094b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:49.841720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb37e987-39bd-4fcb-9da7-7f4b4e5d094b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:49.843042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb37e987-39bd-4fcb-9da7-7f4b4e5d094b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:49.843719 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb37e987-39bd-4fcb-9da7-7f4b4e5d094b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:49.889598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1d5e5188-3773-427a-a2a1-821be5624d5e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:49.899597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1d5e5188-3773-427a-a2a1-821be5624d5e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.229106 Jul 25 19:33:49.900274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 515/1055] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:49 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:49.902724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb37e987-39bd-4fcb-9da7-7f4b4e5d094b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086267 Jul 25 19:33:49.904080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 541/1056] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:49.981168 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bedfdacb-be17-49cb-b084-23a4ed6474c4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:49.984757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bedfdacb-be17-49cb-b084-23a4ed6474c4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:49.998697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bedfdacb-be17-49cb-b084-23a4ed6474c4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:49.999395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bedfdacb-be17-49cb-b084-23a4ed6474c4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:50.000795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bedfdacb-be17-49cb-b084-23a4ed6474c4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:50.001478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bedfdacb-be17-49cb-b084-23a4ed6474c4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:50.046420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bedfdacb-be17-49cb-b084-23a4ed6474c4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073568 Jul 25 19:33:50.047196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 516/1057] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:50.923741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-84ca5633-8432-4171-8417-318c630c56e4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:50.928398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-84ca5633-8432-4171-8417-318c630c56e4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:50.933592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5de1d2ec-e224-435f-b306-eeb3769d74d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:50.934680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5de1d2ec-e224-435f-b306-eeb3769d74d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:50.939259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84ca5633-8432-4171-8417-318c630c56e4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:50.939834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84ca5633-8432-4171-8417-318c630c56e4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:50.940658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84ca5633-8432-4171-8417-318c630c56e4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:50.941097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84ca5633-8432-4171-8417-318c630c56e4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:50.944512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5de1d2ec-e224-435f-b306-eeb3769d74d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:50.945187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5de1d2ec-e224-435f-b306-eeb3769d74d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:50.946226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5de1d2ec-e224-435f-b306-eeb3769d74d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:50.946781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5de1d2ec-e224-435f-b306-eeb3769d74d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:50.986523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-84ca5633-8432-4171-8417-318c630c56e4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070223 Jul 25 19:33:50.987493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 542/1058] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:51.065469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e5616f72-24b7-410e-9d66-ade233bf81b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:51.069413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e5616f72-24b7-410e-9d66-ade233bf81b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:51.081390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5616f72-24b7-410e-9d66-ade233bf81b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:51.082705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5616f72-24b7-410e-9d66-ade233bf81b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:51.084926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5616f72-24b7-410e-9d66-ade233bf81b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:51.085745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5616f72-24b7-410e-9d66-ade233bf81b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:51.133880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5de1d2ec-e224-435f-b306-eeb3769d74d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:51.136777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e5616f72-24b7-410e-9d66-ade233bf81b4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079594 Jul 25 19:33:51.137451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 543/1059] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:51.147600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5de1d2ec-e224-435f-b306-eeb3769d74d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.218372 Jul 25 19:33:51.148503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 517/1060] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:50 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:52.004258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfcc3290-e503-4c53-b718-83b5d6865750 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:52.008271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfcc3290-e503-4c53-b718-83b5d6865750 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:52.017365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfcc3290-e503-4c53-b718-83b5d6865750 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:52.017862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfcc3290-e503-4c53-b718-83b5d6865750 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:52.018830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfcc3290-e503-4c53-b718-83b5d6865750 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:52.019344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfcc3290-e503-4c53-b718-83b5d6865750 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:52.063869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfcc3290-e503-4c53-b718-83b5d6865750 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064420 Jul 25 19:33:52.064815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 544/1061] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:52.154666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-166b8737-4499-451c-9d92-022d5e1e6db2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:52.158160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-166b8737-4499-451c-9d92-022d5e1e6db2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:52.170524 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-166b8737-4499-451c-9d92-022d5e1e6db2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:52.171435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-166b8737-4499-451c-9d92-022d5e1e6db2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:52.173083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-166b8737-4499-451c-9d92-022d5e1e6db2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:52.173755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-166b8737-4499-451c-9d92-022d5e1e6db2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:52.175387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f05edb6-04b1-494e-ac6d-29d7433e05c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:52.178187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2f05edb6-04b1-494e-ac6d-29d7433e05c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:52.191005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f05edb6-04b1-494e-ac6d-29d7433e05c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:52.192435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f05edb6-04b1-494e-ac6d-29d7433e05c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:52.194620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f05edb6-04b1-494e-ac6d-29d7433e05c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:52.195407 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f05edb6-04b1-494e-ac6d-29d7433e05c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:52.242304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-166b8737-4499-451c-9d92-022d5e1e6db2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095631 Jul 25 19:33:52.244883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 518/1062] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:52 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:52.417092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2f05edb6-04b1-494e-ac6d-29d7433e05c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:52.427774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2f05edb6-04b1-494e-ac6d-29d7433e05c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.257588 Jul 25 19:33:52.428791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 545/1063] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:52 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:53.080510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0f854d57-73d4-4985-9e62-ea96286d20a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:53.083333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0f854d57-73d4-4985-9e62-ea96286d20a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:53.091180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f854d57-73d4-4985-9e62-ea96286d20a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:53.091728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f854d57-73d4-4985-9e62-ea96286d20a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:53.092591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f854d57-73d4-4985-9e62-ea96286d20a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:53.093128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f854d57-73d4-4985-9e62-ea96286d20a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:53.131053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0f854d57-73d4-4985-9e62-ea96286d20a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054943 Jul 25 19:33:53.131684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 519/1064] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:53.259803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2e4325b0-2253-4dc9-a172-319bbe8afe09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:53.263211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2e4325b0-2253-4dc9-a172-319bbe8afe09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:53.272290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4325b0-2253-4dc9-a172-319bbe8afe09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:53.272916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4325b0-2253-4dc9-a172-319bbe8afe09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:53.273825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4325b0-2253-4dc9-a172-319bbe8afe09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:53.274437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4325b0-2253-4dc9-a172-319bbe8afe09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:53.311566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2e4325b0-2253-4dc9-a172-319bbe8afe09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056151 Jul 25 19:33:53.312495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 546/1065] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:53.464919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-14838ff7-f579-48b3-bde8-f27ac1035e6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:53.465531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-14838ff7-f579-48b3-bde8-f27ac1035e6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:53.474206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14838ff7-f579-48b3-bde8-f27ac1035e6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:53.474206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14838ff7-f579-48b3-bde8-f27ac1035e6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:53.475689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14838ff7-f579-48b3-bde8-f27ac1035e6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:53.476132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14838ff7-f579-48b3-bde8-f27ac1035e6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:53.494455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:53.696360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-14838ff7-f579-48b3-bde8-f27ac1035e6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:53.711468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-14838ff7-f579-48b3-bde8-f27ac1035e6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.250396 Jul 25 19:33:53.712561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 520/1066] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:53 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:54.148068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6442c0c2-867b-4ccb-9d8e-596c4bfec1a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:54.151554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6442c0c2-867b-4ccb-9d8e-596c4bfec1a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:54.158720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6442c0c2-867b-4ccb-9d8e-596c4bfec1a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:54.159229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6442c0c2-867b-4ccb-9d8e-596c4bfec1a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:54.160235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6442c0c2-867b-4ccb-9d8e-596c4bfec1a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:54.160754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6442c0c2-867b-4ccb-9d8e-596c4bfec1a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:54.203413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6442c0c2-867b-4ccb-9d8e-596c4bfec1a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062503 Jul 25 19:33:54.204038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 547/1067] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:54.331729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a70f462b-56dc-47d2-83a7-e31f5580e474 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:54.337380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a70f462b-56dc-47d2-83a7-e31f5580e474 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:54.345868 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a70f462b-56dc-47d2-83a7-e31f5580e474 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:54.346316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a70f462b-56dc-47d2-83a7-e31f5580e474 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:54.347121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a70f462b-56dc-47d2-83a7-e31f5580e474 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:54.347935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a70f462b-56dc-47d2-83a7-e31f5580e474 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:54.386967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a70f462b-56dc-47d2-83a7-e31f5580e474 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062034 Jul 25 19:33:54.387580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 521/1068] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:54.737497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e7c585d9-6ac0-43c9-bbd9-4d5d9c641927 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:54.738193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e7c585d9-6ac0-43c9-bbd9-4d5d9c641927 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:54.745622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7c585d9-6ac0-43c9-bbd9-4d5d9c641927 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:54.746076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7c585d9-6ac0-43c9-bbd9-4d5d9c641927 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:54.746873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7c585d9-6ac0-43c9-bbd9-4d5d9c641927 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:54.747714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7c585d9-6ac0-43c9-bbd9-4d5d9c641927 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:54.756675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:54.991309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e7c585d9-6ac0-43c9-bbd9-4d5d9c641927 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:55.000023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e7c585d9-6ac0-43c9-bbd9-4d5d9c641927 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.267608 Jul 25 19:33:55.000767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 548/1069] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:54 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:55.217637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-703ce648-6909-4bdc-ad96-563a12e40986 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:55.220137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-703ce648-6909-4bdc-ad96-563a12e40986 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:55.228905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-703ce648-6909-4bdc-ad96-563a12e40986 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:55.229426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-703ce648-6909-4bdc-ad96-563a12e40986 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:55.230278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-703ce648-6909-4bdc-ad96-563a12e40986 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:55.230772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-703ce648-6909-4bdc-ad96-563a12e40986 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:55.265773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-703ce648-6909-4bdc-ad96-563a12e40986 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052302 Jul 25 19:33:55.266252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 522/1070] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:33:55.402657 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e64746bc-30d0-40b5-954f-ffffdba441b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:55.405523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e64746bc-30d0-40b5-954f-ffffdba441b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:55.414095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e64746bc-30d0-40b5-954f-ffffdba441b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:55.414546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e64746bc-30d0-40b5-954f-ffffdba441b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:55.415324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e64746bc-30d0-40b5-954f-ffffdba441b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:55.415797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e64746bc-30d0-40b5-954f-ffffdba441b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:55.459798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e64746bc-30d0-40b5-954f-ffffdba441b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060996 Jul 25 19:33:55.460871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 549/1071] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:56.029002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-02a37911-74f8-4b80-92d7-6d4ee16be16d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:56.030121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-02a37911-74f8-4b80-92d7-6d4ee16be16d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:56.040725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02a37911-74f8-4b80-92d7-6d4ee16be16d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:56.041177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02a37911-74f8-4b80-92d7-6d4ee16be16d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:56.041984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02a37911-74f8-4b80-92d7-6d4ee16be16d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:56.042423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02a37911-74f8-4b80-92d7-6d4ee16be16d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:56.260213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-02a37911-74f8-4b80-92d7-6d4ee16be16d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:56.277657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-02a37911-74f8-4b80-92d7-6d4ee16be16d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.255920 Jul 25 19:33:56.278680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 523/1072] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:56 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:56.282610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c9cf7d2-382f-46da-b8e4-d8730fa35106 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:56.285708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c9cf7d2-382f-46da-b8e4-d8730fa35106 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:56.293772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c9cf7d2-382f-46da-b8e4-d8730fa35106 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:56.294287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c9cf7d2-382f-46da-b8e4-d8730fa35106 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:56.295076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c9cf7d2-382f-46da-b8e4-d8730fa35106 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:56.295549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c9cf7d2-382f-46da-b8e4-d8730fa35106 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:56.339005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c9cf7d2-382f-46da-b8e4-d8730fa35106 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060434 Jul 25 19:33:56.339641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 550/1073] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:56 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:56.481430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-57968c99-2801-459f-b874-f1da48f588ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:56.484444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-57968c99-2801-459f-b874-f1da48f588ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:56.492419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57968c99-2801-459f-b874-f1da48f588ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:56.493020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57968c99-2801-459f-b874-f1da48f588ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:56.494030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57968c99-2801-459f-b874-f1da48f588ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:56.494578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57968c99-2801-459f-b874-f1da48f588ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:56.533267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-57968c99-2801-459f-b874-f1da48f588ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058867 Jul 25 19:33:56.534174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 524/1074] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:57.320382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c08a931a-52bd-4f6e-8c10-34260eb22457 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:57.321346 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c08a931a-52bd-4f6e-8c10-34260eb22457 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:57.333194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c08a931a-52bd-4f6e-8c10-34260eb22457 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:57.333871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c08a931a-52bd-4f6e-8c10-34260eb22457 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:57.335227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c08a931a-52bd-4f6e-8c10-34260eb22457 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:57.336002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c08a931a-52bd-4f6e-8c10-34260eb22457 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:57.357806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0680810d-6021-4d22-9255-888910304170 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:57.361594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0680810d-6021-4d22-9255-888910304170 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:57.374160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0680810d-6021-4d22-9255-888910304170 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:57.375008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0680810d-6021-4d22-9255-888910304170 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:57.376464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0680810d-6021-4d22-9255-888910304170 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:57.377148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0680810d-6021-4d22-9255-888910304170 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:57.441345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0680810d-6021-4d22-9255-888910304170 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091012 Jul 25 19:33:57.443476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 525/1075] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:57.516645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c08a931a-52bd-4f6e-8c10-34260eb22457 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:57.526331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c08a931a-52bd-4f6e-8c10-34260eb22457 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.211498 Jul 25 19:33:57.527117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 551/1076] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:57 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:57.554976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4814a4a0-2a07-4821-83dd-46a6205a26e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:57.558778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4814a4a0-2a07-4821-83dd-46a6205a26e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:57.570990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4814a4a0-2a07-4821-83dd-46a6205a26e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:57.571787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4814a4a0-2a07-4821-83dd-46a6205a26e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:57.573144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4814a4a0-2a07-4821-83dd-46a6205a26e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:57.573980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4814a4a0-2a07-4821-83dd-46a6205a26e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:57.619880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4814a4a0-2a07-4821-83dd-46a6205a26e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072893 Jul 25 19:33:57.621296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 526/1077] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:58.459984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-04cf62e9-2488-4013-a844-30dfd64b905c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:58.463472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-04cf62e9-2488-4013-a844-30dfd64b905c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:58.476880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04cf62e9-2488-4013-a844-30dfd64b905c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:58.477652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04cf62e9-2488-4013-a844-30dfd64b905c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:58.479098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04cf62e9-2488-4013-a844-30dfd64b905c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:58.479902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04cf62e9-2488-4013-a844-30dfd64b905c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:58.542389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-04cf62e9-2488-4013-a844-30dfd64b905c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090158 Jul 25 19:33:58.543343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 552/1078] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:58.556752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-68269c0e-6929-4db2-ac2a-990a79b46a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:58.557426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-68269c0e-6929-4db2-ac2a-990a79b46a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:58.569254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68269c0e-6929-4db2-ac2a-990a79b46a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:58.569254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68269c0e-6929-4db2-ac2a-990a79b46a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:58.569254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68269c0e-6929-4db2-ac2a-990a79b46a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:58.569254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68269c0e-6929-4db2-ac2a-990a79b46a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:58.637977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da73dcd0-7edb-46ff-bf7b-f669adbc9683 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:58.640941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da73dcd0-7edb-46ff-bf7b-f669adbc9683 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:58.649714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da73dcd0-7edb-46ff-bf7b-f669adbc9683 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:58.650409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da73dcd0-7edb-46ff-bf7b-f669adbc9683 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:58.651495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da73dcd0-7edb-46ff-bf7b-f669adbc9683 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:58.652086 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da73dcd0-7edb-46ff-bf7b-f669adbc9683 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:58.700206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da73dcd0-7edb-46ff-bf7b-f669adbc9683 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068396 Jul 25 19:33:58.701216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 553/1079] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:58.756657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-68269c0e-6929-4db2-ac2a-990a79b46a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:58.771397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-68269c0e-6929-4db2-ac2a-990a79b46a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.221228 Jul 25 19:33:58.772379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 527/1080] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:58 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:59.558009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2e07b1e-5ea0-4944-9f1d-b87a31de5b55 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:59.560256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c2e07b1e-5ea0-4944-9f1d-b87a31de5b55 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:59.568331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2e07b1e-5ea0-4944-9f1d-b87a31de5b55 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:59.568964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2e07b1e-5ea0-4944-9f1d-b87a31de5b55 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:59.569822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2e07b1e-5ea0-4944-9f1d-b87a31de5b55 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:59.570332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2e07b1e-5ea0-4944-9f1d-b87a31de5b55 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:59.608780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2e07b1e-5ea0-4944-9f1d-b87a31de5b55 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054597 Jul 25 19:33:59.609393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 554/1081] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:33:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:33:59.717149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-918c0bfc-f5fa-411e-bc98-131e28e986c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:59.719382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-918c0bfc-f5fa-411e-bc98-131e28e986c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:59.728166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-918c0bfc-f5fa-411e-bc98-131e28e986c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:59.728678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-918c0bfc-f5fa-411e-bc98-131e28e986c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:59.729538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-918c0bfc-f5fa-411e-bc98-131e28e986c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:59.730103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-918c0bfc-f5fa-411e-bc98-131e28e986c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:59.768707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-918c0bfc-f5fa-411e-bc98-131e28e986c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055953 Jul 25 19:33:59.769310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 528/1082] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:59.807703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-03680534-060b-4d6f-8611-ff2a16a5a7c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:59.808404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-03680534-060b-4d6f-8611-ff2a16a5a7c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:59.817720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03680534-060b-4d6f-8611-ff2a16a5a7c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:59.818437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03680534-060b-4d6f-8611-ff2a16a5a7c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:59.819655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03680534-060b-4d6f-8611-ff2a16a5a7c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:59.820323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03680534-060b-4d6f-8611-ff2a16a5a7c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:00.039015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-03680534-060b-4d6f-8611-ff2a16a5a7c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:00.048543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-03680534-060b-4d6f-8611-ff2a16a5a7c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.244705 Jul 25 19:34:00.049149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 555/1083] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:59 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:00.625724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aca2427f-b836-4b91-bae2-d90fa12d568d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:00.628349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aca2427f-b836-4b91-bae2-d90fa12d568d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:00.636399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aca2427f-b836-4b91-bae2-d90fa12d568d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:00.636901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aca2427f-b836-4b91-bae2-d90fa12d568d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:00.637797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aca2427f-b836-4b91-bae2-d90fa12d568d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:00.638283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aca2427f-b836-4b91-bae2-d90fa12d568d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:00.675283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aca2427f-b836-4b91-bae2-d90fa12d568d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053686 Jul 25 19:34:00.676486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 529/1084] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:00.790518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-862cf4fa-643e-49be-9b13-6f803532fdf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:00.794210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-862cf4fa-643e-49be-9b13-6f803532fdf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:00.805083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-862cf4fa-643e-49be-9b13-6f803532fdf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:00.805831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-862cf4fa-643e-49be-9b13-6f803532fdf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:00.806817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-862cf4fa-643e-49be-9b13-6f803532fdf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:00.807305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-862cf4fa-643e-49be-9b13-6f803532fdf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:00.851622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-862cf4fa-643e-49be-9b13-6f803532fdf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070674 Jul 25 19:34:00.852557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 556/1085] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:01.073465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ab99c3b9-d04a-415e-94e6-69c3db631eba tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:01.074145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ab99c3b9-d04a-415e-94e6-69c3db631eba tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:01.083481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab99c3b9-d04a-415e-94e6-69c3db631eba tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:01.084027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab99c3b9-d04a-415e-94e6-69c3db631eba tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:01.084864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab99c3b9-d04a-415e-94e6-69c3db631eba tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:01.085340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab99c3b9-d04a-415e-94e6-69c3db631eba tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:01.289376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ab99c3b9-d04a-415e-94e6-69c3db631eba tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:01.302213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ab99c3b9-d04a-415e-94e6-69c3db631eba tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.232310 Jul 25 19:34:01.303207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 530/1086] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:01 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:01.689363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d8e718ca-89d5-49f5-8cac-88eef7a444b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:01.691991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d8e718ca-89d5-49f5-8cac-88eef7a444b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:01.699229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8e718ca-89d5-49f5-8cac-88eef7a444b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:01.699875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8e718ca-89d5-49f5-8cac-88eef7a444b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:01.700722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8e718ca-89d5-49f5-8cac-88eef7a444b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:01.701213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8e718ca-89d5-49f5-8cac-88eef7a444b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:01.762227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d8e718ca-89d5-49f5-8cac-88eef7a444b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076756 Jul 25 19:34:01.763249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 557/1087] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:01 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:01.870574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6e4cf7f3-5ecd-48ad-b930-60f51f685170 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:01.874145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6e4cf7f3-5ecd-48ad-b930-60f51f685170 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:01.881837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e4cf7f3-5ecd-48ad-b930-60f51f685170 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:01.882569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e4cf7f3-5ecd-48ad-b930-60f51f685170 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:01.883935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e4cf7f3-5ecd-48ad-b930-60f51f685170 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:01.884664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e4cf7f3-5ecd-48ad-b930-60f51f685170 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:01.939921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6e4cf7f3-5ecd-48ad-b930-60f51f685170 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076763 Jul 25 19:34:01.940926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 531/1088] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:02.338325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d4975e8a-227d-442f-96de-9587d9f44b5b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:02.339374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d4975e8a-227d-442f-96de-9587d9f44b5b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:02.350970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4975e8a-227d-442f-96de-9587d9f44b5b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:02.351781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4975e8a-227d-442f-96de-9587d9f44b5b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:02.352998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4975e8a-227d-442f-96de-9587d9f44b5b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:02.353692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4975e8a-227d-442f-96de-9587d9f44b5b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:02.549197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d4975e8a-227d-442f-96de-9587d9f44b5b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:02.559693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d4975e8a-227d-442f-96de-9587d9f44b5b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.228319 Jul 25 19:34:02.560736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 558/1089] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:02 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:02.779070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b8bc77d8-3178-4eb0-a003-d1c98f0e52c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:02.781215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b8bc77d8-3178-4eb0-a003-d1c98f0e52c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:02.788899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8bc77d8-3178-4eb0-a003-d1c98f0e52c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:02.789352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8bc77d8-3178-4eb0-a003-d1c98f0e52c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:02.790145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8bc77d8-3178-4eb0-a003-d1c98f0e52c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:02.790586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8bc77d8-3178-4eb0-a003-d1c98f0e52c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:02.825962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b8bc77d8-3178-4eb0-a003-d1c98f0e52c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051051 Jul 25 19:34:02.826597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 532/1090] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:02.956440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b7011013-f514-42de-9359-c6a22db77c1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:02.959333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b7011013-f514-42de-9359-c6a22db77c1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:02.966016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7011013-f514-42de-9359-c6a22db77c1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:02.966468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7011013-f514-42de-9359-c6a22db77c1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:02.967257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7011013-f514-42de-9359-c6a22db77c1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:02.967727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7011013-f514-42de-9359-c6a22db77c1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:03.001252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b7011013-f514-42de-9359-c6a22db77c1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048239 Jul 25 19:34:03.001546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 559/1091] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:03.597378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df1eb313-438f-43f2-9661-c2078a00f31c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:03.598944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df1eb313-438f-43f2-9661-c2078a00f31c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:03.606572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df1eb313-438f-43f2-9661-c2078a00f31c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:03.607024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df1eb313-438f-43f2-9661-c2078a00f31c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:03.607862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df1eb313-438f-43f2-9661-c2078a00f31c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:03.608342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df1eb313-438f-43f2-9661-c2078a00f31c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:03.838869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df1eb313-438f-43f2-9661-c2078a00f31c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:03.844811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-643e96c4-501b-4b93-bda4-2d0401d09ca3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:03.848707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-643e96c4-501b-4b93-bda4-2d0401d09ca3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:03.849614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df1eb313-438f-43f2-9661-c2078a00f31c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.256245 Jul 25 19:34:03.850566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 533/1092] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:03 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:03.857773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-643e96c4-501b-4b93-bda4-2d0401d09ca3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:03.858506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-643e96c4-501b-4b93-bda4-2d0401d09ca3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:03.859922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-643e96c4-501b-4b93-bda4-2d0401d09ca3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:03.860649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-643e96c4-501b-4b93-bda4-2d0401d09ca3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:03.902670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-643e96c4-501b-4b93-bda4-2d0401d09ca3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064214 Jul 25 19:34:03.903261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 560/1093] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:04.017352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8c9fddd9-3d09-4075-86b8-6fc8ed8254e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:04.020586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8c9fddd9-3d09-4075-86b8-6fc8ed8254e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:04.028370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8c9fddd9-3d09-4075-86b8-6fc8ed8254e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:04.028978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8c9fddd9-3d09-4075-86b8-6fc8ed8254e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:04.029874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8c9fddd9-3d09-4075-86b8-6fc8ed8254e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:04.030403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8c9fddd9-3d09-4075-86b8-6fc8ed8254e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:04.071786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8c9fddd9-3d09-4075-86b8-6fc8ed8254e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060021 Jul 25 19:34:04.072536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 534/1094] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:04.886524 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfd07126-01f3-4ba9-b30b-05c9632d5830 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:04.887577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfd07126-01f3-4ba9-b30b-05c9632d5830 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:04.898100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfd07126-01f3-4ba9-b30b-05c9632d5830 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:04.898554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfd07126-01f3-4ba9-b30b-05c9632d5830 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:04.899405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfd07126-01f3-4ba9-b30b-05c9632d5830 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:04.899883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfd07126-01f3-4ba9-b30b-05c9632d5830 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:04.918475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c9179028-3437-48f5-9e2d-ebc298494d82 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:04.922069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c9179028-3437-48f5-9e2d-ebc298494d82 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:04.926372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=82 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:04.934107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9179028-3437-48f5-9e2d-ebc298494d82 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:04.934747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9179028-3437-48f5-9e2d-ebc298494d82 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:04.935718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9179028-3437-48f5-9e2d-ebc298494d82 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:04.936203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9179028-3437-48f5-9e2d-ebc298494d82 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:04.974934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c9179028-3437-48f5-9e2d-ebc298494d82 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060965 Jul 25 19:34:04.976680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 535/1095] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:05.088764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-993cc478-5942-4a85-8e2d-9e825543a264 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:05.092423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-993cc478-5942-4a85-8e2d-9e825543a264 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:05.101717 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-993cc478-5942-4a85-8e2d-9e825543a264 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:05.102326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-993cc478-5942-4a85-8e2d-9e825543a264 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:05.103310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-993cc478-5942-4a85-8e2d-9e825543a264 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:05.104052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-993cc478-5942-4a85-8e2d-9e825543a264 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:05.114662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dfd07126-01f3-4ba9-b30b-05c9632d5830 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:05.131296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfd07126-01f3-4ba9-b30b-05c9632d5830 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.249818 Jul 25 19:34:05.135173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 561/1096] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:04 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:05.159243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-993cc478-5942-4a85-8e2d-9e825543a264 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074898 Jul 25 19:34:05.160761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 536/1097] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:05.995143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-78d81810-82aa-4f72-b7ed-ca2795ab4a85 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:05.999072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-78d81810-82aa-4f72-b7ed-ca2795ab4a85 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:06.012115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78d81810-82aa-4f72-b7ed-ca2795ab4a85 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:06.012896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78d81810-82aa-4f72-b7ed-ca2795ab4a85 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:06.014317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78d81810-82aa-4f72-b7ed-ca2795ab4a85 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:06.015099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78d81810-82aa-4f72-b7ed-ca2795ab4a85 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:06.056085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-78d81810-82aa-4f72-b7ed-ca2795ab4a85 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068315 Jul 25 19:34:06.057127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 562/1098] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:06.172252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a1d63668-1d73-401e-bacf-90e2fcb769a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:06.173316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a1d63668-1d73-401e-bacf-90e2fcb769a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:06.175234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-61d767e7-7ba0-4680-b88d-b3ba8b005897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:06.178717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-61d767e7-7ba0-4680-b88d-b3ba8b005897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:06.182460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1d63668-1d73-401e-bacf-90e2fcb769a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:06.183080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1d63668-1d73-401e-bacf-90e2fcb769a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:06.184176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1d63668-1d73-401e-bacf-90e2fcb769a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:06.184721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1d63668-1d73-401e-bacf-90e2fcb769a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:06.186998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61d767e7-7ba0-4680-b88d-b3ba8b005897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:06.187714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61d767e7-7ba0-4680-b88d-b3ba8b005897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:06.188717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61d767e7-7ba0-4680-b88d-b3ba8b005897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:06.189369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61d767e7-7ba0-4680-b88d-b3ba8b005897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:06.189543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:06.244904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-61d767e7-7ba0-4680-b88d-b3ba8b005897 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075389 Jul 25 19:34:06.245857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 563/1099] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:06.402172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a1d63668-1d73-401e-bacf-90e2fcb769a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:06.411130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a1d63668-1d73-401e-bacf-90e2fcb769a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.245342 Jul 25 19:34:06.411772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 537/1100] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:06 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:07.073266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-06dc61e4-2b3a-4bbd-90bc-3486afa10045 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:07.075890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-06dc61e4-2b3a-4bbd-90bc-3486afa10045 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:07.083755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06dc61e4-2b3a-4bbd-90bc-3486afa10045 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:07.084270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06dc61e4-2b3a-4bbd-90bc-3486afa10045 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:07.085097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06dc61e4-2b3a-4bbd-90bc-3486afa10045 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:07.085587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06dc61e4-2b3a-4bbd-90bc-3486afa10045 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:07.126549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:07.134457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-06dc61e4-2b3a-4bbd-90bc-3486afa10045 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065465 Jul 25 19:34:07.135761 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 564/1101] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:07.266037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f476f15a-6626-4f9c-b5f7-9c711dca6305 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:07.271731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f476f15a-6626-4f9c-b5f7-9c711dca6305 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:07.283614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f476f15a-6626-4f9c-b5f7-9c711dca6305 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:07.284372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f476f15a-6626-4f9c-b5f7-9c711dca6305 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:07.288472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f476f15a-6626-4f9c-b5f7-9c711dca6305 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:07.288675 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f476f15a-6626-4f9c-b5f7-9c711dca6305 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:07.354420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f476f15a-6626-4f9c-b5f7-9c711dca6305 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095456 Jul 25 19:34:07.355453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 538/1102] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:07.438469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da9f46e9-4dc8-42b4-a351-33ceeeece7d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:07.439473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da9f46e9-4dc8-42b4-a351-33ceeeece7d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:07.447853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da9f46e9-4dc8-42b4-a351-33ceeeece7d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:07.448295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da9f46e9-4dc8-42b4-a351-33ceeeece7d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:07.449236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da9f46e9-4dc8-42b4-a351-33ceeeece7d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:07.449678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da9f46e9-4dc8-42b4-a351-33ceeeece7d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:07.625764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-da9f46e9-4dc8-42b4-a351-33ceeeece7d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:07.635930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da9f46e9-4dc8-42b4-a351-33ceeeece7d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.204235 Jul 25 19:34:07.636537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 565/1103] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:07 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:08.149680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1c760d27-0eda-4915-84f9-7b0786cc75c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:08.152777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1c760d27-0eda-4915-84f9-7b0786cc75c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:08.159617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c760d27-0eda-4915-84f9-7b0786cc75c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:08.160642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c760d27-0eda-4915-84f9-7b0786cc75c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:08.161792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c760d27-0eda-4915-84f9-7b0786cc75c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:08.162280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c760d27-0eda-4915-84f9-7b0786cc75c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:08.200153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1c760d27-0eda-4915-84f9-7b0786cc75c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055465 Jul 25 19:34:08.200652 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 539/1104] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:08.371157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-42bc0b1c-4b74-47d9-a93b-9512c1f77ced tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:08.373790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-42bc0b1c-4b74-47d9-a93b-9512c1f77ced tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:08.383931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42bc0b1c-4b74-47d9-a93b-9512c1f77ced tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:08.384548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42bc0b1c-4b74-47d9-a93b-9512c1f77ced tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:08.385543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42bc0b1c-4b74-47d9-a93b-9512c1f77ced tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:08.386050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42bc0b1c-4b74-47d9-a93b-9512c1f77ced tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:08.434759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-42bc0b1c-4b74-47d9-a93b-9512c1f77ced tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067525 Jul 25 19:34:08.435917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 566/1105] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:08.665138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ffd76f8a-d947-4138-a095-dec851a89f94 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:08.666330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ffd76f8a-d947-4138-a095-dec851a89f94 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:08.678926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd76f8a-d947-4138-a095-dec851a89f94 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:08.679738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd76f8a-d947-4138-a095-dec851a89f94 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:08.681075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd76f8a-d947-4138-a095-dec851a89f94 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:08.681742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd76f8a-d947-4138-a095-dec851a89f94 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:08.891927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ffd76f8a-d947-4138-a095-dec851a89f94 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:08.906147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ffd76f8a-d947-4138-a095-dec851a89f94 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.250423 Jul 25 19:34:08.907114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 540/1106] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:08 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:09.219878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1ed3539d-a860-474a-bdf0-a2a77574ec87 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:09.223857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1ed3539d-a860-474a-bdf0-a2a77574ec87 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:09.236091 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ed3539d-a860-474a-bdf0-a2a77574ec87 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:09.236744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ed3539d-a860-474a-bdf0-a2a77574ec87 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:09.238619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ed3539d-a860-474a-bdf0-a2a77574ec87 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:09.239427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ed3539d-a860-474a-bdf0-a2a77574ec87 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:09.297892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1ed3539d-a860-474a-bdf0-a2a77574ec87 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086041 Jul 25 19:34:09.298849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 567/1107] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:09.452450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3781909f-672a-4898-82d5-b458789cb4cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:09.454914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3781909f-672a-4898-82d5-b458789cb4cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:09.462818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3781909f-672a-4898-82d5-b458789cb4cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:09.463270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3781909f-672a-4898-82d5-b458789cb4cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:09.464110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3781909f-672a-4898-82d5-b458789cb4cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:09.464553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3781909f-672a-4898-82d5-b458789cb4cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:09.499187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3781909f-672a-4898-82d5-b458789cb4cf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051202 Jul 25 19:34:09.499875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 541/1108] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:09.932014 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ec006db3-9582-443a-818b-02aa1ce6806d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:09.932929 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ec006db3-9582-443a-818b-02aa1ce6806d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:09.941112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec006db3-9582-443a-818b-02aa1ce6806d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:09.942109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec006db3-9582-443a-818b-02aa1ce6806d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:09.943411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec006db3-9582-443a-818b-02aa1ce6806d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:09.943615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec006db3-9582-443a-818b-02aa1ce6806d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:10.153334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ec006db3-9582-443a-818b-02aa1ce6806d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:10.168913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ec006db3-9582-443a-818b-02aa1ce6806d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.238343 Jul 25 19:34:10.168913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 568/1109] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:09 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:10.317589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e11259b7-8c76-4187-be64-8b3ec0daa80a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:10.321402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e11259b7-8c76-4187-be64-8b3ec0daa80a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:10.332730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e11259b7-8c76-4187-be64-8b3ec0daa80a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:10.333407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e11259b7-8c76-4187-be64-8b3ec0daa80a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:10.334626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e11259b7-8c76-4187-be64-8b3ec0daa80a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:10.335319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e11259b7-8c76-4187-be64-8b3ec0daa80a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:10.389686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e11259b7-8c76-4187-be64-8b3ec0daa80a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079374 Jul 25 19:34:10.390587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 542/1110] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:10.513161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-70efe4ce-0609-47a1-bee7-7ea5b48c50e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:10.515863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-70efe4ce-0609-47a1-bee7-7ea5b48c50e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:10.524112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70efe4ce-0609-47a1-bee7-7ea5b48c50e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:10.524563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70efe4ce-0609-47a1-bee7-7ea5b48c50e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:10.525409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70efe4ce-0609-47a1-bee7-7ea5b48c50e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:10.525853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70efe4ce-0609-47a1-bee7-7ea5b48c50e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:10.565715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-70efe4ce-0609-47a1-bee7-7ea5b48c50e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056783 Jul 25 19:34:10.567166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 569/1111] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:11.196667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-94760b48-e55d-4370-864e-4725454ea4e3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:11.197289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-94760b48-e55d-4370-864e-4725454ea4e3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:11.204886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94760b48-e55d-4370-864e-4725454ea4e3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:11.205328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94760b48-e55d-4370-864e-4725454ea4e3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:11.206111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94760b48-e55d-4370-864e-4725454ea4e3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:11.206544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94760b48-e55d-4370-864e-4725454ea4e3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:11.402430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-94760b48-e55d-4370-864e-4725454ea4e3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:11.406902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b777a5f0-3a6f-40eb-9e38-c36a39141613 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:11.409923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b777a5f0-3a6f-40eb-9e38-c36a39141613 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:11.413970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-94760b48-e55d-4370-864e-4725454ea4e3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.222344 Jul 25 19:34:11.414683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 543/1112] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:11 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:11.420077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b777a5f0-3a6f-40eb-9e38-c36a39141613 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:11.420977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b777a5f0-3a6f-40eb-9e38-c36a39141613 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:11.422294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b777a5f0-3a6f-40eb-9e38-c36a39141613 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:11.423161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b777a5f0-3a6f-40eb-9e38-c36a39141613 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:11.490936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b777a5f0-3a6f-40eb-9e38-c36a39141613 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088183 Jul 25 19:34:11.492059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 570/1113] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:11.585885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cc59e9b4-67b3-4d25-926f-e3e82d208106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:11.589844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cc59e9b4-67b3-4d25-926f-e3e82d208106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:11.602411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc59e9b4-67b3-4d25-926f-e3e82d208106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:11.603234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc59e9b4-67b3-4d25-926f-e3e82d208106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:11.604773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc59e9b4-67b3-4d25-926f-e3e82d208106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:11.605567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cc59e9b4-67b3-4d25-926f-e3e82d208106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:11.668878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cc59e9b4-67b3-4d25-926f-e3e82d208106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091073 Jul 25 19:34:11.670208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 544/1114] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:11 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:12.438044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-24689eaf-5a36-40db-8f3b-d0398b28114d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:12.438870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-24689eaf-5a36-40db-8f3b-d0398b28114d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:12.446215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24689eaf-5a36-40db-8f3b-d0398b28114d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:12.446893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24689eaf-5a36-40db-8f3b-d0398b28114d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:12.448344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24689eaf-5a36-40db-8f3b-d0398b28114d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:12.449109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24689eaf-5a36-40db-8f3b-d0398b28114d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:12.509076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4589db0c-b2dc-4c98-85bf-bce7d44c9846 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:12.511841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4589db0c-b2dc-4c98-85bf-bce7d44c9846 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:12.521099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4589db0c-b2dc-4c98-85bf-bce7d44c9846 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:12.521755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4589db0c-b2dc-4c98-85bf-bce7d44c9846 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:12.522968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4589db0c-b2dc-4c98-85bf-bce7d44c9846 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:12.523660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4589db0c-b2dc-4c98-85bf-bce7d44c9846 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:12.571825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4589db0c-b2dc-4c98-85bf-bce7d44c9846 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067772 Jul 25 19:34:12.572526 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 545/1115] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:12.642802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-24689eaf-5a36-40db-8f3b-d0398b28114d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:12.657786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-24689eaf-5a36-40db-8f3b-d0398b28114d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.218812 Jul 25 19:34:12.658505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 571/1116] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:12 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:12.690378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1d818b72-2327-45b3-9395-3b5b12942abe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:12.694741 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1d818b72-2327-45b3-9395-3b5b12942abe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:12.705986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d818b72-2327-45b3-9395-3b5b12942abe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:12.707752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d818b72-2327-45b3-9395-3b5b12942abe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:12.709276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d818b72-2327-45b3-9395-3b5b12942abe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:12.710138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d818b72-2327-45b3-9395-3b5b12942abe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:12.749810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1d818b72-2327-45b3-9395-3b5b12942abe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067376 Jul 25 19:34:12.750398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 546/1117] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:13.587097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9e47bbe2-0efe-46ec-b343-8584aa36e2a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:13.589450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9e47bbe2-0efe-46ec-b343-8584aa36e2a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:13.597363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e47bbe2-0efe-46ec-b343-8584aa36e2a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:13.598172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e47bbe2-0efe-46ec-b343-8584aa36e2a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:13.599170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e47bbe2-0efe-46ec-b343-8584aa36e2a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:13.599625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e47bbe2-0efe-46ec-b343-8584aa36e2a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:13.651555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9e47bbe2-0efe-46ec-b343-8584aa36e2a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069381 Jul 25 19:34:13.652441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 572/1118] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:13.682106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-def6f94e-c671-41d7-bf06-0a59649845aa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:13.682739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-def6f94e-c671-41d7-bf06-0a59649845aa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:13.690251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-def6f94e-c671-41d7-bf06-0a59649845aa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:13.690768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-def6f94e-c671-41d7-bf06-0a59649845aa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:13.692846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-def6f94e-c671-41d7-bf06-0a59649845aa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:13.693404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-def6f94e-c671-41d7-bf06-0a59649845aa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:13.767750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d94a2a7-8783-41db-b342-ea0860d883aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:13.773313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d94a2a7-8783-41db-b342-ea0860d883aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:13.784371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d94a2a7-8783-41db-b342-ea0860d883aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:13.785687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d94a2a7-8783-41db-b342-ea0860d883aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:13.786993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d94a2a7-8783-41db-b342-ea0860d883aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:13.787714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d94a2a7-8783-41db-b342-ea0860d883aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:13.843743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d94a2a7-8783-41db-b342-ea0860d883aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083402 Jul 25 19:34:13.844596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 573/1119] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:13.903267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-def6f94e-c671-41d7-bf06-0a59649845aa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:13.914000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-def6f94e-c671-41d7-bf06-0a59649845aa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.236450 Jul 25 19:34:13.914596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 547/1120] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:13 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:14.666394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3ee30ad2-b14a-4f96-8853-868398992275 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:14.668802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3ee30ad2-b14a-4f96-8853-868398992275 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:14.677956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ee30ad2-b14a-4f96-8853-868398992275 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:14.678775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ee30ad2-b14a-4f96-8853-868398992275 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:14.680288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ee30ad2-b14a-4f96-8853-868398992275 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:14.681007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ee30ad2-b14a-4f96-8853-868398992275 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:14.722097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3ee30ad2-b14a-4f96-8853-868398992275 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059749 Jul 25 19:34:14.723486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 574/1121] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:14.860458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4700a248-42a3-45b3-89d7-836b983d9e6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:14.862770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4700a248-42a3-45b3-89d7-836b983d9e6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:14.871911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4700a248-42a3-45b3-89d7-836b983d9e6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:14.872366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4700a248-42a3-45b3-89d7-836b983d9e6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:14.873172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4700a248-42a3-45b3-89d7-836b983d9e6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:14.873658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4700a248-42a3-45b3-89d7-836b983d9e6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:14.910780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4700a248-42a3-45b3-89d7-836b983d9e6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056506 Jul 25 19:34:14.911749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 548/1122] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:14 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:14.946352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b7313c1b-dbde-4d0e-ad2c-a859ef50c153 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:14.946352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b7313c1b-dbde-4d0e-ad2c-a859ef50c153 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:14.953943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7313c1b-dbde-4d0e-ad2c-a859ef50c153 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:14.954441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7313c1b-dbde-4d0e-ad2c-a859ef50c153 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:14.955270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7313c1b-dbde-4d0e-ad2c-a859ef50c153 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:14.956018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7313c1b-dbde-4d0e-ad2c-a859ef50c153 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:15.157689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b7313c1b-dbde-4d0e-ad2c-a859ef50c153 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:15.167007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b7313c1b-dbde-4d0e-ad2c-a859ef50c153 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.227485 Jul 25 19:34:15.167644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 575/1123] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:14 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:15.737282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-36625fcf-0d04-4c62-bbe5-3d6bc55cbe1f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:15.740039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-36625fcf-0d04-4c62-bbe5-3d6bc55cbe1f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:15.747353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36625fcf-0d04-4c62-bbe5-3d6bc55cbe1f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:15.747900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36625fcf-0d04-4c62-bbe5-3d6bc55cbe1f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:15.748773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36625fcf-0d04-4c62-bbe5-3d6bc55cbe1f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:15.749269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36625fcf-0d04-4c62-bbe5-3d6bc55cbe1f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:15.790823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-36625fcf-0d04-4c62-bbe5-3d6bc55cbe1f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058659 Jul 25 19:34:15.791585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 549/1124] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:15.924502 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d19c6e11-0bc1-44e6-af17-3c2665e61cf9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:15.927675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d19c6e11-0bc1-44e6-af17-3c2665e61cf9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:15.949895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d19c6e11-0bc1-44e6-af17-3c2665e61cf9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:15.950832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d19c6e11-0bc1-44e6-af17-3c2665e61cf9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:15.951852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d19c6e11-0bc1-44e6-af17-3c2665e61cf9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:15.952364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d19c6e11-0bc1-44e6-af17-3c2665e61cf9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:15.993620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d19c6e11-0bc1-44e6-af17-3c2665e61cf9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073281 Jul 25 19:34:15.994292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 576/1125] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:16.202975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b8092af3-7a93-42ff-a50a-753917e081fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:16.203649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b8092af3-7a93-42ff-a50a-753917e081fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:16.211733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8092af3-7a93-42ff-a50a-753917e081fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:16.212391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8092af3-7a93-42ff-a50a-753917e081fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:16.213239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8092af3-7a93-42ff-a50a-753917e081fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:16.213719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b8092af3-7a93-42ff-a50a-753917e081fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:16.413123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b8092af3-7a93-42ff-a50a-753917e081fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:16.427823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b8092af3-7a93-42ff-a50a-753917e081fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.229275 Jul 25 19:34:16.428838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 550/1126] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:16 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:16.805016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-72f152b2-bf2f-45ed-8ec3-394ccbb060a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:16.808180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-72f152b2-bf2f-45ed-8ec3-394ccbb060a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:16.814670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72f152b2-bf2f-45ed-8ec3-394ccbb060a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:16.815570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72f152b2-bf2f-45ed-8ec3-394ccbb060a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:16.817602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72f152b2-bf2f-45ed-8ec3-394ccbb060a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:16.818099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72f152b2-bf2f-45ed-8ec3-394ccbb060a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:16.864917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-72f152b2-bf2f-45ed-8ec3-394ccbb060a3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063689 Jul 25 19:34:16.865895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 577/1127] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:17.010230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6ff035f8-e468-4c54-9f0d-48a7de36c114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:17.013857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6ff035f8-e468-4c54-9f0d-48a7de36c114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:17.023724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ff035f8-e468-4c54-9f0d-48a7de36c114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:17.024245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ff035f8-e468-4c54-9f0d-48a7de36c114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:17.025180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ff035f8-e468-4c54-9f0d-48a7de36c114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:17.025711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ff035f8-e468-4c54-9f0d-48a7de36c114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:17.064585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6ff035f8-e468-4c54-9f0d-48a7de36c114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059245 Jul 25 19:34:17.065144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 551/1128] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:17.464825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cf9ea41e-1b4b-47a2-9a41-5395a8138a66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:17.465454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cf9ea41e-1b4b-47a2-9a41-5395a8138a66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:17.473971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf9ea41e-1b4b-47a2-9a41-5395a8138a66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:17.474463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf9ea41e-1b4b-47a2-9a41-5395a8138a66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:17.475316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf9ea41e-1b4b-47a2-9a41-5395a8138a66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:17.476226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf9ea41e-1b4b-47a2-9a41-5395a8138a66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:17.656516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cf9ea41e-1b4b-47a2-9a41-5395a8138a66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:17.666208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cf9ea41e-1b4b-47a2-9a41-5395a8138a66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.205522 Jul 25 19:34:17.666765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 578/1129] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:17 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:17.884370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eaec2178-b36f-4872-8ceb-41f73f12faa0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:17.886572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eaec2178-b36f-4872-8ceb-41f73f12faa0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:17.893369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eaec2178-b36f-4872-8ceb-41f73f12faa0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:17.893821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eaec2178-b36f-4872-8ceb-41f73f12faa0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:17.895728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eaec2178-b36f-4872-8ceb-41f73f12faa0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:17.896339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eaec2178-b36f-4872-8ceb-41f73f12faa0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:17.933352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eaec2178-b36f-4872-8ceb-41f73f12faa0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054125 Jul 25 19:34:17.934123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 552/1130] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:18.081425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-489bfe16-bb33-4e64-b226-6156e753ca33 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:18.085676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-489bfe16-bb33-4e64-b226-6156e753ca33 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:18.094566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-489bfe16-bb33-4e64-b226-6156e753ca33 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:18.095158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-489bfe16-bb33-4e64-b226-6156e753ca33 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:18.096129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-489bfe16-bb33-4e64-b226-6156e753ca33 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:18.096711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-489bfe16-bb33-4e64-b226-6156e753ca33 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:18.152993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-489bfe16-bb33-4e64-b226-6156e753ca33 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075644 Jul 25 19:34:18.154275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 579/1131] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:18.690682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0e5bbbee-1709-435e-81f0-8aba35d59685 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:18.692091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0e5bbbee-1709-435e-81f0-8aba35d59685 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:18.699912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e5bbbee-1709-435e-81f0-8aba35d59685 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:18.700360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e5bbbee-1709-435e-81f0-8aba35d59685 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:18.701151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e5bbbee-1709-435e-81f0-8aba35d59685 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:18.701590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e5bbbee-1709-435e-81f0-8aba35d59685 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:18.944705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0e5bbbee-1709-435e-81f0-8aba35d59685 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:18.947676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:18.954731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0e5bbbee-1709-435e-81f0-8aba35d59685 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.268059 Jul 25 19:34:18.955030 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d91656b5-9934-4634-b679-e97a55d58aa8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:18.959303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 553/1132] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:18 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:18.959782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d91656b5-9934-4634-b679-e97a55d58aa8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:18.970513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d91656b5-9934-4634-b679-e97a55d58aa8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:18.971270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d91656b5-9934-4634-b679-e97a55d58aa8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:18.973356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d91656b5-9934-4634-b679-e97a55d58aa8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:18.974194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d91656b5-9934-4634-b679-e97a55d58aa8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:19.018808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d91656b5-9934-4634-b679-e97a55d58aa8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071345 Jul 25 19:34:19.020292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 580/1133] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:19.172828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a89d604f-54f5-4d77-a438-0aad22a6e4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:19.177507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a89d604f-54f5-4d77-a438-0aad22a6e4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:19.188451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a89d604f-54f5-4d77-a438-0aad22a6e4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:19.189189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a89d604f-54f5-4d77-a438-0aad22a6e4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:19.190619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a89d604f-54f5-4d77-a438-0aad22a6e4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:19.191416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a89d604f-54f5-4d77-a438-0aad22a6e4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:19.233255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a89d604f-54f5-4d77-a438-0aad22a6e4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068817 Jul 25 19:34:19.233962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 554/1134] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:19.981408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-84cb1cd2-460b-4975-b2ec-ae64d19967ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:19.982368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-84cb1cd2-460b-4975-b2ec-ae64d19967ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:19.985119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=80 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:19.991691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84cb1cd2-460b-4975-b2ec-ae64d19967ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:19.992186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84cb1cd2-460b-4975-b2ec-ae64d19967ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:19.993009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84cb1cd2-460b-4975-b2ec-ae64d19967ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:19.993487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84cb1cd2-460b-4975-b2ec-ae64d19967ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:20.020743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:20.038879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-67d2929f-1bfe-4998-8d46-6c32e03055cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:20.041703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-67d2929f-1bfe-4998-8d46-6c32e03055cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:20.049384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-67d2929f-1bfe-4998-8d46-6c32e03055cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:20.049843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-67d2929f-1bfe-4998-8d46-6c32e03055cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:20.051445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-67d2929f-1bfe-4998-8d46-6c32e03055cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:20.052284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-67d2929f-1bfe-4998-8d46-6c32e03055cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:20.116979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-67d2929f-1bfe-4998-8d46-6c32e03055cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085079 Jul 25 19:34:20.117951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 555/1135] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:20.203728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84cb1cd2-460b-4975-b2ec-ae64d19967ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:20.214068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-84cb1cd2-460b-4975-b2ec-ae64d19967ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.238785 Jul 25 19:34:20.214662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 581/1136] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:19 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:20.250895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-32e72d79-ce45-401c-a3ba-e0c4d748808c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:20.254873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-32e72d79-ce45-401c-a3ba-e0c4d748808c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:20.266819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32e72d79-ce45-401c-a3ba-e0c4d748808c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:20.267658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32e72d79-ce45-401c-a3ba-e0c4d748808c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:20.269111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32e72d79-ce45-401c-a3ba-e0c4d748808c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:20.270170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32e72d79-ce45-401c-a3ba-e0c4d748808c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:20.336333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-32e72d79-ce45-401c-a3ba-e0c4d748808c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092760 Jul 25 19:34:20.337567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 556/1137] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:21.135100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ba5dceb-8ab8-4dbf-b17d-af705e65be86 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:21.137658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ba5dceb-8ab8-4dbf-b17d-af705e65be86 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:21.145902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ba5dceb-8ab8-4dbf-b17d-af705e65be86 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:21.146444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ba5dceb-8ab8-4dbf-b17d-af705e65be86 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:21.147298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ba5dceb-8ab8-4dbf-b17d-af705e65be86 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:21.147899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ba5dceb-8ab8-4dbf-b17d-af705e65be86 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:21.197661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ba5dceb-8ab8-4dbf-b17d-af705e65be86 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066668 Jul 25 19:34:21.198711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 582/1138] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:21.254246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-79b5fbcb-8e4b-489a-b9ff-046f57944934 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:21.255326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-79b5fbcb-8e4b-489a-b9ff-046f57944934 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:21.269856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79b5fbcb-8e4b-489a-b9ff-046f57944934 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:21.270675 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79b5fbcb-8e4b-489a-b9ff-046f57944934 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:21.272165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79b5fbcb-8e4b-489a-b9ff-046f57944934 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:21.272961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79b5fbcb-8e4b-489a-b9ff-046f57944934 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:21.357121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f7415d5b-c86a-4bce-bf9d-dd599081abe6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:21.361020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f7415d5b-c86a-4bce-bf9d-dd599081abe6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:21.373424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7415d5b-c86a-4bce-bf9d-dd599081abe6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:21.374227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7415d5b-c86a-4bce-bf9d-dd599081abe6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:21.375687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7415d5b-c86a-4bce-bf9d-dd599081abe6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:21.376491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7415d5b-c86a-4bce-bf9d-dd599081abe6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:21.439119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f7415d5b-c86a-4bce-bf9d-dd599081abe6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087859 Jul 25 19:34:21.440222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 583/1139] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:21.493650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-79b5fbcb-8e4b-489a-b9ff-046f57944934 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:21.501861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-79b5fbcb-8e4b-489a-b9ff-046f57944934 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.254852 Jul 25 19:34:21.502446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 557/1140] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:21 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:22.215483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-80e7bbe9-b5f1-4a06-80ee-573095fc2408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:22.217645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-80e7bbe9-b5f1-4a06-80ee-573095fc2408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:22.226678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80e7bbe9-b5f1-4a06-80ee-573095fc2408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:22.227401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80e7bbe9-b5f1-4a06-80ee-573095fc2408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:22.227955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80e7bbe9-b5f1-4a06-80ee-573095fc2408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:22.228409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80e7bbe9-b5f1-4a06-80ee-573095fc2408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:22.267333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-80e7bbe9-b5f1-4a06-80ee-573095fc2408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056321 Jul 25 19:34:22.268171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 584/1141] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:22.458467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-761ec764-009f-479c-ab0c-b9ff4bc75f58 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:22.462191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-761ec764-009f-479c-ab0c-b9ff4bc75f58 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:22.474684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-761ec764-009f-479c-ab0c-b9ff4bc75f58 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:22.475397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-761ec764-009f-479c-ab0c-b9ff4bc75f58 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:22.477120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-761ec764-009f-479c-ab0c-b9ff4bc75f58 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:22.477910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-761ec764-009f-479c-ab0c-b9ff4bc75f58 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:22.534015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a7d2ee4b-96b5-4e84-8c0c-94da302a2834 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:22.536137 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a7d2ee4b-96b5-4e84-8c0c-94da302a2834 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:22.536327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-761ec764-009f-479c-ab0c-b9ff4bc75f58 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084712 Jul 25 19:34:22.536990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 558/1142] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:22.553233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7d2ee4b-96b5-4e84-8c0c-94da302a2834 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:22.553828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7d2ee4b-96b5-4e84-8c0c-94da302a2834 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:22.554728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7d2ee4b-96b5-4e84-8c0c-94da302a2834 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:22.555342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7d2ee4b-96b5-4e84-8c0c-94da302a2834 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:22.736354 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a7d2ee4b-96b5-4e84-8c0c-94da302a2834 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:22.751068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a7d2ee4b-96b5-4e84-8c0c-94da302a2834 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.223681 Jul 25 19:34:22.752376 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 585/1143] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:22 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:23.284620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6ba1b668-a8d7-469b-990e-2118f3adbdba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:23.288073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6ba1b668-a8d7-469b-990e-2118f3adbdba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:23.295395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ba1b668-a8d7-469b-990e-2118f3adbdba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:23.296085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ba1b668-a8d7-469b-990e-2118f3adbdba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:23.297041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ba1b668-a8d7-469b-990e-2118f3adbdba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:23.297606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ba1b668-a8d7-469b-990e-2118f3adbdba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:23.349071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6ba1b668-a8d7-469b-990e-2118f3adbdba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067039 Jul 25 19:34:23.350023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 559/1144] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:23.549880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f6a0290-40ad-4bf2-aaad-e6f5697fa47f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:23.552238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9f6a0290-40ad-4bf2-aaad-e6f5697fa47f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:23.558911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f6a0290-40ad-4bf2-aaad-e6f5697fa47f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:23.559492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f6a0290-40ad-4bf2-aaad-e6f5697fa47f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:23.560152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f6a0290-40ad-4bf2-aaad-e6f5697fa47f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:23.560578 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f6a0290-40ad-4bf2-aaad-e6f5697fa47f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:23.603490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9f6a0290-40ad-4bf2-aaad-e6f5697fa47f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057755 Jul 25 19:34:23.604131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 586/1145] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:23.775998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-61dbf854-8e74-41e3-b16d-3c1496c92349 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:23.776986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-61dbf854-8e74-41e3-b16d-3c1496c92349 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:23.789858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-61dbf854-8e74-41e3-b16d-3c1496c92349 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:23.790642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-61dbf854-8e74-41e3-b16d-3c1496c92349 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:23.792145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-61dbf854-8e74-41e3-b16d-3c1496c92349 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:23.792952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-61dbf854-8e74-41e3-b16d-3c1496c92349 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:24.033262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-61dbf854-8e74-41e3-b16d-3c1496c92349 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:24.042850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-61dbf854-8e74-41e3-b16d-3c1496c92349 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.271067 Jul 25 19:34:24.043454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 560/1146] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:23 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:24.369275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2205bdce-ebdb-48fb-8879-61fec2f394af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:24.373100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2205bdce-ebdb-48fb-8879-61fec2f394af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:24.385059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2205bdce-ebdb-48fb-8879-61fec2f394af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:24.385849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2205bdce-ebdb-48fb-8879-61fec2f394af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:24.387241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2205bdce-ebdb-48fb-8879-61fec2f394af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:24.388061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2205bdce-ebdb-48fb-8879-61fec2f394af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:24.448566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2205bdce-ebdb-48fb-8879-61fec2f394af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086920 Jul 25 19:34:24.449654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 587/1147] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:24.617021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b6041dbc-d283-45f7-98ff-329dbf6c43e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:24.619782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b6041dbc-d283-45f7-98ff-329dbf6c43e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:24.626361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6041dbc-d283-45f7-98ff-329dbf6c43e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:24.626808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6041dbc-d283-45f7-98ff-329dbf6c43e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:24.627637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6041dbc-d283-45f7-98ff-329dbf6c43e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:24.628081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6041dbc-d283-45f7-98ff-329dbf6c43e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:24.662808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b6041dbc-d283-45f7-98ff-329dbf6c43e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050065 Jul 25 19:34:24.663489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 561/1148] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:25.072955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9448cd7a-436d-4ce6-a6da-8be0fb20f110 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:25.073792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9448cd7a-436d-4ce6-a6da-8be0fb20f110 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:25.080930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9448cd7a-436d-4ce6-a6da-8be0fb20f110 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:25.081372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9448cd7a-436d-4ce6-a6da-8be0fb20f110 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:25.082738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9448cd7a-436d-4ce6-a6da-8be0fb20f110 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:25.083173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9448cd7a-436d-4ce6-a6da-8be0fb20f110 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:25.251453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9448cd7a-436d-4ce6-a6da-8be0fb20f110 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:25.267431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9448cd7a-436d-4ce6-a6da-8be0fb20f110 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.200033 Jul 25 19:34:25.268506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 588/1149] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:25 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:25.466916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2d14ba2f-b3f4-4b00-9238-598906bff017 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:25.469289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2d14ba2f-b3f4-4b00-9238-598906bff017 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:25.478336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2d14ba2f-b3f4-4b00-9238-598906bff017 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:25.478786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2d14ba2f-b3f4-4b00-9238-598906bff017 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:25.479752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2d14ba2f-b3f4-4b00-9238-598906bff017 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:25.480207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2d14ba2f-b3f4-4b00-9238-598906bff017 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:25.528010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2d14ba2f-b3f4-4b00-9238-598906bff017 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066371 Jul 25 19:34:25.528664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 562/1150] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:25.676636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cff8ba4c-30de-4eef-bf65-150c6c054970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:25.679203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cff8ba4c-30de-4eef-bf65-150c6c054970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:25.688653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cff8ba4c-30de-4eef-bf65-150c6c054970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:25.689432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cff8ba4c-30de-4eef-bf65-150c6c054970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:25.690771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cff8ba4c-30de-4eef-bf65-150c6c054970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:25.691433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cff8ba4c-30de-4eef-bf65-150c6c054970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:25.743749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cff8ba4c-30de-4eef-bf65-150c6c054970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071288 Jul 25 19:34:25.744573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 589/1151] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:26.307383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b4a5af10-da9e-4488-8f80-3a104fc85b60 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:26.308107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b4a5af10-da9e-4488-8f80-3a104fc85b60 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:26.315589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4a5af10-da9e-4488-8f80-3a104fc85b60 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:26.316619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4a5af10-da9e-4488-8f80-3a104fc85b60 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:26.317746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4a5af10-da9e-4488-8f80-3a104fc85b60 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:26.318298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4a5af10-da9e-4488-8f80-3a104fc85b60 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:26.507637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b4a5af10-da9e-4488-8f80-3a104fc85b60 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:26.516100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b4a5af10-da9e-4488-8f80-3a104fc85b60 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.213038 Jul 25 19:34:26.516964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 563/1152] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:26 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:26.548163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4213d9ba-2aa3-4b46-b5fb-9eed979caedb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:26.552756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4213d9ba-2aa3-4b46-b5fb-9eed979caedb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:26.560973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4213d9ba-2aa3-4b46-b5fb-9eed979caedb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:26.561780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4213d9ba-2aa3-4b46-b5fb-9eed979caedb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:26.562759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4213d9ba-2aa3-4b46-b5fb-9eed979caedb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:26.564693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4213d9ba-2aa3-4b46-b5fb-9eed979caedb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:26.605676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4213d9ba-2aa3-4b46-b5fb-9eed979caedb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062251 Jul 25 19:34:26.606352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 590/1153] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:26.760612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-33adfd03-853c-44c2-8214-aadbbbc75ecc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:26.763406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-33adfd03-853c-44c2-8214-aadbbbc75ecc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:26.771010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33adfd03-853c-44c2-8214-aadbbbc75ecc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:26.771459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33adfd03-853c-44c2-8214-aadbbbc75ecc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:26.772270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33adfd03-853c-44c2-8214-aadbbbc75ecc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:26.772702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33adfd03-853c-44c2-8214-aadbbbc75ecc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:26.807711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-33adfd03-853c-44c2-8214-aadbbbc75ecc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051251 Jul 25 19:34:26.808324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 564/1154] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:27.539155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a4722688-cd4b-44b4-8eea-09a9ffc62ad9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:27.539786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a4722688-cd4b-44b4-8eea-09a9ffc62ad9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:27.547849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4722688-cd4b-44b4-8eea-09a9ffc62ad9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:27.548525 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4722688-cd4b-44b4-8eea-09a9ffc62ad9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:27.549495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4722688-cd4b-44b4-8eea-09a9ffc62ad9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:27.550039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4722688-cd4b-44b4-8eea-09a9ffc62ad9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:27.622967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-646c2ba6-5a6e-4170-8731-6b2b4c2ae499 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:27.627232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-646c2ba6-5a6e-4170-8731-6b2b4c2ae499 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:27.639295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-646c2ba6-5a6e-4170-8731-6b2b4c2ae499 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:27.640244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-646c2ba6-5a6e-4170-8731-6b2b4c2ae499 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:27.641721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-646c2ba6-5a6e-4170-8731-6b2b4c2ae499 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:27.642513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-646c2ba6-5a6e-4170-8731-6b2b4c2ae499 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:27.688827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-646c2ba6-5a6e-4170-8731-6b2b4c2ae499 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073394 Jul 25 19:34:27.689690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 565/1155] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:27.748793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a4722688-cd4b-44b4-8eea-09a9ffc62ad9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:27.758692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a4722688-cd4b-44b4-8eea-09a9ffc62ad9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.223931 Jul 25 19:34:27.759456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 591/1156] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:27 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:27.823030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1117fa1a-a00f-4572-82ab-d26229a2a7ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:27.825739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1117fa1a-a00f-4572-82ab-d26229a2a7ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:27.833795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1117fa1a-a00f-4572-82ab-d26229a2a7ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:27.834242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1117fa1a-a00f-4572-82ab-d26229a2a7ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:27.835027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1117fa1a-a00f-4572-82ab-d26229a2a7ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:27.835454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1117fa1a-a00f-4572-82ab-d26229a2a7ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:27.870621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1117fa1a-a00f-4572-82ab-d26229a2a7ee tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051795 Jul 25 19:34:27.871262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 566/1157] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:28.704681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-23a485b1-5e1e-4f97-aba8-91b5c70dfcf3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:28.707441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-23a485b1-5e1e-4f97-aba8-91b5c70dfcf3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:28.714521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23a485b1-5e1e-4f97-aba8-91b5c70dfcf3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:28.714959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23a485b1-5e1e-4f97-aba8-91b5c70dfcf3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:28.715786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23a485b1-5e1e-4f97-aba8-91b5c70dfcf3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:28.716214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23a485b1-5e1e-4f97-aba8-91b5c70dfcf3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:28.762612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-23a485b1-5e1e-4f97-aba8-91b5c70dfcf3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061670 Jul 25 19:34:28.763689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 592/1158] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:28.794870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0ea9e388-b081-471a-9897-2b9e1ed61d1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:28.795592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0ea9e388-b081-471a-9897-2b9e1ed61d1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:28.803480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ea9e388-b081-471a-9897-2b9e1ed61d1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:28.804076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ea9e388-b081-471a-9897-2b9e1ed61d1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:28.804963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ea9e388-b081-471a-9897-2b9e1ed61d1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:28.805443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ea9e388-b081-471a-9897-2b9e1ed61d1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:28.891287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b45d97c-e453-4783-a458-9caa399a2214 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:28.897294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b45d97c-e453-4783-a458-9caa399a2214 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:28.908860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b45d97c-e453-4783-a458-9caa399a2214 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:28.909331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b45d97c-e453-4783-a458-9caa399a2214 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:28.912375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b45d97c-e453-4783-a458-9caa399a2214 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:28.913190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b45d97c-e453-4783-a458-9caa399a2214 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:28.975318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0ea9e388-b081-471a-9897-2b9e1ed61d1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:28.976129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b45d97c-e453-4783-a458-9caa399a2214 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091917 Jul 25 19:34:28.979127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 593/1159] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:28.988548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0ea9e388-b081-471a-9897-2b9e1ed61d1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.197127 Jul 25 19:34:28.989309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 567/1160] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:28 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:29.788696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d15f38f1-1823-444b-8d69-d083c2752e6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:29.792086 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d15f38f1-1823-444b-8d69-d083c2752e6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:29.802358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d15f38f1-1823-444b-8d69-d083c2752e6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:29.803026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d15f38f1-1823-444b-8d69-d083c2752e6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:29.804277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d15f38f1-1823-444b-8d69-d083c2752e6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:29.804942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d15f38f1-1823-444b-8d69-d083c2752e6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:29.855634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d15f38f1-1823-444b-8d69-d083c2752e6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073755 Jul 25 19:34:29.856543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 594/1161] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:29 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:29.993799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6fe8077c-3d2a-4086-96f8-e87b3aa51781 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:29.997359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6fe8077c-3d2a-4086-96f8-e87b3aa51781 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:30.009630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fe8077c-3d2a-4086-96f8-e87b3aa51781 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:30.010301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fe8077c-3d2a-4086-96f8-e87b3aa51781 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:30.011552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fe8077c-3d2a-4086-96f8-e87b3aa51781 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:30.011777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48368ab2-ba0c-4ae5-b727-932ea200bc1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:30.012261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fe8077c-3d2a-4086-96f8-e87b3aa51781 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:30.012510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48368ab2-ba0c-4ae5-b727-932ea200bc1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:30.022688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48368ab2-ba0c-4ae5-b727-932ea200bc1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:30.023410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48368ab2-ba0c-4ae5-b727-932ea200bc1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:30.024618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48368ab2-ba0c-4ae5-b727-932ea200bc1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:30.025953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48368ab2-ba0c-4ae5-b727-932ea200bc1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:30.077883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6fe8077c-3d2a-4086-96f8-e87b3aa51781 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090644 Jul 25 19:34:30.078974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 568/1162] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:29 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:30.210453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48368ab2-ba0c-4ae5-b727-932ea200bc1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:30.224386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48368ab2-ba0c-4ae5-b727-932ea200bc1e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.216548 Jul 25 19:34:30.225448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 595/1163] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:30 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:30.875012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-714db0c1-464a-4b4c-a235-25f1b2baf28b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:30.877412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-714db0c1-464a-4b4c-a235-25f1b2baf28b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:30.887551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714db0c1-464a-4b4c-a235-25f1b2baf28b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:30.888476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714db0c1-464a-4b4c-a235-25f1b2baf28b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:30.889502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714db0c1-464a-4b4c-a235-25f1b2baf28b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:30.890169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-714db0c1-464a-4b4c-a235-25f1b2baf28b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:30.938587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-714db0c1-464a-4b4c-a235-25f1b2baf28b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069065 Jul 25 19:34:30.939190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 569/1164] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:31.099656 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1c5c0041-509c-4642-a48b-37a3dd9b6380 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:31.103456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1c5c0041-509c-4642-a48b-37a3dd9b6380 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:31.116048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c5c0041-509c-4642-a48b-37a3dd9b6380 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:31.116781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c5c0041-509c-4642-a48b-37a3dd9b6380 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:31.118080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c5c0041-509c-4642-a48b-37a3dd9b6380 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:31.118788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c5c0041-509c-4642-a48b-37a3dd9b6380 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:31.177985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1c5c0041-509c-4642-a48b-37a3dd9b6380 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085999 Jul 25 19:34:31.178895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 596/1165] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:31.260935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b3fa9bc7-e5c5-400c-b44e-1749fbfab88f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:31.261717 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b3fa9bc7-e5c5-400c-b44e-1749fbfab88f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:31.269685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3fa9bc7-e5c5-400c-b44e-1749fbfab88f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:31.270138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3fa9bc7-e5c5-400c-b44e-1749fbfab88f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:31.270928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3fa9bc7-e5c5-400c-b44e-1749fbfab88f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:31.271370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3fa9bc7-e5c5-400c-b44e-1749fbfab88f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:31.289162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:31.508390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b3fa9bc7-e5c5-400c-b44e-1749fbfab88f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:31.518305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b3fa9bc7-e5c5-400c-b44e-1749fbfab88f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.261440 Jul 25 19:34:31.518893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 570/1166] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:31 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:31.956548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a33e91f8-e7c2-40d3-80b0-ac3a18e808b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:31.960147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a33e91f8-e7c2-40d3-80b0-ac3a18e808b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:31.967082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a33e91f8-e7c2-40d3-80b0-ac3a18e808b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:31.967561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a33e91f8-e7c2-40d3-80b0-ac3a18e808b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:31.968840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a33e91f8-e7c2-40d3-80b0-ac3a18e808b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:31.969547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a33e91f8-e7c2-40d3-80b0-ac3a18e808b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:32.009483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a33e91f8-e7c2-40d3-80b0-ac3a18e808b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056824 Jul 25 19:34:32.010352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 597/1167] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:32.192702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0cb6c89a-ef5f-4f64-90ab-c3aaea1d965d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:32.196368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0cb6c89a-ef5f-4f64-90ab-c3aaea1d965d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:32.205726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cb6c89a-ef5f-4f64-90ab-c3aaea1d965d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:32.206154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cb6c89a-ef5f-4f64-90ab-c3aaea1d965d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:32.207584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cb6c89a-ef5f-4f64-90ab-c3aaea1d965d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:32.207964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cb6c89a-ef5f-4f64-90ab-c3aaea1d965d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:32.247341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0cb6c89a-ef5f-4f64-90ab-c3aaea1d965d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059941 Jul 25 19:34:32.248250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 571/1168] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:32.545094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-887a186e-3172-4f81-9e29-1b0475fc7132 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:32.545686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-887a186e-3172-4f81-9e29-1b0475fc7132 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:32.553042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-887a186e-3172-4f81-9e29-1b0475fc7132 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:32.553706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-887a186e-3172-4f81-9e29-1b0475fc7132 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:32.554661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-887a186e-3172-4f81-9e29-1b0475fc7132 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:32.555200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-887a186e-3172-4f81-9e29-1b0475fc7132 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:32.558321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:32.725313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-887a186e-3172-4f81-9e29-1b0475fc7132 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:32.733529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-887a186e-3172-4f81-9e29-1b0475fc7132 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.192355 Jul 25 19:34:32.734127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 598/1169] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:32 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:33.027161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0b75636d-494d-43c8-9482-ff5b6030f9ae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:33.029438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0b75636d-494d-43c8-9482-ff5b6030f9ae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:33.037401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b75636d-494d-43c8-9482-ff5b6030f9ae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:33.037856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b75636d-494d-43c8-9482-ff5b6030f9ae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:33.038653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b75636d-494d-43c8-9482-ff5b6030f9ae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:33.039092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b75636d-494d-43c8-9482-ff5b6030f9ae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:33.078283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0b75636d-494d-43c8-9482-ff5b6030f9ae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054960 Jul 25 19:34:33.079364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 572/1170] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:33.262000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a4accac-8389-4a1a-94b0-97e2dd31fc34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:33.265186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6a4accac-8389-4a1a-94b0-97e2dd31fc34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:33.274489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4accac-8389-4a1a-94b0-97e2dd31fc34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:33.275112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4accac-8389-4a1a-94b0-97e2dd31fc34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:33.276243 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4accac-8389-4a1a-94b0-97e2dd31fc34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:33.276817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4accac-8389-4a1a-94b0-97e2dd31fc34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:33.313295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6a4accac-8389-4a1a-94b0-97e2dd31fc34 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056302 Jul 25 19:34:33.313938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 599/1171] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:33.756544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6208a03b-bfa8-4493-8bfc-25d5c5a7a9ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:33.757175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6208a03b-bfa8-4493-8bfc-25d5c5a7a9ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:33.763802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6208a03b-bfa8-4493-8bfc-25d5c5a7a9ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:33.764254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6208a03b-bfa8-4493-8bfc-25d5c5a7a9ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:33.765046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6208a03b-bfa8-4493-8bfc-25d5c5a7a9ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:33.765487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6208a03b-bfa8-4493-8bfc-25d5c5a7a9ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:34.008891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6208a03b-bfa8-4493-8bfc-25d5c5a7a9ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:34.017151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6208a03b-bfa8-4493-8bfc-25d5c5a7a9ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.264546 Jul 25 19:34:34.017887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 573/1172] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:33 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:34.092346 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f414d71b-167f-4a71-ac74-c75b1a2d0153 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:34.094631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f414d71b-167f-4a71-ac74-c75b1a2d0153 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:34.102839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f414d71b-167f-4a71-ac74-c75b1a2d0153 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:34.103291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f414d71b-167f-4a71-ac74-c75b1a2d0153 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:34.104216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f414d71b-167f-4a71-ac74-c75b1a2d0153 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:34.104582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f414d71b-167f-4a71-ac74-c75b1a2d0153 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:34.138210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f414d71b-167f-4a71-ac74-c75b1a2d0153 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050015 Jul 25 19:34:34.138803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 600/1173] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:34.327311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7742cb67-4664-4a46-bc34-bf7929269809 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:34.329622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7742cb67-4664-4a46-bc34-bf7929269809 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:34.338517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7742cb67-4664-4a46-bc34-bf7929269809 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:34.338970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7742cb67-4664-4a46-bc34-bf7929269809 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:34.339819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7742cb67-4664-4a46-bc34-bf7929269809 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:34.340545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7742cb67-4664-4a46-bc34-bf7929269809 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:34.376328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7742cb67-4664-4a46-bc34-bf7929269809 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052942 Jul 25 19:34:34.377125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 574/1174] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:35.041305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-20e62435-82bf-4ee7-bc00-2f7d97af12ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:35.042059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-20e62435-82bf-4ee7-bc00-2f7d97af12ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:35.049504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20e62435-82bf-4ee7-bc00-2f7d97af12ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:35.049950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20e62435-82bf-4ee7-bc00-2f7d97af12ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:35.050743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20e62435-82bf-4ee7-bc00-2f7d97af12ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:35.051178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20e62435-82bf-4ee7-bc00-2f7d97af12ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:35.151327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ba15be2b-a10c-4955-bd12-211869f3003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:35.153638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ba15be2b-a10c-4955-bd12-211869f3003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:35.155681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=80 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:35.164731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba15be2b-a10c-4955-bd12-211869f3003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:35.165977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba15be2b-a10c-4955-bd12-211869f3003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:35.167262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba15be2b-a10c-4955-bd12-211869f3003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:35.167910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba15be2b-a10c-4955-bd12-211869f3003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:35.221718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ba15be2b-a10c-4955-bd12-211869f3003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074539 Jul 25 19:34:35.223319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 575/1175] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:35.305318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-20e62435-82bf-4ee7-bc00-2f7d97af12ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:35.313385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-20e62435-82bf-4ee7-bc00-2f7d97af12ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.277502 Jul 25 19:34:35.313983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 601/1176] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:35 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:35.390131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e3e0abb9-eea7-4a38-ba22-355d53aad37e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:35.392474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e3e0abb9-eea7-4a38-ba22-355d53aad37e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:35.400473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e3e0abb9-eea7-4a38-ba22-355d53aad37e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:35.400919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e3e0abb9-eea7-4a38-ba22-355d53aad37e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:35.401702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e3e0abb9-eea7-4a38-ba22-355d53aad37e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:35.402142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e3e0abb9-eea7-4a38-ba22-355d53aad37e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:35.438523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e3e0abb9-eea7-4a38-ba22-355d53aad37e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052249 Jul 25 19:34:35.439420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 576/1177] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:35 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:36.243129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ff313156-6276-4c74-a605-89cf846246b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:36.246730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ff313156-6276-4c74-a605-89cf846246b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:36.259652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff313156-6276-4c74-a605-89cf846246b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:36.260470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff313156-6276-4c74-a605-89cf846246b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:36.262165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff313156-6276-4c74-a605-89cf846246b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:36.262991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff313156-6276-4c74-a605-89cf846246b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:36.324037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ff313156-6276-4c74-a605-89cf846246b3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089647 Jul 25 19:34:36.325058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 602/1178] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:36.337666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2259cea7-60c7-408b-b534-c50f21fa028a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:36.338392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2259cea7-60c7-408b-b534-c50f21fa028a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:36.345241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2259cea7-60c7-408b-b534-c50f21fa028a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:36.345685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2259cea7-60c7-408b-b534-c50f21fa028a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:36.346479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2259cea7-60c7-408b-b534-c50f21fa028a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:36.346923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2259cea7-60c7-408b-b534-c50f21fa028a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:36.455789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-953e6f5b-a7d5-41f0-b474-a7b7a59f0970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:36.460142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-953e6f5b-a7d5-41f0-b474-a7b7a59f0970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:36.470793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-953e6f5b-a7d5-41f0-b474-a7b7a59f0970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:36.471532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-953e6f5b-a7d5-41f0-b474-a7b7a59f0970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:36.472870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-953e6f5b-a7d5-41f0-b474-a7b7a59f0970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:36.473686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-953e6f5b-a7d5-41f0-b474-a7b7a59f0970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:36.509443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2259cea7-60c7-408b-b534-c50f21fa028a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:36.518170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2259cea7-60c7-408b-b534-c50f21fa028a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.185213 Jul 25 19:34:36.519080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 577/1179] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:36 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:36.532229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-953e6f5b-a7d5-41f0-b474-a7b7a59f0970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083282 Jul 25 19:34:36.533300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 603/1180] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:37.342009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4759a46f-b93e-4e9f-b604-e6bfa40b2098 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:37.344483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4759a46f-b93e-4e9f-b604-e6bfa40b2098 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:37.352867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4759a46f-b93e-4e9f-b604-e6bfa40b2098 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:37.353304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4759a46f-b93e-4e9f-b604-e6bfa40b2098 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:37.354076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4759a46f-b93e-4e9f-b604-e6bfa40b2098 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:37.354506 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4759a46f-b93e-4e9f-b604-e6bfa40b2098 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:37.388442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4759a46f-b93e-4e9f-b604-e6bfa40b2098 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050380 Jul 25 19:34:37.389023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 578/1181] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:37.541644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c447e253-420d-4a07-a14b-de5a8d13cb58 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:37.542227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c447e253-420d-4a07-a14b-de5a8d13cb58 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:37.548952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-92df1a90-0588-431f-adc2-8462365636e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:37.552734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c447e253-420d-4a07-a14b-de5a8d13cb58 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:37.553468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c447e253-420d-4a07-a14b-de5a8d13cb58 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:37.554471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-92df1a90-0588-431f-adc2-8462365636e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:37.554733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c447e253-420d-4a07-a14b-de5a8d13cb58 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:37.555490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c447e253-420d-4a07-a14b-de5a8d13cb58 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:37.564708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92df1a90-0588-431f-adc2-8462365636e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:37.565437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92df1a90-0588-431f-adc2-8462365636e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:37.567972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92df1a90-0588-431f-adc2-8462365636e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:37.568700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92df1a90-0588-431f-adc2-8462365636e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:37.616709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-92df1a90-0588-431f-adc2-8462365636e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074915 Jul 25 19:34:37.617789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 579/1182] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:37.725254 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c447e253-420d-4a07-a14b-de5a8d13cb58 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:37.733499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c447e253-420d-4a07-a14b-de5a8d13cb58 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.197706 Jul 25 19:34:37.734090 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 604/1183] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:37 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:38.401731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-84c5d3d3-d205-4760-bc78-801a96269e7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:38.404081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-84c5d3d3-d205-4760-bc78-801a96269e7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:38.411669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84c5d3d3-d205-4760-bc78-801a96269e7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:38.412267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84c5d3d3-d205-4760-bc78-801a96269e7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:38.413673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84c5d3d3-d205-4760-bc78-801a96269e7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:38.414121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84c5d3d3-d205-4760-bc78-801a96269e7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:38.450337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-84c5d3d3-d205-4760-bc78-801a96269e7f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052483 Jul 25 19:34:38.450923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 580/1184] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:38 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:38.631939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9620a6dc-7848-4486-89e9-43c7504623e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:38.634266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9620a6dc-7848-4486-89e9-43c7504623e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:38.641470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9620a6dc-7848-4486-89e9-43c7504623e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:38.641950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9620a6dc-7848-4486-89e9-43c7504623e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:38.642736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9620a6dc-7848-4486-89e9-43c7504623e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:38.643167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9620a6dc-7848-4486-89e9-43c7504623e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:38.680171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9620a6dc-7848-4486-89e9-43c7504623e8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053296 Jul 25 19:34:38.680677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 605/1185] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:38.757638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cba27380-1d29-4265-9c92-f39cf3865a07 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:38.758233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cba27380-1d29-4265-9c92-f39cf3865a07 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:38.765730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cba27380-1d29-4265-9c92-f39cf3865a07 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:38.766167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cba27380-1d29-4265-9c92-f39cf3865a07 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:38.766946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cba27380-1d29-4265-9c92-f39cf3865a07 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:38.767380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cba27380-1d29-4265-9c92-f39cf3865a07 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:38.922760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cba27380-1d29-4265-9c92-f39cf3865a07 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:38.932664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cba27380-1d29-4265-9c92-f39cf3865a07 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.179117 Jul 25 19:34:38.933250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 581/1186] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:38 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:39.466030 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-45c9c29f-2e3e-451a-87af-adeca9afe5ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:39.468780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-45c9c29f-2e3e-451a-87af-adeca9afe5ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:39.476402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45c9c29f-2e3e-451a-87af-adeca9afe5ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:39.476845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45c9c29f-2e3e-451a-87af-adeca9afe5ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:39.477624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45c9c29f-2e3e-451a-87af-adeca9afe5ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:39.478055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45c9c29f-2e3e-451a-87af-adeca9afe5ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:39.512971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-45c9c29f-2e3e-451a-87af-adeca9afe5ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051047 Jul 25 19:34:39.513558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 606/1187] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:39.693763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dceb09cf-e203-48c6-9fbb-b801b284ecd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:39.696175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dceb09cf-e203-48c6-9fbb-b801b284ecd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:39.702641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dceb09cf-e203-48c6-9fbb-b801b284ecd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:39.703086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dceb09cf-e203-48c6-9fbb-b801b284ecd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:39.703899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dceb09cf-e203-48c6-9fbb-b801b284ecd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:39.704333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dceb09cf-e203-48c6-9fbb-b801b284ecd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:39.740721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dceb09cf-e203-48c6-9fbb-b801b284ecd7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051549 Jul 25 19:34:39.741413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 582/1188] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:39.956071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-123df2d4-666c-44f0-9a58-66bac7093c36 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:39.957725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-123df2d4-666c-44f0-9a58-66bac7093c36 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:39.964565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-123df2d4-666c-44f0-9a58-66bac7093c36 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:39.965123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-123df2d4-666c-44f0-9a58-66bac7093c36 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:39.965982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-123df2d4-666c-44f0-9a58-66bac7093c36 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:39.966461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-123df2d4-666c-44f0-9a58-66bac7093c36 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:40.138425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-123df2d4-666c-44f0-9a58-66bac7093c36 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:40.147665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-123df2d4-666c-44f0-9a58-66bac7093c36 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.195394 Jul 25 19:34:40.148264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 607/1189] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:39 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:40.526934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cb777069-695d-4842-a44b-f77681a4196d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:40.529198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cb777069-695d-4842-a44b-f77681a4196d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:40.537414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb777069-695d-4842-a44b-f77681a4196d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:40.537921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb777069-695d-4842-a44b-f77681a4196d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:40.538841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb777069-695d-4842-a44b-f77681a4196d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:40.539316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb777069-695d-4842-a44b-f77681a4196d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:40.575752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cb777069-695d-4842-a44b-f77681a4196d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052974 Jul 25 19:34:40.576358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 583/1190] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:40.755297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0d603ad2-1729-4092-91b6-883aeed1df5a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:40.757708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0d603ad2-1729-4092-91b6-883aeed1df5a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:40.764593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d603ad2-1729-4092-91b6-883aeed1df5a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:40.765090 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d603ad2-1729-4092-91b6-883aeed1df5a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:40.765910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d603ad2-1729-4092-91b6-883aeed1df5a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:40.766390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d603ad2-1729-4092-91b6-883aeed1df5a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:40.807935 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0d603ad2-1729-4092-91b6-883aeed1df5a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057700 Jul 25 19:34:40.808526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 608/1191] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:41.173052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e4208536-8304-43a7-879c-d0360a21660c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:41.173052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e4208536-8304-43a7-879c-d0360a21660c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:41.181016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4208536-8304-43a7-879c-d0360a21660c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:41.181487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4208536-8304-43a7-879c-d0360a21660c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:41.182274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4208536-8304-43a7-879c-d0360a21660c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:41.182728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4208536-8304-43a7-879c-d0360a21660c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:41.590869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-98f36fee-24fe-42b3-8b04-45eebb3d6926 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:41.594085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-98f36fee-24fe-42b3-8b04-45eebb3d6926 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:41.603829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98f36fee-24fe-42b3-8b04-45eebb3d6926 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:41.604277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98f36fee-24fe-42b3-8b04-45eebb3d6926 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:41.605057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98f36fee-24fe-42b3-8b04-45eebb3d6926 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:41.605488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98f36fee-24fe-42b3-8b04-45eebb3d6926 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:41.639857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e4208536-8304-43a7-879c-d0360a21660c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:41.640733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-98f36fee-24fe-42b3-8b04-45eebb3d6926 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054818 Jul 25 19:34:41.641322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 609/1192] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:41.653658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e4208536-8304-43a7-879c-d0360a21660c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.486829 Jul 25 19:34:41.654706 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 584/1193] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:41 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:41.821585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e2dfdff5-e31c-40ae-aea5-7a918153aa1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:41.823778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e2dfdff5-e31c-40ae-aea5-7a918153aa1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:41.830120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2dfdff5-e31c-40ae-aea5-7a918153aa1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:41.830563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2dfdff5-e31c-40ae-aea5-7a918153aa1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:41.831340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2dfdff5-e31c-40ae-aea5-7a918153aa1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:41.832319 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2dfdff5-e31c-40ae-aea5-7a918153aa1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:41.890478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e2dfdff5-e31c-40ae-aea5-7a918153aa1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073142 Jul 25 19:34:41.891580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 610/1194] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:42.656912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aafd4d23-849e-42cd-a797-ca77b7c1a031 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:42.659189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aafd4d23-849e-42cd-a797-ca77b7c1a031 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:42.667073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aafd4d23-849e-42cd-a797-ca77b7c1a031 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:42.667542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aafd4d23-849e-42cd-a797-ca77b7c1a031 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:42.668494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aafd4d23-849e-42cd-a797-ca77b7c1a031 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:42.668987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aafd4d23-849e-42cd-a797-ca77b7c1a031 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:42.698958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13df0379-5176-4248-81cc-22a7e04bcb1b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:42.699764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-13df0379-5176-4248-81cc-22a7e04bcb1b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:42.705944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aafd4d23-849e-42cd-a797-ca77b7c1a031 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053153 Jul 25 19:34:42.707137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 585/1195] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:42.708054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13df0379-5176-4248-81cc-22a7e04bcb1b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:42.708769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13df0379-5176-4248-81cc-22a7e04bcb1b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:42.709826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13df0379-5176-4248-81cc-22a7e04bcb1b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:42.710463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13df0379-5176-4248-81cc-22a7e04bcb1b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:42.867717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-13df0379-5176-4248-81cc-22a7e04bcb1b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:42.876528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13df0379-5176-4248-81cc-22a7e04bcb1b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.181533 Jul 25 19:34:42.877114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 611/1196] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:42 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:42.905073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-361428dd-5436-4f1f-b5ad-f2f9435a9ff9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:42.907763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-361428dd-5436-4f1f-b5ad-f2f9435a9ff9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:42.915100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-361428dd-5436-4f1f-b5ad-f2f9435a9ff9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:42.915616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-361428dd-5436-4f1f-b5ad-f2f9435a9ff9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:42.916476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-361428dd-5436-4f1f-b5ad-f2f9435a9ff9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:42.916913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-361428dd-5436-4f1f-b5ad-f2f9435a9ff9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:42.951355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-361428dd-5436-4f1f-b5ad-f2f9435a9ff9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050279 Jul 25 19:34:42.952131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 586/1197] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:42 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:43.725487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f54cd2e1-edfa-4bc4-8ba7-c0fc50e2c816 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:43.729172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f54cd2e1-edfa-4bc4-8ba7-c0fc50e2c816 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:43.740858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f54cd2e1-edfa-4bc4-8ba7-c0fc50e2c816 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:43.741562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f54cd2e1-edfa-4bc4-8ba7-c0fc50e2c816 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:43.742834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f54cd2e1-edfa-4bc4-8ba7-c0fc50e2c816 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:43.743584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f54cd2e1-edfa-4bc4-8ba7-c0fc50e2c816 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:43.793576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f54cd2e1-edfa-4bc4-8ba7-c0fc50e2c816 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075877 Jul 25 19:34:43.794197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 612/1198] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:43.903258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-690a3fd2-955c-4c79-9817-6fb40fc809ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:43.904514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-690a3fd2-955c-4c79-9817-6fb40fc809ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:43.915117 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-690a3fd2-955c-4c79-9817-6fb40fc809ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:43.915837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-690a3fd2-955c-4c79-9817-6fb40fc809ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:43.916796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-690a3fd2-955c-4c79-9817-6fb40fc809ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:43.917269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-690a3fd2-955c-4c79-9817-6fb40fc809ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:43.920443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:43.968664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-59c46e81-92df-48cf-ac67-f3ac487e5d7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:43.972379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-59c46e81-92df-48cf-ac67-f3ac487e5d7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:43.983449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59c46e81-92df-48cf-ac67-f3ac487e5d7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:43.984263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59c46e81-92df-48cf-ac67-f3ac487e5d7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:43.985456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59c46e81-92df-48cf-ac67-f3ac487e5d7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:43.986159 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59c46e81-92df-48cf-ac67-f3ac487e5d7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:44.032542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-59c46e81-92df-48cf-ac67-f3ac487e5d7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071108 Jul 25 19:34:44.033289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 613/1199] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:44.083481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-690a3fd2-955c-4c79-9817-6fb40fc809ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:44.093204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-690a3fd2-955c-4c79-9817-6fb40fc809ad tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.196674 Jul 25 19:34:44.093863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 587/1200] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:43 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:44.809630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-98b3b0a7-e16d-46c4-873a-381bbbb5f9ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:44.813801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-98b3b0a7-e16d-46c4-873a-381bbbb5f9ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:44.821299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98b3b0a7-e16d-46c4-873a-381bbbb5f9ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:44.821983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98b3b0a7-e16d-46c4-873a-381bbbb5f9ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:44.822967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98b3b0a7-e16d-46c4-873a-381bbbb5f9ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:44.823539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98b3b0a7-e16d-46c4-873a-381bbbb5f9ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:44.852721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:44.860218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-98b3b0a7-e16d-46c4-873a-381bbbb5f9ee tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056550 Jul 25 19:34:44.860893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 614/1201] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:45.049630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-36f67d16-a8ec-426f-9032-c990cc7f8fd2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:45.052907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-36f67d16-a8ec-426f-9032-c990cc7f8fd2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:45.060324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36f67d16-a8ec-426f-9032-c990cc7f8fd2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:45.060687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36f67d16-a8ec-426f-9032-c990cc7f8fd2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:45.061465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36f67d16-a8ec-426f-9032-c990cc7f8fd2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:45.061896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36f67d16-a8ec-426f-9032-c990cc7f8fd2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:45.094440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-36f67d16-a8ec-426f-9032-c990cc7f8fd2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049043 Jul 25 19:34:45.095023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 588/1202] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:45.119892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-93c5b7aa-a754-4e12-9c53-6a0c7408c0a1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:45.120510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93c5b7aa-a754-4e12-9c53-6a0c7408c0a1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:45.126918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93c5b7aa-a754-4e12-9c53-6a0c7408c0a1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:45.127413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93c5b7aa-a754-4e12-9c53-6a0c7408c0a1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:45.128266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93c5b7aa-a754-4e12-9c53-6a0c7408c0a1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:45.129176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93c5b7aa-a754-4e12-9c53-6a0c7408c0a1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:45.306211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93c5b7aa-a754-4e12-9c53-6a0c7408c0a1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:45.314481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-93c5b7aa-a754-4e12-9c53-6a0c7408c0a1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.198369 Jul 25 19:34:45.315004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 615/1203] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:45 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:45.874533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-54556745-7789-4e9e-89be-a41ef8349f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:45.876976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-54556745-7789-4e9e-89be-a41ef8349f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:45.884978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54556745-7789-4e9e-89be-a41ef8349f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:45.885568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54556745-7789-4e9e-89be-a41ef8349f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:45.886395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54556745-7789-4e9e-89be-a41ef8349f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:45.886881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54556745-7789-4e9e-89be-a41ef8349f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:45.921418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-54556745-7789-4e9e-89be-a41ef8349f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050813 Jul 25 19:34:45.922090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 589/1204] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:46.108430 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ea70e27-a454-4671-a549-cb8c9c9586ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:46.110675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ea70e27-a454-4671-a549-cb8c9c9586ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:46.118621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ea70e27-a454-4671-a549-cb8c9c9586ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:46.119034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ea70e27-a454-4671-a549-cb8c9c9586ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:46.119852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ea70e27-a454-4671-a549-cb8c9c9586ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:46.120288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ea70e27-a454-4671-a549-cb8c9c9586ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:46.155822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ea70e27-a454-4671-a549-cb8c9c9586ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051157 Jul 25 19:34:46.156301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 616/1205] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:46.338492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f0aeea78-1438-4225-9583-fae083f5cea8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:46.339186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f0aeea78-1438-4225-9583-fae083f5cea8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:46.346909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0aeea78-1438-4225-9583-fae083f5cea8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:46.348139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0aeea78-1438-4225-9583-fae083f5cea8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:46.348939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0aeea78-1438-4225-9583-fae083f5cea8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:46.350888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0aeea78-1438-4225-9583-fae083f5cea8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:46.507134 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f0aeea78-1438-4225-9583-fae083f5cea8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:46.515486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f0aeea78-1438-4225-9583-fae083f5cea8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.180871 Jul 25 19:34:46.516205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 590/1206] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:46 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:46.936389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f79cdb4-9b55-4c7f-972b-05a9f9ebb355 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:46.938933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9f79cdb4-9b55-4c7f-972b-05a9f9ebb355 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:46.948736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f79cdb4-9b55-4c7f-972b-05a9f9ebb355 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:46.949239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f79cdb4-9b55-4c7f-972b-05a9f9ebb355 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:46.950138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f79cdb4-9b55-4c7f-972b-05a9f9ebb355 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:46.950645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f79cdb4-9b55-4c7f-972b-05a9f9ebb355 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:46.985057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9f79cdb4-9b55-4c7f-972b-05a9f9ebb355 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053372 Jul 25 19:34:46.985653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 617/1207] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:47.169432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2eb27f90-a065-4227-b816-d22d7c61857c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:47.172068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2eb27f90-a065-4227-b816-d22d7c61857c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:47.180579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2eb27f90-a065-4227-b816-d22d7c61857c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:47.181037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2eb27f90-a065-4227-b816-d22d7c61857c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:47.181844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2eb27f90-a065-4227-b816-d22d7c61857c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:47.182281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2eb27f90-a065-4227-b816-d22d7c61857c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:47.219209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2eb27f90-a065-4227-b816-d22d7c61857c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053993 Jul 25 19:34:47.219782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 591/1208] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:47.540716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-482672e5-d7dc-43a8-92bb-b2df6b39541f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:47.541588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-482672e5-d7dc-43a8-92bb-b2df6b39541f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:47.549835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482672e5-d7dc-43a8-92bb-b2df6b39541f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:47.551048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482672e5-d7dc-43a8-92bb-b2df6b39541f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:47.552213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482672e5-d7dc-43a8-92bb-b2df6b39541f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:47.552655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482672e5-d7dc-43a8-92bb-b2df6b39541f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:47.716126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-482672e5-d7dc-43a8-92bb-b2df6b39541f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:47.725979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-482672e5-d7dc-43a8-92bb-b2df6b39541f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.189482 Jul 25 19:34:47.726850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 618/1209] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:47 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:47.999157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-16ae7a2c-57d2-4aec-9211-4c0766568cbe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:48.001427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-16ae7a2c-57d2-4aec-9211-4c0766568cbe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:48.008632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16ae7a2c-57d2-4aec-9211-4c0766568cbe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:48.009074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16ae7a2c-57d2-4aec-9211-4c0766568cbe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:48.009858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16ae7a2c-57d2-4aec-9211-4c0766568cbe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:48.010291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16ae7a2c-57d2-4aec-9211-4c0766568cbe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:48.044482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-16ae7a2c-57d2-4aec-9211-4c0766568cbe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049720 Jul 25 19:34:48.045079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 592/1210] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:48.233973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-efcbf130-2e68-46d7-8e4d-28e8e0f67da7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:48.236433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-efcbf130-2e68-46d7-8e4d-28e8e0f67da7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:48.245900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efcbf130-2e68-46d7-8e4d-28e8e0f67da7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:48.246399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efcbf130-2e68-46d7-8e4d-28e8e0f67da7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:48.247438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efcbf130-2e68-46d7-8e4d-28e8e0f67da7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:48.247951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efcbf130-2e68-46d7-8e4d-28e8e0f67da7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:48.282365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-efcbf130-2e68-46d7-8e4d-28e8e0f67da7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052559 Jul 25 19:34:48.283175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 619/1211] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:48.750149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-33335e1d-5013-48cd-88da-79a2d145728d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:48.751259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-33335e1d-5013-48cd-88da-79a2d145728d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:48.758908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33335e1d-5013-48cd-88da-79a2d145728d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:48.759352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33335e1d-5013-48cd-88da-79a2d145728d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:48.760185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33335e1d-5013-48cd-88da-79a2d145728d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:48.760622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33335e1d-5013-48cd-88da-79a2d145728d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:48.925784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-33335e1d-5013-48cd-88da-79a2d145728d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:48.933963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-33335e1d-5013-48cd-88da-79a2d145728d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.187864 Jul 25 19:34:48.934549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 593/1212] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:48 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:49.058174 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-55af7fae-4d16-4c7e-9313-7ab4b30259bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:49.060543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-55af7fae-4d16-4c7e-9313-7ab4b30259bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:49.068825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55af7fae-4d16-4c7e-9313-7ab4b30259bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:49.069428 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55af7fae-4d16-4c7e-9313-7ab4b30259bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:49.070368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55af7fae-4d16-4c7e-9313-7ab4b30259bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:49.070936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55af7fae-4d16-4c7e-9313-7ab4b30259bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:49.106230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-55af7fae-4d16-4c7e-9313-7ab4b30259bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051982 Jul 25 19:34:49.106823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 620/1213] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:49.295381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-29ea0e37-5c3a-4423-b4a0-66b1d46870e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:49.298087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-29ea0e37-5c3a-4423-b4a0-66b1d46870e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:49.305922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29ea0e37-5c3a-4423-b4a0-66b1d46870e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:49.306570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29ea0e37-5c3a-4423-b4a0-66b1d46870e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:49.307443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29ea0e37-5c3a-4423-b4a0-66b1d46870e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:49.307998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29ea0e37-5c3a-4423-b4a0-66b1d46870e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:49.341868 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-29ea0e37-5c3a-4423-b4a0-66b1d46870e1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050477 Jul 25 19:34:49.342548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 594/1214] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:49.969097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd146942-7359-42c1-9ae7-de0c5f2cc863 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:49.970210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd146942-7359-42c1-9ae7-de0c5f2cc863 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:49.982424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd146942-7359-42c1-9ae7-de0c5f2cc863 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:49.983192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd146942-7359-42c1-9ae7-de0c5f2cc863 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:49.984638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd146942-7359-42c1-9ae7-de0c5f2cc863 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:49.985417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd146942-7359-42c1-9ae7-de0c5f2cc863 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:50.121185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-de09be7c-1076-4dcb-8fcf-3f296d450a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:50.123977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-de09be7c-1076-4dcb-8fcf-3f296d450a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:50.133221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de09be7c-1076-4dcb-8fcf-3f296d450a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:50.133672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de09be7c-1076-4dcb-8fcf-3f296d450a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:50.134472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de09be7c-1076-4dcb-8fcf-3f296d450a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:50.134911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de09be7c-1076-4dcb-8fcf-3f296d450a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:50.170064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd146942-7359-42c1-9ae7-de0c5f2cc863 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:50.176495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-de09be7c-1076-4dcb-8fcf-3f296d450a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058511 Jul 25 19:34:50.177526 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 595/1215] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:50.184756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd146942-7359-42c1-9ae7-de0c5f2cc863 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.222827 Jul 25 19:34:50.185487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 621/1216] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:49 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:50.356838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-972a878e-555d-4105-8181-64f600714fa4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:50.359138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-972a878e-555d-4105-8181-64f600714fa4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:50.367369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-972a878e-555d-4105-8181-64f600714fa4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:50.367908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-972a878e-555d-4105-8181-64f600714fa4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:50.368758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-972a878e-555d-4105-8181-64f600714fa4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:50.369343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-972a878e-555d-4105-8181-64f600714fa4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:50.427205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-972a878e-555d-4105-8181-64f600714fa4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074142 Jul 25 19:34:50.428321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 596/1217] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:51.196439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f3bc5b0a-20d2-46e2-8622-c162267a4803 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:51.199773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f3bc5b0a-20d2-46e2-8622-c162267a4803 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:51.203155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=82 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:51.208028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-07f8689d-f423-4213-ac11-600b7f184de6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:51.208546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-07f8689d-f423-4213-ac11-600b7f184de6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:51.212339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3bc5b0a-20d2-46e2-8622-c162267a4803 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:51.213165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3bc5b0a-20d2-46e2-8622-c162267a4803 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:51.214534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3bc5b0a-20d2-46e2-8622-c162267a4803 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:51.215363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3bc5b0a-20d2-46e2-8622-c162267a4803 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:51.215689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07f8689d-f423-4213-ac11-600b7f184de6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:51.216148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07f8689d-f423-4213-ac11-600b7f184de6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:51.217510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07f8689d-f423-4213-ac11-600b7f184de6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:51.218148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07f8689d-f423-4213-ac11-600b7f184de6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:51.259012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f3bc5b0a-20d2-46e2-8622-c162267a4803 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069970 Jul 25 19:34:51.260542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 622/1218] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:51.402820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-07f8689d-f423-4213-ac11-600b7f184de6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:51.411545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-07f8689d-f423-4213-ac11-600b7f184de6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.208246 Jul 25 19:34:51.412404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 597/1219] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:51 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:51.443875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bc49d6f7-b7a1-431e-ba2e-b757458b5d32 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:51.446140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bc49d6f7-b7a1-431e-ba2e-b757458b5d32 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:51.452734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc49d6f7-b7a1-431e-ba2e-b757458b5d32 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:51.453578 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc49d6f7-b7a1-431e-ba2e-b757458b5d32 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:51.453953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc49d6f7-b7a1-431e-ba2e-b757458b5d32 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:51.454393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc49d6f7-b7a1-431e-ba2e-b757458b5d32 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:51.506390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bc49d6f7-b7a1-431e-ba2e-b757458b5d32 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067351 Jul 25 19:34:51.507374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 623/1220] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:52.273052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-59fffab5-0811-4f22-8d3a-465f3d947c46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:52.275326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-59fffab5-0811-4f22-8d3a-465f3d947c46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:52.282247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59fffab5-0811-4f22-8d3a-465f3d947c46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:52.282700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59fffab5-0811-4f22-8d3a-465f3d947c46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:52.283502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59fffab5-0811-4f22-8d3a-465f3d947c46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:52.283978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59fffab5-0811-4f22-8d3a-465f3d947c46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:52.319956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-59fffab5-0811-4f22-8d3a-465f3d947c46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051828 Jul 25 19:34:52.320569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 598/1221] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:52 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:52.435478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-605d959c-d60e-4f7f-8099-4adfc2b3ffa2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:52.436257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-605d959c-d60e-4f7f-8099-4adfc2b3ffa2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:52.445566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-605d959c-d60e-4f7f-8099-4adfc2b3ffa2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:52.446026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-605d959c-d60e-4f7f-8099-4adfc2b3ffa2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:52.446893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-605d959c-d60e-4f7f-8099-4adfc2b3ffa2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:52.447330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-605d959c-d60e-4f7f-8099-4adfc2b3ffa2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:52.519893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-49f21eab-6c97-4419-8365-04e1306088c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:52.522752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-49f21eab-6c97-4419-8365-04e1306088c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:52.529515 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49f21eab-6c97-4419-8365-04e1306088c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:52.529972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49f21eab-6c97-4419-8365-04e1306088c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:52.530783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49f21eab-6c97-4419-8365-04e1306088c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:52.531230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49f21eab-6c97-4419-8365-04e1306088c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:52.564687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-49f21eab-6c97-4419-8365-04e1306088c0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050038 Jul 25 19:34:52.565476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 599/1222] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:52 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:52.632217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-605d959c-d60e-4f7f-8099-4adfc2b3ffa2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:52.640910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-605d959c-d60e-4f7f-8099-4adfc2b3ffa2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.210707 Jul 25 19:34:52.641513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 624/1223] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:52 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:53.334375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-52f739eb-2f4d-4f8b-9193-8fb0f35cb331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:53.336745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-52f739eb-2f4d-4f8b-9193-8fb0f35cb331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:53.343925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-52f739eb-2f4d-4f8b-9193-8fb0f35cb331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:53.344373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-52f739eb-2f4d-4f8b-9193-8fb0f35cb331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:53.345153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-52f739eb-2f4d-4f8b-9193-8fb0f35cb331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:53.345588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-52f739eb-2f4d-4f8b-9193-8fb0f35cb331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:53.381924 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-52f739eb-2f4d-4f8b-9193-8fb0f35cb331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052621 Jul 25 19:34:53.382519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 600/1224] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:53.579390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-628cded9-4b66-41df-8c07-9a21791b5197 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:53.581796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-628cded9-4b66-41df-8c07-9a21791b5197 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:53.589988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-628cded9-4b66-41df-8c07-9a21791b5197 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:53.590322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-628cded9-4b66-41df-8c07-9a21791b5197 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:53.591224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-628cded9-4b66-41df-8c07-9a21791b5197 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:53.591966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-628cded9-4b66-41df-8c07-9a21791b5197 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:53.634326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-628cded9-4b66-41df-8c07-9a21791b5197 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058964 Jul 25 19:34:53.634938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 625/1225] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:53.663773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ca8910a1-c2f2-49f2-b480-fca35ed8c192 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:53.664615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ca8910a1-c2f2-49f2-b480-fca35ed8c192 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:53.671072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca8910a1-c2f2-49f2-b480-fca35ed8c192 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:53.671539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca8910a1-c2f2-49f2-b480-fca35ed8c192 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:53.672362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca8910a1-c2f2-49f2-b480-fca35ed8c192 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:53.672805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca8910a1-c2f2-49f2-b480-fca35ed8c192 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:53.853256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ca8910a1-c2f2-49f2-b480-fca35ed8c192 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:53.862149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ca8910a1-c2f2-49f2-b480-fca35ed8c192 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.203386 Jul 25 19:34:53.862823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 601/1226] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:53 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:54.395122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c5e145b1-5637-477b-89b2-c6f3bcf7a259 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:54.397523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c5e145b1-5637-477b-89b2-c6f3bcf7a259 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:54.404597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5e145b1-5637-477b-89b2-c6f3bcf7a259 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:54.405098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5e145b1-5637-477b-89b2-c6f3bcf7a259 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:54.405935 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5e145b1-5637-477b-89b2-c6f3bcf7a259 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:54.406413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5e145b1-5637-477b-89b2-c6f3bcf7a259 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:54.448787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c5e145b1-5637-477b-89b2-c6f3bcf7a259 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057809 Jul 25 19:34:54.449286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 626/1227] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:54.653905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3d17e217-d1b6-488c-a72f-e20890e919a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:54.657049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3d17e217-d1b6-488c-a72f-e20890e919a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:54.667620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d17e217-d1b6-488c-a72f-e20890e919a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:54.668358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d17e217-d1b6-488c-a72f-e20890e919a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:54.669200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d17e217-d1b6-488c-a72f-e20890e919a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:54.669650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d17e217-d1b6-488c-a72f-e20890e919a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:54.708959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3d17e217-d1b6-488c-a72f-e20890e919a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061854 Jul 25 19:34:54.709477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 602/1228] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:54.888461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4652379-5534-47a5-a3ea-116a707145a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:54.889142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c4652379-5534-47a5-a3ea-116a707145a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:54.897118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4652379-5534-47a5-a3ea-116a707145a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:54.897566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4652379-5534-47a5-a3ea-116a707145a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:54.898345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4652379-5534-47a5-a3ea-116a707145a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:54.898778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4652379-5534-47a5-a3ea-116a707145a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:55.076398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c4652379-5534-47a5-a3ea-116a707145a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:55.085259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c4652379-5534-47a5-a3ea-116a707145a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.200737 Jul 25 19:34:55.085877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 627/1229] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:54 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:55.462701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0a4b5531-3890-43c4-a8d7-41c253aa0cae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:55.464995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0a4b5531-3890-43c4-a8d7-41c253aa0cae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:55.471405 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a4b5531-3890-43c4-a8d7-41c253aa0cae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:55.471902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a4b5531-3890-43c4-a8d7-41c253aa0cae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:55.472689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a4b5531-3890-43c4-a8d7-41c253aa0cae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:55.473132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a4b5531-3890-43c4-a8d7-41c253aa0cae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:55.500873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:55.509213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0a4b5531-3890-43c4-a8d7-41c253aa0cae tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050707 Jul 25 19:34:55.509812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 603/1230] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:34:55.722143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3e9cfb65-2512-4564-a5a5-82452091fa7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:55.724323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3e9cfb65-2512-4564-a5a5-82452091fa7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:55.731211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e9cfb65-2512-4564-a5a5-82452091fa7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:55.731692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e9cfb65-2512-4564-a5a5-82452091fa7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:55.732472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e9cfb65-2512-4564-a5a5-82452091fa7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:55.732910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e9cfb65-2512-4564-a5a5-82452091fa7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:55.774436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3e9cfb65-2512-4564-a5a5-82452091fa7b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056084 Jul 25 19:34:55.775482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 628/1231] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:34:56.115596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0d4f1219-954e-4bd1-bff7-606064d4c358 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:56.116664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0d4f1219-954e-4bd1-bff7-606064d4c358 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:56.129206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4f1219-954e-4bd1-bff7-606064d4c358 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:56.130021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4f1219-954e-4bd1-bff7-606064d4c358 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:56.131495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4f1219-954e-4bd1-bff7-606064d4c358 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:56.132308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4f1219-954e-4bd1-bff7-606064d4c358 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:56.347812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0d4f1219-954e-4bd1-bff7-606064d4c358 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:56.361172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0d4f1219-954e-4bd1-bff7-606064d4c358 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.253387 Jul 25 19:34:56.362132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 604/1232] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:56 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:56.522974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9edd9b69-30ef-492d-9704-c6debcd8f87e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:56.525248 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9edd9b69-30ef-492d-9704-c6debcd8f87e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:56.532231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9edd9b69-30ef-492d-9704-c6debcd8f87e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:56.532672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9edd9b69-30ef-492d-9704-c6debcd8f87e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:56.533455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9edd9b69-30ef-492d-9704-c6debcd8f87e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:56.533893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9edd9b69-30ef-492d-9704-c6debcd8f87e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:56.587013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9edd9b69-30ef-492d-9704-c6debcd8f87e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068557 Jul 25 19:34:56.587832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 629/1233] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:56 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:56.797008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7e194641-9956-4239-82b6-642171c3c9f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:56.801007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7e194641-9956-4239-82b6-642171c3c9f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:56.809376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7e194641-9956-4239-82b6-642171c3c9f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:56.809891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7e194641-9956-4239-82b6-642171c3c9f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:56.810700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7e194641-9956-4239-82b6-642171c3c9f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:56.811146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7e194641-9956-4239-82b6-642171c3c9f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:56.843995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7e194641-9956-4239-82b6-642171c3c9f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053327 Jul 25 19:34:56.844596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 605/1234] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:57.386495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f071e472-375c-4720-963c-3064266c4609 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:57.387105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f071e472-375c-4720-963c-3064266c4609 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:57.395018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f071e472-375c-4720-963c-3064266c4609 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:57.395500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f071e472-375c-4720-963c-3064266c4609 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:57.396447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f071e472-375c-4720-963c-3064266c4609 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:57.396933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f071e472-375c-4720-963c-3064266c4609 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:57.562429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f071e472-375c-4720-963c-3064266c4609 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:57.571879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f071e472-375c-4720-963c-3064266c4609 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.189641 Jul 25 19:34:57.572622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 630/1235] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:57 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:57.603883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7b58443a-4839-4775-957f-172bf2c82f40 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:57.606556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7b58443a-4839-4775-957f-172bf2c82f40 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:57.615153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7b58443a-4839-4775-957f-172bf2c82f40 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:57.615642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7b58443a-4839-4775-957f-172bf2c82f40 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:57.616457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7b58443a-4839-4775-957f-172bf2c82f40 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:57.616894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7b58443a-4839-4775-957f-172bf2c82f40 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:57.650082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7b58443a-4839-4775-957f-172bf2c82f40 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050656 Jul 25 19:34:57.650555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 606/1236] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:57.857715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ca8f929-246f-4ec0-b321-552ce7f604e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:57.859979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ca8f929-246f-4ec0-b321-552ce7f604e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:57.866448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ca8f929-246f-4ec0-b321-552ce7f604e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:57.866905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ca8f929-246f-4ec0-b321-552ce7f604e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:57.867770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ca8f929-246f-4ec0-b321-552ce7f604e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:57.868238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ca8f929-246f-4ec0-b321-552ce7f604e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:57.885686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:57.904778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ca8f929-246f-4ec0-b321-552ce7f604e6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051069 Jul 25 19:34:57.905606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 631/1237] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:58.594635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8dcb6dee-24b0-44ef-be83-3c307dc1aa6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:58.595255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8dcb6dee-24b0-44ef-be83-3c307dc1aa6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:58.602855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8dcb6dee-24b0-44ef-be83-3c307dc1aa6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:58.603304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8dcb6dee-24b0-44ef-be83-3c307dc1aa6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:58.604147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8dcb6dee-24b0-44ef-be83-3c307dc1aa6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:58.604975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8dcb6dee-24b0-44ef-be83-3c307dc1aa6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:58.668072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7253b5e6-cbfb-4555-92cf-f51679afbb34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:58.672015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7253b5e6-cbfb-4555-92cf-f51679afbb34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:58.686085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7253b5e6-cbfb-4555-92cf-f51679afbb34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:58.687063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7253b5e6-cbfb-4555-92cf-f51679afbb34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:58.688403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7253b5e6-cbfb-4555-92cf-f51679afbb34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:58.689115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7253b5e6-cbfb-4555-92cf-f51679afbb34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:58.749805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7253b5e6-cbfb-4555-92cf-f51679afbb34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090058 Jul 25 19:34:58.751019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 632/1238] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:58.776439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8dcb6dee-24b0-44ef-be83-3c307dc1aa6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:58.785441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8dcb6dee-24b0-44ef-be83-3c307dc1aa6f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.194116 Jul 25 19:34:58.786144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 607/1239] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:58 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:58.881438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:34:58.881684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:34:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:34:58.917417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c52a72d7-afc3-4a71-8f55-c059d32bae1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:58.919626 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c52a72d7-afc3-4a71-8f55-c059d32bae1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:58.927102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c52a72d7-afc3-4a71-8f55-c059d32bae1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:58.927576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c52a72d7-afc3-4a71-8f55-c059d32bae1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:58.928353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c52a72d7-afc3-4a71-8f55-c059d32bae1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:58.928786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c52a72d7-afc3-4a71-8f55-c059d32bae1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:58.964247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c52a72d7-afc3-4a71-8f55-c059d32bae1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050527 Jul 25 19:34:58.964840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 633/1240] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:59.764664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-960616bd-5500-478e-b5b7-4597fd433b42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:59.766993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-960616bd-5500-478e-b5b7-4597fd433b42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:59.774311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-960616bd-5500-478e-b5b7-4597fd433b42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:59.774753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-960616bd-5500-478e-b5b7-4597fd433b42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:59.775548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-960616bd-5500-478e-b5b7-4597fd433b42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:59.775984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-960616bd-5500-478e-b5b7-4597fd433b42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:59.811750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-960616bd-5500-478e-b5b7-4597fd433b42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050942 Jul 25 19:34:59.812353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 608/1241] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:34:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:34:59.812699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-71d8045b-cf37-4803-87d6-85116d69992a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:59.813808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-71d8045b-cf37-4803-87d6-85116d69992a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:59.821843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71d8045b-cf37-4803-87d6-85116d69992a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:59.822295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71d8045b-cf37-4803-87d6-85116d69992a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:59.823170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71d8045b-cf37-4803-87d6-85116d69992a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:59.823825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71d8045b-cf37-4803-87d6-85116d69992a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:59.979902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b65b504c-c9d6-410d-babf-cea3a1f13740 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:59.983113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b65b504c-c9d6-410d-babf-cea3a1f13740 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:59.984707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-71d8045b-cf37-4803-87d6-85116d69992a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:59.991378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b65b504c-c9d6-410d-babf-cea3a1f13740 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:59.992423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b65b504c-c9d6-410d-babf-cea3a1f13740 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:59.993860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b65b504c-c9d6-410d-babf-cea3a1f13740 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:59.994633 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b65b504c-c9d6-410d-babf-cea3a1f13740 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:59.996671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-71d8045b-cf37-4803-87d6-85116d69992a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.188674 Jul 25 19:34:59.998729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 634/1242] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:59 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:00.030615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b65b504c-c9d6-410d-babf-cea3a1f13740 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055390 Jul 25 19:35:00.031217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 609/1243] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:34:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:00.827581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5f455ba1-048a-4dac-9cb8-f96637569c4f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:00.830165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5f455ba1-048a-4dac-9cb8-f96637569c4f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:00.837280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f455ba1-048a-4dac-9cb8-f96637569c4f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:00.837729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f455ba1-048a-4dac-9cb8-f96637569c4f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:00.838540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f455ba1-048a-4dac-9cb8-f96637569c4f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:00.838969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f455ba1-048a-4dac-9cb8-f96637569c4f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:00.875358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5f455ba1-048a-4dac-9cb8-f96637569c4f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051763 Jul 25 19:35:00.875974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 635/1244] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:01.031264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bf2dcf67-8973-4832-8127-86b71b2e8bb3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:01.032308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bf2dcf67-8973-4832-8127-86b71b2e8bb3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:01.042229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf2dcf67-8973-4832-8127-86b71b2e8bb3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:01.042955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf2dcf67-8973-4832-8127-86b71b2e8bb3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:01.044330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf2dcf67-8973-4832-8127-86b71b2e8bb3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:01.045056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf2dcf67-8973-4832-8127-86b71b2e8bb3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:01.048669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ce174c2d-d9a4-4adc-955f-8903bedeb100 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:01.055106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ce174c2d-d9a4-4adc-955f-8903bedeb100 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:01.065035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce174c2d-d9a4-4adc-955f-8903bedeb100 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:01.067646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce174c2d-d9a4-4adc-955f-8903bedeb100 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:01.069987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce174c2d-d9a4-4adc-955f-8903bedeb100 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:01.071064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce174c2d-d9a4-4adc-955f-8903bedeb100 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:01.131988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ce174c2d-d9a4-4adc-955f-8903bedeb100 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090172 Jul 25 19:35:01.138869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 636/1245] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:01.267267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bf2dcf67-8973-4832-8127-86b71b2e8bb3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:01.276564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bf2dcf67-8973-4832-8127-86b71b2e8bb3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.249700 Jul 25 19:35:01.277162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 610/1246] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:01 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:01.889754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bbd2ab74-3601-45a0-8156-1b2b2bc05c62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:01.892542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bbd2ab74-3601-45a0-8156-1b2b2bc05c62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:01.900841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bbd2ab74-3601-45a0-8156-1b2b2bc05c62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:01.901336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bbd2ab74-3601-45a0-8156-1b2b2bc05c62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:01.902760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bbd2ab74-3601-45a0-8156-1b2b2bc05c62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:01.902760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bbd2ab74-3601-45a0-8156-1b2b2bc05c62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:01.937883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bbd2ab74-3601-45a0-8156-1b2b2bc05c62 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052348 Jul 25 19:35:01.938479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 637/1247] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:01 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:02.146900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-22844405-00c8-4a00-92b7-c04e69f57f42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:02.149034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-22844405-00c8-4a00-92b7-c04e69f57f42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:02.156024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-22844405-00c8-4a00-92b7-c04e69f57f42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:02.156481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-22844405-00c8-4a00-92b7-c04e69f57f42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:02.157311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-22844405-00c8-4a00-92b7-c04e69f57f42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:02.157733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-22844405-00c8-4a00-92b7-c04e69f57f42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:02.197133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-22844405-00c8-4a00-92b7-c04e69f57f42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054350 Jul 25 19:35:02.198036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 611/1248] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:02.309196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3ad57068-6950-4547-a38b-442f457875e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:02.309856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3ad57068-6950-4547-a38b-442f457875e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:02.317379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ad57068-6950-4547-a38b-442f457875e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:02.318081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ad57068-6950-4547-a38b-442f457875e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:02.318881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ad57068-6950-4547-a38b-442f457875e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:02.319322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ad57068-6950-4547-a38b-442f457875e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:02.475465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3ad57068-6950-4547-a38b-442f457875e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:02.484400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3ad57068-6950-4547-a38b-442f457875e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.178977 Jul 25 19:35:02.485163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 638/1249] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:02 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:02.958007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5c3ba7cf-0c72-4635-ad12-d41e6102eb0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:02.962867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5c3ba7cf-0c72-4635-ad12-d41e6102eb0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:02.979045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c3ba7cf-0c72-4635-ad12-d41e6102eb0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:02.979910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c3ba7cf-0c72-4635-ad12-d41e6102eb0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:02.981388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c3ba7cf-0c72-4635-ad12-d41e6102eb0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:02.982165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c3ba7cf-0c72-4635-ad12-d41e6102eb0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:03.041873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5c3ba7cf-0c72-4635-ad12-d41e6102eb0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092363 Jul 25 19:35:03.042968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 612/1250] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:03.307601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cf322a48-ab42-4366-a0c9-45e98e75fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:03.311281 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cf322a48-ab42-4366-a0c9-45e98e75fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:03.319232 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf322a48-ab42-4366-a0c9-45e98e75fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:03.319714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf322a48-ab42-4366-a0c9-45e98e75fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:03.320518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf322a48-ab42-4366-a0c9-45e98e75fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:03.320943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf322a48-ab42-4366-a0c9-45e98e75fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:03.357680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cf322a48-ab42-4366-a0c9-45e98e75fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149901 Jul 25 19:35:03.358273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 639/1251] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:03 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:03.508800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2585cfb2-6da9-4371-a335-a9d7e1e0c5d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:03.509493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2585cfb2-6da9-4371-a335-a9d7e1e0c5d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:03.516575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2585cfb2-6da9-4371-a335-a9d7e1e0c5d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:03.517017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2585cfb2-6da9-4371-a335-a9d7e1e0c5d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:03.517791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2585cfb2-6da9-4371-a335-a9d7e1e0c5d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:03.518385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2585cfb2-6da9-4371-a335-a9d7e1e0c5d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:03.682394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2585cfb2-6da9-4371-a335-a9d7e1e0c5d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:03.690569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2585cfb2-6da9-4371-a335-a9d7e1e0c5d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.186053 Jul 25 19:35:03.691724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 613/1252] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:03 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:04.058824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a5cf632a-e9bc-4301-b8af-ee63279d6059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:04.061134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a5cf632a-e9bc-4301-b8af-ee63279d6059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:04.068871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5cf632a-e9bc-4301-b8af-ee63279d6059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:04.069322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5cf632a-e9bc-4301-b8af-ee63279d6059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:04.070120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5cf632a-e9bc-4301-b8af-ee63279d6059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:04.070555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5cf632a-e9bc-4301-b8af-ee63279d6059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:04.105118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a5cf632a-e9bc-4301-b8af-ee63279d6059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050387 Jul 25 19:35:04.105711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 640/1253] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:04.375419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-348951f1-636e-40f6-a372-2fe058cca588 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:04.379570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-348951f1-636e-40f6-a372-2fe058cca588 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:04.389160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-348951f1-636e-40f6-a372-2fe058cca588 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:04.389806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-348951f1-636e-40f6-a372-2fe058cca588 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:04.390973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-348951f1-636e-40f6-a372-2fe058cca588 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:04.391651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-348951f1-636e-40f6-a372-2fe058cca588 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:04.444033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-348951f1-636e-40f6-a372-2fe058cca588 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075622 Jul 25 19:35:04.444708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 614/1254] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:04.715916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-467acaa1-b059-49a3-a767-4c632da58585 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:04.716798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-467acaa1-b059-49a3-a767-4c632da58585 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:04.725027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-467acaa1-b059-49a3-a767-4c632da58585 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:04.725773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-467acaa1-b059-49a3-a767-4c632da58585 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:04.727336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-467acaa1-b059-49a3-a767-4c632da58585 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:04.727821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-467acaa1-b059-49a3-a767-4c632da58585 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:04.914209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-467acaa1-b059-49a3-a767-4c632da58585 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:04.922701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-467acaa1-b059-49a3-a767-4c632da58585 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.212786 Jul 25 19:35:04.923311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 641/1255] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:04 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:05.118906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e2fe5347-04b4-416b-8de7-ca956da834a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:05.121812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e2fe5347-04b4-416b-8de7-ca956da834a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:05.130098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2fe5347-04b4-416b-8de7-ca956da834a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:05.130677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2fe5347-04b4-416b-8de7-ca956da834a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:05.131799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2fe5347-04b4-416b-8de7-ca956da834a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:05.132339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2fe5347-04b4-416b-8de7-ca956da834a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:05.169010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e2fe5347-04b4-416b-8de7-ca956da834a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054892 Jul 25 19:35:05.169713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 615/1256] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:05.460187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-776bd37d-8f4f-4d67-b3e1-cabfe1c523f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:05.462951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-776bd37d-8f4f-4d67-b3e1-cabfe1c523f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:05.469756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776bd37d-8f4f-4d67-b3e1-cabfe1c523f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:05.470255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776bd37d-8f4f-4d67-b3e1-cabfe1c523f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:05.471109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776bd37d-8f4f-4d67-b3e1-cabfe1c523f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:05.471703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776bd37d-8f4f-4d67-b3e1-cabfe1c523f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:05.515268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-776bd37d-8f4f-4d67-b3e1-cabfe1c523f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060993 Jul 25 19:35:05.516483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 642/1257] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:05.950824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9d564104-e1ee-44db-a2ea-da9b20ff8b1f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:05.951964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9d564104-e1ee-44db-a2ea-da9b20ff8b1f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:05.955000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=82 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:05.966311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d564104-e1ee-44db-a2ea-da9b20ff8b1f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:05.967113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d564104-e1ee-44db-a2ea-da9b20ff8b1f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:05.968519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d564104-e1ee-44db-a2ea-da9b20ff8b1f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:05.969328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d564104-e1ee-44db-a2ea-da9b20ff8b1f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:06.183444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4472ae89-1e90-4486-bc3a-47a1a26def47 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:06.185842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4472ae89-1e90-4486-bc3a-47a1a26def47 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:06.190110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9d564104-e1ee-44db-a2ea-da9b20ff8b1f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:06.194608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4472ae89-1e90-4486-bc3a-47a1a26def47 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:06.195047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4472ae89-1e90-4486-bc3a-47a1a26def47 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:06.195888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4472ae89-1e90-4486-bc3a-47a1a26def47 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:06.196331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4472ae89-1e90-4486-bc3a-47a1a26def47 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:06.205769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9d564104-e1ee-44db-a2ea-da9b20ff8b1f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.261309 Jul 25 19:35:06.207564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 616/1258] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:05 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:06.238481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4472ae89-1e90-4486-bc3a-47a1a26def47 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058372 Jul 25 19:35:06.239314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 643/1259] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:06.529154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-950dfc77-6baa-4978-9b2b-f43810bf684a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:06.531381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-950dfc77-6baa-4978-9b2b-f43810bf684a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:06.538795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-950dfc77-6baa-4978-9b2b-f43810bf684a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:06.539397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-950dfc77-6baa-4978-9b2b-f43810bf684a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:06.540341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-950dfc77-6baa-4978-9b2b-f43810bf684a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:06.541021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-950dfc77-6baa-4978-9b2b-f43810bf684a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:06.575675 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-950dfc77-6baa-4978-9b2b-f43810bf684a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050555 Jul 25 19:35:06.576364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 617/1260] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:07.244730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-09c00dc3-1487-4c99-aed6-9e44328e4279 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:07.245508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-09c00dc3-1487-4c99-aed6-9e44328e4279 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:07.254401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09c00dc3-1487-4c99-aed6-9e44328e4279 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:07.254907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09c00dc3-1487-4c99-aed6-9e44328e4279 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:07.255448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c5848b72-6fe5-43e8-8345-9649d0a21a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:07.256205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09c00dc3-1487-4c99-aed6-9e44328e4279 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:07.256366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09c00dc3-1487-4c99-aed6-9e44328e4279 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:07.258316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c5848b72-6fe5-43e8-8345-9649d0a21a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:07.267570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5848b72-6fe5-43e8-8345-9649d0a21a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:07.268227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5848b72-6fe5-43e8-8345-9649d0a21a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:07.269153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5848b72-6fe5-43e8-8345-9649d0a21a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:07.269724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5848b72-6fe5-43e8-8345-9649d0a21a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:07.317836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c5848b72-6fe5-43e8-8345-9649d0a21a54 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068510 Jul 25 19:35:07.318854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 618/1261] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:07.425872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-09c00dc3-1487-4c99-aed6-9e44328e4279 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:07.437511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-09c00dc3-1487-4c99-aed6-9e44328e4279 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.196580 Jul 25 19:35:07.438541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 644/1262] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:07 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:07.589283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4fae0df2-b148-4b44-8c96-d946e6bb05a2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:07.591630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4fae0df2-b148-4b44-8c96-d946e6bb05a2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:07.598248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4fae0df2-b148-4b44-8c96-d946e6bb05a2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:07.598692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4fae0df2-b148-4b44-8c96-d946e6bb05a2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:07.599473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4fae0df2-b148-4b44-8c96-d946e6bb05a2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:07.600027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4fae0df2-b148-4b44-8c96-d946e6bb05a2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:07.634584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4fae0df2-b148-4b44-8c96-d946e6bb05a2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049284 Jul 25 19:35:07.635179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 619/1263] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:08.332658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e8cd6638-072c-4b90-ace2-6a40a0fa3a27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:08.335021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e8cd6638-072c-4b90-ace2-6a40a0fa3a27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:08.342104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8cd6638-072c-4b90-ace2-6a40a0fa3a27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:08.342563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8cd6638-072c-4b90-ace2-6a40a0fa3a27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:08.343367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8cd6638-072c-4b90-ace2-6a40a0fa3a27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:08.343832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8cd6638-072c-4b90-ace2-6a40a0fa3a27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:08.474565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0e39f008-5ee8-40cd-95f6-4f5218355c03 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:08.475742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0e39f008-5ee8-40cd-95f6-4f5218355c03 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:08.484638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e39f008-5ee8-40cd-95f6-4f5218355c03 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:08.485244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e39f008-5ee8-40cd-95f6-4f5218355c03 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:08.486166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e39f008-5ee8-40cd-95f6-4f5218355c03 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:08.486802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e39f008-5ee8-40cd-95f6-4f5218355c03 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:08.506701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:08.549463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e8cd6638-072c-4b90-ace2-6a40a0fa3a27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.222013 Jul 25 19:35:08.550067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 645/1264] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:08.649070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c335cfa-f80c-4c57-b47a-460315af571f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:08.651930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c335cfa-f80c-4c57-b47a-460315af571f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:08.656897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0e39f008-5ee8-40cd-95f6-4f5218355c03 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:08.660482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c335cfa-f80c-4c57-b47a-460315af571f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:08.661090 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c335cfa-f80c-4c57-b47a-460315af571f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:08.662095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c335cfa-f80c-4c57-b47a-460315af571f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:08.662585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c335cfa-f80c-4c57-b47a-460315af571f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:08.668626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0e39f008-5ee8-40cd-95f6-4f5218355c03 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.199044 Jul 25 19:35:08.669225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 620/1265] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:08 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:08.712066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c335cfa-f80c-4c57-b47a-460315af571f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067702 Jul 25 19:35:08.712648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 646/1266] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:09.563959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-590f5bbd-e0bc-4e76-8e58-54492b38e554 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:09.567211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-590f5bbd-e0bc-4e76-8e58-54492b38e554 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:09.574666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-590f5bbd-e0bc-4e76-8e58-54492b38e554 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:09.575225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-590f5bbd-e0bc-4e76-8e58-54492b38e554 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:09.576077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-590f5bbd-e0bc-4e76-8e58-54492b38e554 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:09.576523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-590f5bbd-e0bc-4e76-8e58-54492b38e554 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:09.610551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-590f5bbd-e0bc-4e76-8e58-54492b38e554 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051253 Jul 25 19:35:09.611156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 621/1267] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:09.690568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e95c7ab1-5148-43a2-b975-6af92a0fec24 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:09.691959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e95c7ab1-5148-43a2-b975-6af92a0fec24 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:09.699481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e95c7ab1-5148-43a2-b975-6af92a0fec24 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:09.700038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e95c7ab1-5148-43a2-b975-6af92a0fec24 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:09.700889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e95c7ab1-5148-43a2-b975-6af92a0fec24 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:09.701383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e95c7ab1-5148-43a2-b975-6af92a0fec24 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:09.727646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e2ee4af9-8133-4be7-8dd5-e5fec1aa0885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:09.730158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e2ee4af9-8133-4be7-8dd5-e5fec1aa0885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:09.737282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2ee4af9-8133-4be7-8dd5-e5fec1aa0885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:09.738377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2ee4af9-8133-4be7-8dd5-e5fec1aa0885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:09.739180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2ee4af9-8133-4be7-8dd5-e5fec1aa0885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:09.739844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2ee4af9-8133-4be7-8dd5-e5fec1aa0885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:09.776245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e2ee4af9-8133-4be7-8dd5-e5fec1aa0885 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054651 Jul 25 19:35:09.776844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 622/1268] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:09.873409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e95c7ab1-5148-43a2-b975-6af92a0fec24 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:09.883270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e95c7ab1-5148-43a2-b975-6af92a0fec24 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.196615 Jul 25 19:35:09.884022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 647/1269] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:09 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:10.625947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-04462c9a-a0bc-4f1f-a3dd-39f3eb77f5b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:10.629959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-04462c9a-a0bc-4f1f-a3dd-39f3eb77f5b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:10.637159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04462c9a-a0bc-4f1f-a3dd-39f3eb77f5b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:10.637601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04462c9a-a0bc-4f1f-a3dd-39f3eb77f5b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:10.638393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04462c9a-a0bc-4f1f-a3dd-39f3eb77f5b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:10.638822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04462c9a-a0bc-4f1f-a3dd-39f3eb77f5b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:10.674340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-04462c9a-a0bc-4f1f-a3dd-39f3eb77f5b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052986 Jul 25 19:35:10.674935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 623/1270] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:10.792306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9d8e96a1-0039-46a7-a998-dc8ec3349e92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:10.794862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9d8e96a1-0039-46a7-a998-dc8ec3349e92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:10.802540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d8e96a1-0039-46a7-a998-dc8ec3349e92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:10.803110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d8e96a1-0039-46a7-a998-dc8ec3349e92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:10.804014 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d8e96a1-0039-46a7-a998-dc8ec3349e92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:10.804504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d8e96a1-0039-46a7-a998-dc8ec3349e92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:10.807473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:10.840691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9d8e96a1-0039-46a7-a998-dc8ec3349e92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052350 Jul 25 19:35:10.841319 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 648/1271] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:10.905959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fbbd9708-aa6e-4f04-97bb-493b65dea06f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:10.906656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fbbd9708-aa6e-4f04-97bb-493b65dea06f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:10.914542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fbbd9708-aa6e-4f04-97bb-493b65dea06f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:10.915197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fbbd9708-aa6e-4f04-97bb-493b65dea06f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:10.916111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fbbd9708-aa6e-4f04-97bb-493b65dea06f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:10.916591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fbbd9708-aa6e-4f04-97bb-493b65dea06f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:11.078601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fbbd9708-aa6e-4f04-97bb-493b65dea06f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:11.088584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fbbd9708-aa6e-4f04-97bb-493b65dea06f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.186941 Jul 25 19:35:11.089233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 624/1272] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:10 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:11.688035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3709467-d51e-4bc0-958b-7dfda9edc36a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:11.690399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e3709467-d51e-4bc0-958b-7dfda9edc36a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:11.697646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3709467-d51e-4bc0-958b-7dfda9edc36a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:11.698096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3709467-d51e-4bc0-958b-7dfda9edc36a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:11.698898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3709467-d51e-4bc0-958b-7dfda9edc36a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:11.699332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3709467-d51e-4bc0-958b-7dfda9edc36a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:11.734035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e3709467-d51e-4bc0-958b-7dfda9edc36a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050044 Jul 25 19:35:11.734625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 649/1273] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:11.854896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-48280430-118f-425c-b32b-2bc36fe79e4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:11.857162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-48280430-118f-425c-b32b-2bc36fe79e4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:11.865217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48280430-118f-425c-b32b-2bc36fe79e4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:11.865710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48280430-118f-425c-b32b-2bc36fe79e4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:11.866536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48280430-118f-425c-b32b-2bc36fe79e4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:11.867008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48280430-118f-425c-b32b-2bc36fe79e4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:11.902039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-48280430-118f-425c-b32b-2bc36fe79e4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051467 Jul 25 19:35:11.902696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 625/1274] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:11 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:12.113499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d9b23081-188d-4442-94f8-97e68a513f48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:12.114550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d9b23081-188d-4442-94f8-97e68a513f48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:12.121856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9b23081-188d-4442-94f8-97e68a513f48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:12.122442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9b23081-188d-4442-94f8-97e68a513f48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:12.123447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9b23081-188d-4442-94f8-97e68a513f48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:12.124018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9b23081-188d-4442-94f8-97e68a513f48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:12.282699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d9b23081-188d-4442-94f8-97e68a513f48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:12.292242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d9b23081-188d-4442-94f8-97e68a513f48 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.183030 Jul 25 19:35:12.293031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 650/1275] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:12 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:12.749248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ebb5fe30-84a9-4de0-97df-46cc20e383dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:12.751572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ebb5fe30-84a9-4de0-97df-46cc20e383dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:12.759071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ebb5fe30-84a9-4de0-97df-46cc20e383dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:12.759649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ebb5fe30-84a9-4de0-97df-46cc20e383dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:12.760788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ebb5fe30-84a9-4de0-97df-46cc20e383dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:12.761371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ebb5fe30-84a9-4de0-97df-46cc20e383dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:12.798137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ebb5fe30-84a9-4de0-97df-46cc20e383dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053027 Jul 25 19:35:12.798803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 626/1276] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:12.915813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-631ecdd8-d55b-4cd2-89d5-afaa1dc48265 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:12.918087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-631ecdd8-d55b-4cd2-89d5-afaa1dc48265 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:12.925697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-631ecdd8-d55b-4cd2-89d5-afaa1dc48265 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:12.926400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-631ecdd8-d55b-4cd2-89d5-afaa1dc48265 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:12.927310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-631ecdd8-d55b-4cd2-89d5-afaa1dc48265 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:12.927873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-631ecdd8-d55b-4cd2-89d5-afaa1dc48265 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:12.970358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-631ecdd8-d55b-4cd2-89d5-afaa1dc48265 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058928 Jul 25 19:35:12.971073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 651/1277] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:13.316905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7e80b95f-c5e1-438b-b57e-037629a0a743 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:13.317740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7e80b95f-c5e1-438b-b57e-037629a0a743 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:13.325352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7e80b95f-c5e1-438b-b57e-037629a0a743 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:13.325773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7e80b95f-c5e1-438b-b57e-037629a0a743 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:13.326678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7e80b95f-c5e1-438b-b57e-037629a0a743 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:13.327186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7e80b95f-c5e1-438b-b57e-037629a0a743 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:13.504940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7e80b95f-c5e1-438b-b57e-037629a0a743 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:13.513140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7e80b95f-c5e1-438b-b57e-037629a0a743 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.201694 Jul 25 19:35:13.513735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 627/1278] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:13 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:13.812105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d673487d-0be9-4432-8198-0748edd87241 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:13.814384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d673487d-0be9-4432-8198-0748edd87241 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:13.822671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d673487d-0be9-4432-8198-0748edd87241 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:13.823133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d673487d-0be9-4432-8198-0748edd87241 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:13.823953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d673487d-0be9-4432-8198-0748edd87241 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:13.824394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d673487d-0be9-4432-8198-0748edd87241 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:13.858070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d673487d-0be9-4432-8198-0748edd87241 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049798 Jul 25 19:35:13.858585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 652/1279] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:13.985545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6a2ba6e8-5613-413c-b5fc-d3a6149be0d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:13.988768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6a2ba6e8-5613-413c-b5fc-d3a6149be0d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:13.998833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a2ba6e8-5613-413c-b5fc-d3a6149be0d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:14.000251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a2ba6e8-5613-413c-b5fc-d3a6149be0d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:14.000251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a2ba6e8-5613-413c-b5fc-d3a6149be0d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:14.000548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a2ba6e8-5613-413c-b5fc-d3a6149be0d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:14.043174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6a2ba6e8-5613-413c-b5fc-d3a6149be0d6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061818 Jul 25 19:35:14.044003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 628/1280] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:14.535834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2af085a2-b77e-4af8-bdeb-8efd42b380e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:14.536383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2af085a2-b77e-4af8-bdeb-8efd42b380e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:14.542670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2af085a2-b77e-4af8-bdeb-8efd42b380e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:14.543109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2af085a2-b77e-4af8-bdeb-8efd42b380e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:14.543916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2af085a2-b77e-4af8-bdeb-8efd42b380e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:14.544370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2af085a2-b77e-4af8-bdeb-8efd42b380e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:14.700581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2af085a2-b77e-4af8-bdeb-8efd42b380e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:14.710538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2af085a2-b77e-4af8-bdeb-8efd42b380e0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.179509 Jul 25 19:35:14.711220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 653/1281] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:14 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:14.871833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9bdccd11-c692-4223-9fa8-aebda5376f41 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:14.874769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9bdccd11-c692-4223-9fa8-aebda5376f41 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:14.882933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9bdccd11-c692-4223-9fa8-aebda5376f41 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:14.883376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9bdccd11-c692-4223-9fa8-aebda5376f41 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:14.884214 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9bdccd11-c692-4223-9fa8-aebda5376f41 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:14.884632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9bdccd11-c692-4223-9fa8-aebda5376f41 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:14.919288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9bdccd11-c692-4223-9fa8-aebda5376f41 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051453 Jul 25 19:35:14.919912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 629/1282] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:15.056463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e226465f-d3c3-4692-9041-621f9fa86866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:15.058718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e226465f-d3c3-4692-9041-621f9fa86866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:15.066763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e226465f-d3c3-4692-9041-621f9fa86866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:15.067263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e226465f-d3c3-4692-9041-621f9fa86866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:15.068251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e226465f-d3c3-4692-9041-621f9fa86866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:15.068893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e226465f-d3c3-4692-9041-621f9fa86866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:15.103870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e226465f-d3c3-4692-9041-621f9fa86866 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051456 Jul 25 19:35:15.104460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 654/1283] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:15.740637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b3dc4ab6-f6b8-42ca-a027-20ee9269c00e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:15.741797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b3dc4ab6-f6b8-42ca-a027-20ee9269c00e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:15.753716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3dc4ab6-f6b8-42ca-a027-20ee9269c00e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:15.754502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3dc4ab6-f6b8-42ca-a027-20ee9269c00e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:15.755986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3dc4ab6-f6b8-42ca-a027-20ee9269c00e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:15.756764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3dc4ab6-f6b8-42ca-a027-20ee9269c00e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:15.936451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4b8de879-8cda-4ee0-a7f7-cf30ee5ae0c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:15.940194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4b8de879-8cda-4ee0-a7f7-cf30ee5ae0c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:15.940467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b3dc4ab6-f6b8-42ca-a027-20ee9269c00e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:15.951125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b8de879-8cda-4ee0-a7f7-cf30ee5ae0c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:15.951890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b8de879-8cda-4ee0-a7f7-cf30ee5ae0c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:15.953125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b8de879-8cda-4ee0-a7f7-cf30ee5ae0c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:15.953505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b3dc4ab6-f6b8-42ca-a027-20ee9269c00e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.221153 Jul 25 19:35:15.953899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b8de879-8cda-4ee0-a7f7-cf30ee5ae0c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:15.954569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 630/1284] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:15 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:15.992913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4b8de879-8cda-4ee0-a7f7-cf30ee5ae0c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063986 Jul 25 19:35:15.997837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 655/1285] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:16.116827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bf09d66e-e8cf-4ff1-bf3d-49ac1bafcbb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:16.119026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bf09d66e-e8cf-4ff1-bf3d-49ac1bafcbb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:16.125765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf09d66e-e8cf-4ff1-bf3d-49ac1bafcbb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:16.126217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf09d66e-e8cf-4ff1-bf3d-49ac1bafcbb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:16.127010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf09d66e-e8cf-4ff1-bf3d-49ac1bafcbb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:16.127450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf09d66e-e8cf-4ff1-bf3d-49ac1bafcbb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:16.160670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bf09d66e-e8cf-4ff1-bf3d-49ac1bafcbb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048432 Jul 25 19:35:16.161366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 631/1286] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:16.976458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e951d326-16a6-4574-a9b8-c6f0b9550f7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:16.977516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e951d326-16a6-4574-a9b8-c6f0b9550f7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:16.984588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e951d326-16a6-4574-a9b8-c6f0b9550f7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:16.985040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e951d326-16a6-4574-a9b8-c6f0b9550f7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:16.985825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e951d326-16a6-4574-a9b8-c6f0b9550f7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:16.986264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e951d326-16a6-4574-a9b8-c6f0b9550f7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:17.006680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-940035e5-ba5a-4bd6-b639-acb5409dba0d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:17.009185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-940035e5-ba5a-4bd6-b639-acb5409dba0d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:17.016456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-940035e5-ba5a-4bd6-b639-acb5409dba0d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:17.017061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-940035e5-ba5a-4bd6-b639-acb5409dba0d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:17.017886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-940035e5-ba5a-4bd6-b639-acb5409dba0d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:17.018322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-940035e5-ba5a-4bd6-b639-acb5409dba0d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:17.055417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-940035e5-ba5a-4bd6-b639-acb5409dba0d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053844 Jul 25 19:35:17.056361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 632/1287] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:17.155479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e951d326-16a6-4574-a9b8-c6f0b9550f7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:17.164813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e951d326-16a6-4574-a9b8-c6f0b9550f7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.193154 Jul 25 19:35:17.165571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 656/1288] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:16 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:17.179004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-43e1fe20-d4d8-4361-80af-808df9200cc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:17.182108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-43e1fe20-d4d8-4361-80af-808df9200cc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:17.191280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43e1fe20-d4d8-4361-80af-808df9200cc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:17.192015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43e1fe20-d4d8-4361-80af-808df9200cc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:17.193078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43e1fe20-d4d8-4361-80af-808df9200cc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:17.193590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43e1fe20-d4d8-4361-80af-808df9200cc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:17.229169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-43e1fe20-d4d8-4361-80af-808df9200cc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057189 Jul 25 19:35:17.229818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 633/1289] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:18.070392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4a29e630-371b-40b5-bb57-af22aefc8cb9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:18.072638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4a29e630-371b-40b5-bb57-af22aefc8cb9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:18.079743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a29e630-371b-40b5-bb57-af22aefc8cb9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:18.080193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a29e630-371b-40b5-bb57-af22aefc8cb9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:18.081011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a29e630-371b-40b5-bb57-af22aefc8cb9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:18.082081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a29e630-371b-40b5-bb57-af22aefc8cb9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:18.117966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4a29e630-371b-40b5-bb57-af22aefc8cb9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052358 Jul 25 19:35:18.118563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 657/1290] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:18.194081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7a253b0b-f3a8-4bdf-9e94-c9a169694318 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:18.194962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7a253b0b-f3a8-4bdf-9e94-c9a169694318 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:18.202064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7a253b0b-f3a8-4bdf-9e94-c9a169694318 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:18.202508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7a253b0b-f3a8-4bdf-9e94-c9a169694318 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:18.203293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7a253b0b-f3a8-4bdf-9e94-c9a169694318 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:18.203757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7a253b0b-f3a8-4bdf-9e94-c9a169694318 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:18.243060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-775148c1-296f-45ff-88db-d8ebbfb13a55 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:18.245309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-775148c1-296f-45ff-88db-d8ebbfb13a55 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:18.251925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-775148c1-296f-45ff-88db-d8ebbfb13a55 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:18.252375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-775148c1-296f-45ff-88db-d8ebbfb13a55 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:18.253335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-775148c1-296f-45ff-88db-d8ebbfb13a55 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:18.254402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-775148c1-296f-45ff-88db-d8ebbfb13a55 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:18.310655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-775148c1-296f-45ff-88db-d8ebbfb13a55 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071235 Jul 25 19:35:18.311728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 658/1291] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:18.391925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7a253b0b-f3a8-4bdf-9e94-c9a169694318 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:18.401749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7a253b0b-f3a8-4bdf-9e94-c9a169694318 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.212479 Jul 25 19:35:18.402343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 634/1292] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:18 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:18.975737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:35:18.976008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:35:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:35:19.132409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5fb8c3ea-98fe-4d4a-b713-f9d0d86363a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:19.134690 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5fb8c3ea-98fe-4d4a-b713-f9d0d86363a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:19.141789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5fb8c3ea-98fe-4d4a-b713-f9d0d86363a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:19.142233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5fb8c3ea-98fe-4d4a-b713-f9d0d86363a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:19.143007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5fb8c3ea-98fe-4d4a-b713-f9d0d86363a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:19.143441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5fb8c3ea-98fe-4d4a-b713-f9d0d86363a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:19.179397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5fb8c3ea-98fe-4d4a-b713-f9d0d86363a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051994 Jul 25 19:35:19.180019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 659/1293] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:19.325643 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6f12ab1e-492f-4a68-81c2-2c472fa3c3e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:19.327991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6f12ab1e-492f-4a68-81c2-2c472fa3c3e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:19.335725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f12ab1e-492f-4a68-81c2-2c472fa3c3e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:19.336170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f12ab1e-492f-4a68-81c2-2c472fa3c3e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:19.336959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f12ab1e-492f-4a68-81c2-2c472fa3c3e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:19.337394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f12ab1e-492f-4a68-81c2-2c472fa3c3e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:19.373916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6f12ab1e-492f-4a68-81c2-2c472fa3c3e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052248 Jul 25 19:35:19.374515 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 635/1294] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:19.424252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8941cca7-5c94-4082-9d3e-50eb7005e1d2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:19.424913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8941cca7-5c94-4082-9d3e-50eb7005e1d2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:19.432791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8941cca7-5c94-4082-9d3e-50eb7005e1d2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:19.433241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8941cca7-5c94-4082-9d3e-50eb7005e1d2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:19.434038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8941cca7-5c94-4082-9d3e-50eb7005e1d2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:19.434481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8941cca7-5c94-4082-9d3e-50eb7005e1d2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:19.594881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8941cca7-5c94-4082-9d3e-50eb7005e1d2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:19.604083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8941cca7-5c94-4082-9d3e-50eb7005e1d2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.183645 Jul 25 19:35:19.604731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 660/1295] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:19 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:20.196208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ad7816d4-d3fc-46df-9de5-b1418107e4a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:20.198978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ad7816d4-d3fc-46df-9de5-b1418107e4a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:20.207450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7816d4-d3fc-46df-9de5-b1418107e4a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:20.208102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7816d4-d3fc-46df-9de5-b1418107e4a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:20.209066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7816d4-d3fc-46df-9de5-b1418107e4a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:20.209619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7816d4-d3fc-46df-9de5-b1418107e4a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:20.250029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ad7816d4-d3fc-46df-9de5-b1418107e4a6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060739 Jul 25 19:35:20.251088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 636/1296] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:20.391783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9dd8d801-78c0-432b-bb3c-e62e433a7660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:20.396036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9dd8d801-78c0-432b-bb3c-e62e433a7660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:20.408099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9dd8d801-78c0-432b-bb3c-e62e433a7660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:20.408860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9dd8d801-78c0-432b-bb3c-e62e433a7660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:20.410507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9dd8d801-78c0-432b-bb3c-e62e433a7660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:20.411557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9dd8d801-78c0-432b-bb3c-e62e433a7660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:20.447866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9dd8d801-78c0-432b-bb3c-e62e433a7660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063207 Jul 25 19:35:20.448643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 661/1297] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:20.629302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e5c1928f-bd21-4805-ad7c-d302e7fe701c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:20.630146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e5c1928f-bd21-4805-ad7c-d302e7fe701c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:20.638945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5c1928f-bd21-4805-ad7c-d302e7fe701c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:20.639771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5c1928f-bd21-4805-ad7c-d302e7fe701c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:20.640884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5c1928f-bd21-4805-ad7c-d302e7fe701c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:20.641682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5c1928f-bd21-4805-ad7c-d302e7fe701c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:20.645849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:20.888086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e5c1928f-bd21-4805-ad7c-d302e7fe701c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:20.897550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e5c1928f-bd21-4805-ad7c-d302e7fe701c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.273826 Jul 25 19:35:20.898146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 637/1298] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:20 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:21.267129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b10cd91-66b7-42b3-a19a-80c08433eeca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:21.270150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b10cd91-66b7-42b3-a19a-80c08433eeca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:21.272497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=80 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:21.279395 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b10cd91-66b7-42b3-a19a-80c08433eeca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:21.280201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b10cd91-66b7-42b3-a19a-80c08433eeca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:21.280975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b10cd91-66b7-42b3-a19a-80c08433eeca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:21.281418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b10cd91-66b7-42b3-a19a-80c08433eeca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:21.319473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b10cd91-66b7-42b3-a19a-80c08433eeca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058400 Jul 25 19:35:21.320092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 662/1299] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:21.462176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8266110a-a1b3-4169-b9e5-61c5b1fbc1aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:21.464370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8266110a-a1b3-4169-b9e5-61c5b1fbc1aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:21.471019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8266110a-a1b3-4169-b9e5-61c5b1fbc1aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:21.471466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8266110a-a1b3-4169-b9e5-61c5b1fbc1aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:21.472907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8266110a-a1b3-4169-b9e5-61c5b1fbc1aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:21.473353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8266110a-a1b3-4169-b9e5-61c5b1fbc1aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:21.507268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8266110a-a1b3-4169-b9e5-61c5b1fbc1aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049586 Jul 25 19:35:21.507969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 638/1300] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:21.921104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d739c031-f32a-4ee5-a072-c16c5b27ae04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:21.921854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d739c031-f32a-4ee5-a072-c16c5b27ae04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:21.929611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d739c031-f32a-4ee5-a072-c16c5b27ae04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:21.930067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d739c031-f32a-4ee5-a072-c16c5b27ae04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:21.930862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d739c031-f32a-4ee5-a072-c16c5b27ae04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:21.931308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d739c031-f32a-4ee5-a072-c16c5b27ae04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:22.083036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d739c031-f32a-4ee5-a072-c16c5b27ae04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:22.091845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d739c031-f32a-4ee5-a072-c16c5b27ae04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.174626 Jul 25 19:35:22.092438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 663/1301] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:21 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:22.333230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3a523934-64ba-4a0d-9bcd-4d12e611da6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:22.335425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3a523934-64ba-4a0d-9bcd-4d12e611da6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:22.342474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a523934-64ba-4a0d-9bcd-4d12e611da6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:22.342961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a523934-64ba-4a0d-9bcd-4d12e611da6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:22.343864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a523934-64ba-4a0d-9bcd-4d12e611da6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:22.344309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a523934-64ba-4a0d-9bcd-4d12e611da6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:22.380430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3a523934-64ba-4a0d-9bcd-4d12e611da6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051914 Jul 25 19:35:22.381119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 639/1302] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:22.522494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9983edcb-1726-4636-be3d-90a78173c780 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:22.524773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9983edcb-1726-4636-be3d-90a78173c780 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:22.531263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9983edcb-1726-4636-be3d-90a78173c780 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:22.531753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9983edcb-1726-4636-be3d-90a78173c780 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:22.532537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9983edcb-1726-4636-be3d-90a78173c780 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:22.532973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9983edcb-1726-4636-be3d-90a78173c780 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:22.562500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:22.570922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9983edcb-1726-4636-be3d-90a78173c780 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054643 Jul 25 19:35:22.571584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 664/1303] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:23.114092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2bc24cbe-451c-4f7c-b665-094f8f326965 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:23.114846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2bc24cbe-451c-4f7c-b665-094f8f326965 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:23.121880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bc24cbe-451c-4f7c-b665-094f8f326965 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:23.122323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bc24cbe-451c-4f7c-b665-094f8f326965 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:23.123128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bc24cbe-451c-4f7c-b665-094f8f326965 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:23.123612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bc24cbe-451c-4f7c-b665-094f8f326965 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:23.289993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2bc24cbe-451c-4f7c-b665-094f8f326965 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:23.304676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2bc24cbe-451c-4f7c-b665-094f8f326965 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.194830 Jul 25 19:35:23.305993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 640/1304] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:23 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:23.393644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5675ff09-a2a5-4904-86e9-f884f06d6a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:23.396505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5675ff09-a2a5-4904-86e9-f884f06d6a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:23.403812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5675ff09-a2a5-4904-86e9-f884f06d6a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:23.404265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5675ff09-a2a5-4904-86e9-f884f06d6a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:23.405070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5675ff09-a2a5-4904-86e9-f884f06d6a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:23.405512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5675ff09-a2a5-4904-86e9-f884f06d6a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:23.442902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5675ff09-a2a5-4904-86e9-f884f06d6a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052587 Jul 25 19:35:23.443665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 665/1305] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:23.585507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5f57dc72-b76f-4adf-bab7-0f92e2d0848a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:23.588457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5f57dc72-b76f-4adf-bab7-0f92e2d0848a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:23.595743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f57dc72-b76f-4adf-bab7-0f92e2d0848a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:23.596198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f57dc72-b76f-4adf-bab7-0f92e2d0848a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:23.597570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f57dc72-b76f-4adf-bab7-0f92e2d0848a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:23.598023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f57dc72-b76f-4adf-bab7-0f92e2d0848a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:23.633108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5f57dc72-b76f-4adf-bab7-0f92e2d0848a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053393 Jul 25 19:35:23.633894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 641/1306] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:24.329072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d2acac48-9b54-4651-bc2f-bf9317e64ad4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:24.329694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d2acac48-9b54-4651-bc2f-bf9317e64ad4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:24.336863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2acac48-9b54-4651-bc2f-bf9317e64ad4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:24.337296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2acac48-9b54-4651-bc2f-bf9317e64ad4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:24.338082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2acac48-9b54-4651-bc2f-bf9317e64ad4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:24.338677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2acac48-9b54-4651-bc2f-bf9317e64ad4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:24.461607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e32e840a-431b-4344-9635-4b5f66e1bb77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:24.465940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e32e840a-431b-4344-9635-4b5f66e1bb77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:24.477792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e32e840a-431b-4344-9635-4b5f66e1bb77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:24.478496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e32e840a-431b-4344-9635-4b5f66e1bb77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:24.479891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e32e840a-431b-4344-9635-4b5f66e1bb77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:24.480626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e32e840a-431b-4344-9635-4b5f66e1bb77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:24.510390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d2acac48-9b54-4651-bc2f-bf9317e64ad4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:24.518638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d2acac48-9b54-4651-bc2f-bf9317e64ad4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.193514 Jul 25 19:35:24.519924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 666/1307] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:24 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:24.520208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e32e840a-431b-4344-9635-4b5f66e1bb77 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066052 Jul 25 19:35:24.521038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 642/1308] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:24.647433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c7e4796b-682c-45be-b14f-a254cbb3e8e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:24.650163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c7e4796b-682c-45be-b14f-a254cbb3e8e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:24.657068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7e4796b-682c-45be-b14f-a254cbb3e8e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:24.657517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7e4796b-682c-45be-b14f-a254cbb3e8e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:24.658364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7e4796b-682c-45be-b14f-a254cbb3e8e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:24.658804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7e4796b-682c-45be-b14f-a254cbb3e8e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:24.696769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c7e4796b-682c-45be-b14f-a254cbb3e8e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054618 Jul 25 19:35:24.697372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 667/1309] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:25.141726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:35:25.142459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:35:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:35:25.533004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5d7270c9-22c3-4cd7-b697-9f1f0c63365f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:25.535809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5d7270c9-22c3-4cd7-b697-9f1f0c63365f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:25.542857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d7270c9-22c3-4cd7-b697-9f1f0c63365f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:25.543316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d7270c9-22c3-4cd7-b697-9f1f0c63365f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:25.544144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d7270c9-22c3-4cd7-b697-9f1f0c63365f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:25.544593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d7270c9-22c3-4cd7-b697-9f1f0c63365f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:25.556077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a7f8bb02-fa96-4e3c-8eaa-66e6afffd447 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:25.557173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a7f8bb02-fa96-4e3c-8eaa-66e6afffd447 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:25.569987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7f8bb02-fa96-4e3c-8eaa-66e6afffd447 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:25.571175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7f8bb02-fa96-4e3c-8eaa-66e6afffd447 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:25.572904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7f8bb02-fa96-4e3c-8eaa-66e6afffd447 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:25.573701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7f8bb02-fa96-4e3c-8eaa-66e6afffd447 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:25.592235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5d7270c9-22c3-4cd7-b697-9f1f0c63365f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063465 Jul 25 19:35:25.593718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 643/1310] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:25.714337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-98985a1b-89be-4741-a3e1-a3ad1b590d0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:25.718247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-98985a1b-89be-4741-a3e1-a3ad1b590d0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:25.729493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98985a1b-89be-4741-a3e1-a3ad1b590d0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:25.730217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98985a1b-89be-4741-a3e1-a3ad1b590d0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:25.731641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98985a1b-89be-4741-a3e1-a3ad1b590d0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:25.732431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98985a1b-89be-4741-a3e1-a3ad1b590d0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:25.737220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a7f8bb02-fa96-4e3c-8eaa-66e6afffd447 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:25.746069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a7f8bb02-fa96-4e3c-8eaa-66e6afffd447 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.195498 Jul 25 19:35:25.746674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 668/1311] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:25 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:25.791889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-98985a1b-89be-4741-a3e1-a3ad1b590d0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084813 Jul 25 19:35:25.792884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 644/1312] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:26.608515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aecbc36f-0745-48fc-a55d-b416c07303cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:26.610762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aecbc36f-0745-48fc-a55d-b416c07303cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:26.618104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aecbc36f-0745-48fc-a55d-b416c07303cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:26.618548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aecbc36f-0745-48fc-a55d-b416c07303cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:26.619341 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aecbc36f-0745-48fc-a55d-b416c07303cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:26.619815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aecbc36f-0745-48fc-a55d-b416c07303cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:26.655655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aecbc36f-0745-48fc-a55d-b416c07303cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050939 Jul 25 19:35:26.656428 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 669/1313] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:26.769773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dad27978-a095-449f-8b09-f46a0d89efbc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:26.770621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dad27978-a095-449f-8b09-f46a0d89efbc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:26.778696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dad27978-a095-449f-8b09-f46a0d89efbc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:26.779115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dad27978-a095-449f-8b09-f46a0d89efbc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:26.780022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dad27978-a095-449f-8b09-f46a0d89efbc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:26.780510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dad27978-a095-449f-8b09-f46a0d89efbc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:26.812086 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-87838a27-91e8-4aed-af66-c6f2d3d9e7ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:26.816575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-87838a27-91e8-4aed-af66-c6f2d3d9e7ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:26.827984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87838a27-91e8-4aed-af66-c6f2d3d9e7ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:26.828778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87838a27-91e8-4aed-af66-c6f2d3d9e7ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:26.830166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87838a27-91e8-4aed-af66-c6f2d3d9e7ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:26.830974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87838a27-91e8-4aed-af66-c6f2d3d9e7ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:26.893678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-87838a27-91e8-4aed-af66-c6f2d3d9e7ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088632 Jul 25 19:35:26.895177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 670/1314] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:26.954544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-dad27978-a095-449f-8b09-f46a0d89efbc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:26.963852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dad27978-a095-449f-8b09-f46a0d89efbc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.199150 Jul 25 19:35:26.964451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 645/1315] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:26 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:27.668983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b25ae15c-5edd-4b86-adc7-29c18441f5ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:27.671228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b25ae15c-5edd-4b86-adc7-29c18441f5ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:27.679776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b25ae15c-5edd-4b86-adc7-29c18441f5ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:27.680254 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b25ae15c-5edd-4b86-adc7-29c18441f5ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:27.681072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b25ae15c-5edd-4b86-adc7-29c18441f5ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:27.681519 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b25ae15c-5edd-4b86-adc7-29c18441f5ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:27.716221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b25ae15c-5edd-4b86-adc7-29c18441f5ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051337 Jul 25 19:35:27.716818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 671/1316] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:27.911213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2bcd85af-73e0-4b22-bf59-3edb0b8e0b20 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:27.913476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2bcd85af-73e0-4b22-bf59-3edb0b8e0b20 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:27.920705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bcd85af-73e0-4b22-bf59-3edb0b8e0b20 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:27.921051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bcd85af-73e0-4b22-bf59-3edb0b8e0b20 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:27.921840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bcd85af-73e0-4b22-bf59-3edb0b8e0b20 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:27.922282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bcd85af-73e0-4b22-bf59-3edb0b8e0b20 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:27.962265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2bcd85af-73e0-4b22-bf59-3edb0b8e0b20 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056288 Jul 25 19:35:27.962951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 646/1317] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:28.001235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b33dbed5-c31e-464a-8b27-0b6d14175d3a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:28.001987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b33dbed5-c31e-464a-8b27-0b6d14175d3a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:28.009538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b33dbed5-c31e-464a-8b27-0b6d14175d3a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:28.009985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b33dbed5-c31e-464a-8b27-0b6d14175d3a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:28.010769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b33dbed5-c31e-464a-8b27-0b6d14175d3a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:28.011198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b33dbed5-c31e-464a-8b27-0b6d14175d3a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:28.201870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b33dbed5-c31e-464a-8b27-0b6d14175d3a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:28.211309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b33dbed5-c31e-464a-8b27-0b6d14175d3a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.214276 Jul 25 19:35:28.211920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 672/1318] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:27 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:28.730041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e7b78b49-58b0-4a3d-bc73-51f027a6172b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:28.732304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e7b78b49-58b0-4a3d-bc73-51f027a6172b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:28.741014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7b78b49-58b0-4a3d-bc73-51f027a6172b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:28.741855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7b78b49-58b0-4a3d-bc73-51f027a6172b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:28.743244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7b78b49-58b0-4a3d-bc73-51f027a6172b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:28.744118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7b78b49-58b0-4a3d-bc73-51f027a6172b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:28.804867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e7b78b49-58b0-4a3d-bc73-51f027a6172b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078658 Jul 25 19:35:28.805924 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 647/1319] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:28.977265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d7d0230f-cdf7-4557-b25c-e1cb1ed993ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:28.979664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d7d0230f-cdf7-4557-b25c-e1cb1ed993ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:28.986851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7d0230f-cdf7-4557-b25c-e1cb1ed993ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:28.987268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7d0230f-cdf7-4557-b25c-e1cb1ed993ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:28.989159 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7d0230f-cdf7-4557-b25c-e1cb1ed993ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:28.989658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7d0230f-cdf7-4557-b25c-e1cb1ed993ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:29.024337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d7d0230f-cdf7-4557-b25c-e1cb1ed993ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052902 Jul 25 19:35:29.024939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 673/1320] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:29.234821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e64f6149-a7d0-473a-9030-46d455618e23 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:29.235650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e64f6149-a7d0-473a-9030-46d455618e23 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:29.244246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e64f6149-a7d0-473a-9030-46d455618e23 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:29.244593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e64f6149-a7d0-473a-9030-46d455618e23 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:29.245464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e64f6149-a7d0-473a-9030-46d455618e23 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:29.245902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e64f6149-a7d0-473a-9030-46d455618e23 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:29.428374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e64f6149-a7d0-473a-9030-46d455618e23 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:29.437151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e64f6149-a7d0-473a-9030-46d455618e23 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.206320 Jul 25 19:35:29.437773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 648/1321] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:29 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:29.821606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6441ff29-fab5-4319-989e-1a562ae8e764 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:29.824060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6441ff29-fab5-4319-989e-1a562ae8e764 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:29.830895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6441ff29-fab5-4319-989e-1a562ae8e764 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:29.831874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6441ff29-fab5-4319-989e-1a562ae8e764 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:29.832853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6441ff29-fab5-4319-989e-1a562ae8e764 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:29.833417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6441ff29-fab5-4319-989e-1a562ae8e764 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:29.868864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6441ff29-fab5-4319-989e-1a562ae8e764 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052220 Jul 25 19:35:29.869454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 674/1322] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:29 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:30.039054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9f217c3f-ef25-421d-90ef-6cddb392ec3d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:30.041291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9f217c3f-ef25-421d-90ef-6cddb392ec3d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:30.048325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f217c3f-ef25-421d-90ef-6cddb392ec3d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:30.048916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f217c3f-ef25-421d-90ef-6cddb392ec3d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:30.049805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f217c3f-ef25-421d-90ef-6cddb392ec3d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:30.051830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f217c3f-ef25-421d-90ef-6cddb392ec3d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:30.087646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9f217c3f-ef25-421d-90ef-6cddb392ec3d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054135 Jul 25 19:35:30.088309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 649/1323] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:30.461405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-356202c1-eae9-4622-8894-f7e8faad0b6b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:30.462207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-356202c1-eae9-4622-8894-f7e8faad0b6b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:30.469826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-356202c1-eae9-4622-8894-f7e8faad0b6b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:30.470259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-356202c1-eae9-4622-8894-f7e8faad0b6b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:30.471201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-356202c1-eae9-4622-8894-f7e8faad0b6b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:30.471887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-356202c1-eae9-4622-8894-f7e8faad0b6b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:30.658168 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-356202c1-eae9-4622-8894-f7e8faad0b6b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:30.667629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-356202c1-eae9-4622-8894-f7e8faad0b6b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.211640 Jul 25 19:35:30.668421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 675/1324] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:30 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:30.881954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-be6ddbce-b744-4063-8be3-dfb6ebe0fb44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:30.885580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-be6ddbce-b744-4063-8be3-dfb6ebe0fb44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:30.894921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be6ddbce-b744-4063-8be3-dfb6ebe0fb44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:30.895376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be6ddbce-b744-4063-8be3-dfb6ebe0fb44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:30.896224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be6ddbce-b744-4063-8be3-dfb6ebe0fb44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:30.896671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be6ddbce-b744-4063-8be3-dfb6ebe0fb44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:30.930298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-be6ddbce-b744-4063-8be3-dfb6ebe0fb44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053261 Jul 25 19:35:30.930903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 650/1325] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:31.105242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f40980f0-2fd5-40cf-ac66-6d1c900d3737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:31.107831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f40980f0-2fd5-40cf-ac66-6d1c900d3737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:31.115652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f40980f0-2fd5-40cf-ac66-6d1c900d3737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:31.116386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f40980f0-2fd5-40cf-ac66-6d1c900d3737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:31.117212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f40980f0-2fd5-40cf-ac66-6d1c900d3737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:31.117650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f40980f0-2fd5-40cf-ac66-6d1c900d3737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:31.151397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f40980f0-2fd5-40cf-ac66-6d1c900d3737 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054130 Jul 25 19:35:31.151996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 676/1326] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:31.689075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7031fe0b-5651-4d1e-932a-6be5ab5f50d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:31.689596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7031fe0b-5651-4d1e-932a-6be5ab5f50d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:31.696902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7031fe0b-5651-4d1e-932a-6be5ab5f50d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:31.697426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7031fe0b-5651-4d1e-932a-6be5ab5f50d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:31.698157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7031fe0b-5651-4d1e-932a-6be5ab5f50d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:31.698599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7031fe0b-5651-4d1e-932a-6be5ab5f50d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:31.859425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7031fe0b-5651-4d1e-932a-6be5ab5f50d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:31.868057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7031fe0b-5651-4d1e-932a-6be5ab5f50d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.182923 Jul 25 19:35:31.868655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 651/1327] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:31 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:31.943487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0322ccf1-3b29-434b-b3a8-7975e3785528 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:31.945825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0322ccf1-3b29-434b-b3a8-7975e3785528 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:31.953186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0322ccf1-3b29-434b-b3a8-7975e3785528 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:31.953635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0322ccf1-3b29-434b-b3a8-7975e3785528 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:31.954427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0322ccf1-3b29-434b-b3a8-7975e3785528 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:31.954865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0322ccf1-3b29-434b-b3a8-7975e3785528 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:31.990645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0322ccf1-3b29-434b-b3a8-7975e3785528 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051612 Jul 25 19:35:31.991249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 677/1328] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:32.165685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eae8afc8-d266-4221-93ab-1aea3fb04b1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:32.168444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eae8afc8-d266-4221-93ab-1aea3fb04b1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:32.176681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eae8afc8-d266-4221-93ab-1aea3fb04b1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:32.177133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eae8afc8-d266-4221-93ab-1aea3fb04b1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:32.178066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eae8afc8-d266-4221-93ab-1aea3fb04b1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:32.178538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eae8afc8-d266-4221-93ab-1aea3fb04b1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:32.213213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eae8afc8-d266-4221-93ab-1aea3fb04b1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052135 Jul 25 19:35:32.213723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 652/1329] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:32.894612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c5e14f6-dbfd-4dcb-8aa2-20277ed20255 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:32.895384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7c5e14f6-dbfd-4dcb-8aa2-20277ed20255 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:32.902886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c5e14f6-dbfd-4dcb-8aa2-20277ed20255 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:32.903636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c5e14f6-dbfd-4dcb-8aa2-20277ed20255 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:32.905006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c5e14f6-dbfd-4dcb-8aa2-20277ed20255 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:32.905639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c5e14f6-dbfd-4dcb-8aa2-20277ed20255 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:33.007287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1cfbf687-ecc4-4827-a3fa-13d033970885 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:33.009627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1cfbf687-ecc4-4827-a3fa-13d033970885 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:33.017634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cfbf687-ecc4-4827-a3fa-13d033970885 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:33.018103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cfbf687-ecc4-4827-a3fa-13d033970885 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:33.019606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cfbf687-ecc4-4827-a3fa-13d033970885 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:33.020138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cfbf687-ecc4-4827-a3fa-13d033970885 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:33.051731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:33.058177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1cfbf687-ecc4-4827-a3fa-13d033970885 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055780 Jul 25 19:35:33.062847 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 653/1330] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:33.106673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7c5e14f6-dbfd-4dcb-8aa2-20277ed20255 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:33.118010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c5e14f6-dbfd-4dcb-8aa2-20277ed20255 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.228361 Jul 25 19:35:33.118604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 678/1331] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:32 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:33.229095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-143a2f2c-c19f-42e3-88b4-19e3ad2c10d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:33.231421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-143a2f2c-c19f-42e3-88b4-19e3ad2c10d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:33.238773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-143a2f2c-c19f-42e3-88b4-19e3ad2c10d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:33.239219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-143a2f2c-c19f-42e3-88b4-19e3ad2c10d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:33.240121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-143a2f2c-c19f-42e3-88b4-19e3ad2c10d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:33.240657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-143a2f2c-c19f-42e3-88b4-19e3ad2c10d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:33.274576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-143a2f2c-c19f-42e3-88b4-19e3ad2c10d9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050992 Jul 25 19:35:33.275163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 654/1332] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:34.075854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-63ac781b-5d56-4417-b913-17ee3329b186 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:34.079794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-63ac781b-5d56-4417-b913-17ee3329b186 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:34.088148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63ac781b-5d56-4417-b913-17ee3329b186 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:34.088712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63ac781b-5d56-4417-b913-17ee3329b186 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:34.089602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63ac781b-5d56-4417-b913-17ee3329b186 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:34.090151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63ac781b-5d56-4417-b913-17ee3329b186 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:34.126386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-63ac781b-5d56-4417-b913-17ee3329b186 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058574 Jul 25 19:35:34.127187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 679/1333] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:34.140240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8e127055-7d36-4f43-b463-ba39db5545d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:34.140900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8e127055-7d36-4f43-b463-ba39db5545d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:34.148415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e127055-7d36-4f43-b463-ba39db5545d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:34.148862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e127055-7d36-4f43-b463-ba39db5545d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:34.149662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e127055-7d36-4f43-b463-ba39db5545d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:34.150104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e127055-7d36-4f43-b463-ba39db5545d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:34.292803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4f6428bb-0a09-4433-9dc3-4dd5d8e1bb3b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:34.295956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4f6428bb-0a09-4433-9dc3-4dd5d8e1bb3b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:34.304319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8e127055-7d36-4f43-b463-ba39db5545d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:34.305213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f6428bb-0a09-4433-9dc3-4dd5d8e1bb3b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:34.305574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f6428bb-0a09-4433-9dc3-4dd5d8e1bb3b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:34.306409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f6428bb-0a09-4433-9dc3-4dd5d8e1bb3b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:34.306851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f6428bb-0a09-4433-9dc3-4dd5d8e1bb3b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:34.314507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8e127055-7d36-4f43-b463-ba39db5545d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.178044 Jul 25 19:35:34.315262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 655/1334] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:34 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:34.340872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4f6428bb-0a09-4433-9dc3-4dd5d8e1bb3b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055449 Jul 25 19:35:34.341463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 680/1335] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:34.556094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:35:34.556604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:35:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:35:35.140391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bbdf4470-890e-40a5-a506-fa0b39c92716 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:35.142603 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bbdf4470-890e-40a5-a506-fa0b39c92716 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:35.151532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bbdf4470-890e-40a5-a506-fa0b39c92716 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:35.152225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bbdf4470-890e-40a5-a506-fa0b39c92716 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:35.153413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bbdf4470-890e-40a5-a506-fa0b39c92716 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:35.154075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bbdf4470-890e-40a5-a506-fa0b39c92716 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:35.213723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bbdf4470-890e-40a5-a506-fa0b39c92716 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076934 Jul 25 19:35:35.214754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 656/1336] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:35.340729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bf7652a0-6f74-4997-899f-582832173ad0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:35.341459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bf7652a0-6f74-4997-899f-582832173ad0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:35.349293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf7652a0-6f74-4997-899f-582832173ad0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:35.349739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf7652a0-6f74-4997-899f-582832173ad0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:35.350529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf7652a0-6f74-4997-899f-582832173ad0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:35.350964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf7652a0-6f74-4997-899f-582832173ad0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:35.358903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d040d30c-b76e-4ee2-9705-3c4819f5a18d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:35.363481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d040d30c-b76e-4ee2-9705-3c4819f5a18d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:35.369183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:35.376154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d040d30c-b76e-4ee2-9705-3c4819f5a18d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:35.376949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d040d30c-b76e-4ee2-9705-3c4819f5a18d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:35.380083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d040d30c-b76e-4ee2-9705-3c4819f5a18d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:35.380953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d040d30c-b76e-4ee2-9705-3c4819f5a18d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:35.420619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d040d30c-b76e-4ee2-9705-3c4819f5a18d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069454 Jul 25 19:35:35.421141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 657/1337] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:35 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:35.533995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bf7652a0-6f74-4997-899f-582832173ad0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:35.542937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bf7652a0-6f74-4997-899f-582832173ad0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.206038 Jul 25 19:35:35.543545 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 681/1338] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:35 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:36.228289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3dfd3412-1abe-46f8-b1c6-a77088c5c28a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:36.230800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3dfd3412-1abe-46f8-b1c6-a77088c5c28a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:36.233059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=84 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:36.240474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3dfd3412-1abe-46f8-b1c6-a77088c5c28a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:36.241133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3dfd3412-1abe-46f8-b1c6-a77088c5c28a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:36.242057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3dfd3412-1abe-46f8-b1c6-a77088c5c28a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:36.242554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3dfd3412-1abe-46f8-b1c6-a77088c5c28a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:36.282901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3dfd3412-1abe-46f8-b1c6-a77088c5c28a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059176 Jul 25 19:35:36.283423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 658/1339] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:36.437436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eae022ae-59e6-44f1-acb9-720010805d92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:36.439751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eae022ae-59e6-44f1-acb9-720010805d92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:36.447351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eae022ae-59e6-44f1-acb9-720010805d92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:36.447878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eae022ae-59e6-44f1-acb9-720010805d92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:36.448674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eae022ae-59e6-44f1-acb9-720010805d92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:36.449114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eae022ae-59e6-44f1-acb9-720010805d92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:36.493806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eae022ae-59e6-44f1-acb9-720010805d92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060333 Jul 25 19:35:36.494399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 682/1340] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:36.567886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d965de87-8f5e-48c6-9e27-8c8ed6b210e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:36.568585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d965de87-8f5e-48c6-9e27-8c8ed6b210e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:36.576006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d965de87-8f5e-48c6-9e27-8c8ed6b210e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:36.576446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d965de87-8f5e-48c6-9e27-8c8ed6b210e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:36.577230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d965de87-8f5e-48c6-9e27-8c8ed6b210e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:36.577664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d965de87-8f5e-48c6-9e27-8c8ed6b210e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:36.767237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d965de87-8f5e-48c6-9e27-8c8ed6b210e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:36.776362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d965de87-8f5e-48c6-9e27-8c8ed6b210e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.213327 Jul 25 19:35:36.776974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 659/1341] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:36 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:37.296927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13bc4bde-44cf-4c7e-aa7d-e3b3650c25d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:37.299643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-13bc4bde-44cf-4c7e-aa7d-e3b3650c25d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:37.307637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13bc4bde-44cf-4c7e-aa7d-e3b3650c25d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:37.308091 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13bc4bde-44cf-4c7e-aa7d-e3b3650c25d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:37.308882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13bc4bde-44cf-4c7e-aa7d-e3b3650c25d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:37.309328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13bc4bde-44cf-4c7e-aa7d-e3b3650c25d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:37.345477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13bc4bde-44cf-4c7e-aa7d-e3b3650c25d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052737 Jul 25 19:35:37.346153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 683/1342] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:37.507354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-987e4b28-e092-43d7-9f34-080311c2f407 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:37.509764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-987e4b28-e092-43d7-9f34-080311c2f407 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:37.516599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-987e4b28-e092-43d7-9f34-080311c2f407 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:37.517052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-987e4b28-e092-43d7-9f34-080311c2f407 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:37.517873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-987e4b28-e092-43d7-9f34-080311c2f407 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:37.518402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-987e4b28-e092-43d7-9f34-080311c2f407 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:37.580143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-987e4b28-e092-43d7-9f34-080311c2f407 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077163 Jul 25 19:35:37.582412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 660/1343] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:37.800613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7509c100-b0d8-4505-94c2-721d3c2dcf04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:37.801226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7509c100-b0d8-4505-94c2-721d3c2dcf04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:37.808867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7509c100-b0d8-4505-94c2-721d3c2dcf04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:37.809315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7509c100-b0d8-4505-94c2-721d3c2dcf04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:37.810106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7509c100-b0d8-4505-94c2-721d3c2dcf04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:37.810562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7509c100-b0d8-4505-94c2-721d3c2dcf04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:37.982686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7509c100-b0d8-4505-94c2-721d3c2dcf04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:37.992106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7509c100-b0d8-4505-94c2-721d3c2dcf04 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.196226 Jul 25 19:35:37.992700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 684/1344] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:37 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:38.359257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4608f4bc-efc4-4b99-a578-6f28ed58b14b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:38.361732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4608f4bc-efc4-4b99-a578-6f28ed58b14b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:38.369955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4608f4bc-efc4-4b99-a578-6f28ed58b14b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:38.370408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4608f4bc-efc4-4b99-a578-6f28ed58b14b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:38.371210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4608f4bc-efc4-4b99-a578-6f28ed58b14b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:38.371699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4608f4bc-efc4-4b99-a578-6f28ed58b14b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:38.408719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4608f4bc-efc4-4b99-a578-6f28ed58b14b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053634 Jul 25 19:35:38.409439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 661/1345] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:38 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:38.594905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-763be4ed-cc18-45e4-8fed-4bdfab418244 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:38.598179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-763be4ed-cc18-45e4-8fed-4bdfab418244 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:38.605195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-763be4ed-cc18-45e4-8fed-4bdfab418244 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:38.605641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-763be4ed-cc18-45e4-8fed-4bdfab418244 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:38.606431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-763be4ed-cc18-45e4-8fed-4bdfab418244 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:38.606874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-763be4ed-cc18-45e4-8fed-4bdfab418244 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:38.646653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-763be4ed-cc18-45e4-8fed-4bdfab418244 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055713 Jul 25 19:35:38.647356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 685/1346] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:39.016258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-526d000f-d6fc-4e49-974d-f697ef00f911 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:39.017165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-526d000f-d6fc-4e49-974d-f697ef00f911 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:39.027458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-526d000f-d6fc-4e49-974d-f697ef00f911 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:39.028249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-526d000f-d6fc-4e49-974d-f697ef00f911 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:39.029687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-526d000f-d6fc-4e49-974d-f697ef00f911 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:39.030555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-526d000f-d6fc-4e49-974d-f697ef00f911 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:39.194076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-526d000f-d6fc-4e49-974d-f697ef00f911 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:39.202756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-526d000f-d6fc-4e49-974d-f697ef00f911 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.191303 Jul 25 19:35:39.203356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 662/1347] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:39 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:39.426827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1cd629b-2d8a-4f8d-af28-ff93fffddbda tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:39.430422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c1cd629b-2d8a-4f8d-af28-ff93fffddbda tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:39.439046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1cd629b-2d8a-4f8d-af28-ff93fffddbda tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:39.439502 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1cd629b-2d8a-4f8d-af28-ff93fffddbda tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:39.441113 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1cd629b-2d8a-4f8d-af28-ff93fffddbda tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:39.441914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1cd629b-2d8a-4f8d-af28-ff93fffddbda tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:39.479535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c1cd629b-2d8a-4f8d-af28-ff93fffddbda tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058540 Jul 25 19:35:39.480133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 686/1348] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:39.664979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0845e981-c573-4b43-aa5b-4b6e03beb1ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:39.669071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0845e981-c573-4b43-aa5b-4b6e03beb1ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:39.680872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0845e981-c573-4b43-aa5b-4b6e03beb1ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:39.681556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0845e981-c573-4b43-aa5b-4b6e03beb1ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:39.682873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0845e981-c573-4b43-aa5b-4b6e03beb1ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:39.683659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0845e981-c573-4b43-aa5b-4b6e03beb1ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:39.746035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0845e981-c573-4b43-aa5b-4b6e03beb1ba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088433 Jul 25 19:35:39.747152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 663/1349] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:40.228194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8acd381f-0196-48fe-ac80-da4ecc41e05d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:40.228920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8acd381f-0196-48fe-ac80-da4ecc41e05d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:40.236223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8acd381f-0196-48fe-ac80-da4ecc41e05d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:40.236697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8acd381f-0196-48fe-ac80-da4ecc41e05d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:40.238129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8acd381f-0196-48fe-ac80-da4ecc41e05d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:40.238723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8acd381f-0196-48fe-ac80-da4ecc41e05d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:40.416145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8acd381f-0196-48fe-ac80-da4ecc41e05d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:40.428610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8acd381f-0196-48fe-ac80-da4ecc41e05d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.204714 Jul 25 19:35:40.429546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 687/1350] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:40 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:40.493638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9335a58a-a7e5-414d-b6e7-00bfc5adf5f7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:40.496484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9335a58a-a7e5-414d-b6e7-00bfc5adf5f7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:40.504678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9335a58a-a7e5-414d-b6e7-00bfc5adf5f7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:40.505185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9335a58a-a7e5-414d-b6e7-00bfc5adf5f7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:40.506034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9335a58a-a7e5-414d-b6e7-00bfc5adf5f7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:40.506593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9335a58a-a7e5-414d-b6e7-00bfc5adf5f7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:40.542429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9335a58a-a7e5-414d-b6e7-00bfc5adf5f7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053088 Jul 25 19:35:40.543042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 664/1351] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:40.760463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc969e89-c2a9-4180-9eb5-3793a2f65c5b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:40.763024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc969e89-c2a9-4180-9eb5-3793a2f65c5b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:40.770683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc969e89-c2a9-4180-9eb5-3793a2f65c5b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:40.771135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc969e89-c2a9-4180-9eb5-3793a2f65c5b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:40.771978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc969e89-c2a9-4180-9eb5-3793a2f65c5b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:40.772410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc969e89-c2a9-4180-9eb5-3793a2f65c5b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:40.808816 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc969e89-c2a9-4180-9eb5-3793a2f65c5b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052461 Jul 25 19:35:40.809465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 688/1352] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:41.464981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e498a5b6-9368-4757-a8d0-684771bdf2d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:41.465682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e498a5b6-9368-4757-a8d0-684771bdf2d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:41.473454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e498a5b6-9368-4757-a8d0-684771bdf2d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:41.473960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e498a5b6-9368-4757-a8d0-684771bdf2d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:41.474768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e498a5b6-9368-4757-a8d0-684771bdf2d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:41.475209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e498a5b6-9368-4757-a8d0-684771bdf2d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:41.562957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de9eb4d3-602d-430a-b431-6936dbc5e5f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:41.567025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de9eb4d3-602d-430a-b431-6936dbc5e5f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:41.578359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de9eb4d3-602d-430a-b431-6936dbc5e5f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:41.579171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de9eb4d3-602d-430a-b431-6936dbc5e5f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:41.580569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de9eb4d3-602d-430a-b431-6936dbc5e5f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:41.581872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de9eb4d3-602d-430a-b431-6936dbc5e5f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:41.618169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de9eb4d3-602d-430a-b431-6936dbc5e5f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063686 Jul 25 19:35:41.619024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 689/1353] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:41.671821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e498a5b6-9368-4757-a8d0-684771bdf2d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:41.680789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e498a5b6-9368-4757-a8d0-684771bdf2d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.220233 Jul 25 19:35:41.681394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 665/1354] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:41 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:41.822391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4e8a1681-4853-4ea2-aeaf-9bec682f1c1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:41.824763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4e8a1681-4853-4ea2-aeaf-9bec682f1c1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:41.832333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e8a1681-4853-4ea2-aeaf-9bec682f1c1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:41.832789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e8a1681-4853-4ea2-aeaf-9bec682f1c1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:41.833664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e8a1681-4853-4ea2-aeaf-9bec682f1c1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:41.834028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e8a1681-4853-4ea2-aeaf-9bec682f1c1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:41.870152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4e8a1681-4853-4ea2-aeaf-9bec682f1c1b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051749 Jul 25 19:35:41.870714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 690/1355] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:42.631771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f9722a3d-7e5f-4c97-97ef-00f23d93adbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:42.634538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f9722a3d-7e5f-4c97-97ef-00f23d93adbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:42.642495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9722a3d-7e5f-4c97-97ef-00f23d93adbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:42.643140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9722a3d-7e5f-4c97-97ef-00f23d93adbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:42.644788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9722a3d-7e5f-4c97-97ef-00f23d93adbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:42.645337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9722a3d-7e5f-4c97-97ef-00f23d93adbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:42.686073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f9722a3d-7e5f-4c97-97ef-00f23d93adbb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059276 Jul 25 19:35:42.686804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 666/1356] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:42.704706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-722460b2-ec31-4978-975e-6ddb63394a4e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:42.705343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-722460b2-ec31-4978-975e-6ddb63394a4e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:42.713158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-722460b2-ec31-4978-975e-6ddb63394a4e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:42.713653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-722460b2-ec31-4978-975e-6ddb63394a4e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:42.714482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-722460b2-ec31-4978-975e-6ddb63394a4e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:42.714956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-722460b2-ec31-4978-975e-6ddb63394a4e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:42.867666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-722460b2-ec31-4978-975e-6ddb63394a4e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:42.875776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-722460b2-ec31-4978-975e-6ddb63394a4e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.174832 Jul 25 19:35:42.876366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 691/1357] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:42 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:42.884377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7f39f88d-dadf-4604-9b1a-c70705ba00d7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:42.886815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7f39f88d-dadf-4604-9b1a-c70705ba00d7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:42.895743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f39f88d-dadf-4604-9b1a-c70705ba00d7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:42.896197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f39f88d-dadf-4604-9b1a-c70705ba00d7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:42.896995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f39f88d-dadf-4604-9b1a-c70705ba00d7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:42.897434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f39f88d-dadf-4604-9b1a-c70705ba00d7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:42.934018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7f39f88d-dadf-4604-9b1a-c70705ba00d7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053781 Jul 25 19:35:42.934617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 667/1358] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:42 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:43.707767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4193d7ee-c558-49a6-872d-0816b2b2af17 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:43.711444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4193d7ee-c558-49a6-872d-0816b2b2af17 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:43.723838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4193d7ee-c558-49a6-872d-0816b2b2af17 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:43.724648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4193d7ee-c558-49a6-872d-0816b2b2af17 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:43.726029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4193d7ee-c558-49a6-872d-0816b2b2af17 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:43.726802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4193d7ee-c558-49a6-872d-0816b2b2af17 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:43.789494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4193d7ee-c558-49a6-872d-0816b2b2af17 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090547 Jul 25 19:35:43.790576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 692/1359] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:43.899557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6a492cfa-d3c7-4fe5-93ba-a7f6f39d14ef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:43.900354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6a492cfa-d3c7-4fe5-93ba-a7f6f39d14ef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:43.907712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a492cfa-d3c7-4fe5-93ba-a7f6f39d14ef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:43.908156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a492cfa-d3c7-4fe5-93ba-a7f6f39d14ef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:43.908943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a492cfa-d3c7-4fe5-93ba-a7f6f39d14ef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:43.910055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a492cfa-d3c7-4fe5-93ba-a7f6f39d14ef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:43.949970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-709000db-821d-4d51-b7cd-eebbbf599471 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:43.953920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-709000db-821d-4d51-b7cd-eebbbf599471 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:43.967797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-709000db-821d-4d51-b7cd-eebbbf599471 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:43.968843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-709000db-821d-4d51-b7cd-eebbbf599471 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:43.970163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-709000db-821d-4d51-b7cd-eebbbf599471 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:43.970863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-709000db-821d-4d51-b7cd-eebbbf599471 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:44.031272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-709000db-821d-4d51-b7cd-eebbbf599471 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087272 Jul 25 19:35:44.039394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 693/1360] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:44.112282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6a492cfa-d3c7-4fe5-93ba-a7f6f39d14ef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:44.129399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6a492cfa-d3c7-4fe5-93ba-a7f6f39d14ef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.234043 Jul 25 19:35:44.131560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 668/1361] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:43 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:44.806013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-faa0fb25-fb30-46fe-840b-a8647527a189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:44.808491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-faa0fb25-fb30-46fe-840b-a8647527a189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:44.815173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faa0fb25-fb30-46fe-840b-a8647527a189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:44.815711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faa0fb25-fb30-46fe-840b-a8647527a189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:44.816585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faa0fb25-fb30-46fe-840b-a8647527a189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:44.817114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faa0fb25-fb30-46fe-840b-a8647527a189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:44.853930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-faa0fb25-fb30-46fe-840b-a8647527a189 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052265 Jul 25 19:35:44.854863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 694/1362] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:45.046940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8eefb9fb-7603-4bbe-ac20-bc207d78a316 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:45.049277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8eefb9fb-7603-4bbe-ac20-bc207d78a316 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:45.057325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8eefb9fb-7603-4bbe-ac20-bc207d78a316 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:45.057680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8eefb9fb-7603-4bbe-ac20-bc207d78a316 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:45.058495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8eefb9fb-7603-4bbe-ac20-bc207d78a316 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:45.058917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8eefb9fb-7603-4bbe-ac20-bc207d78a316 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:45.095711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8eefb9fb-7603-4bbe-ac20-bc207d78a316 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052754 Jul 25 19:35:45.096318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 669/1363] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:45.157222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b45e424-5e08-4048-92d8-e23d0c167715 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:45.158211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b45e424-5e08-4048-92d8-e23d0c167715 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:45.166297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b45e424-5e08-4048-92d8-e23d0c167715 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:45.166787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b45e424-5e08-4048-92d8-e23d0c167715 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:45.167796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b45e424-5e08-4048-92d8-e23d0c167715 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:45.168289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b45e424-5e08-4048-92d8-e23d0c167715 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:45.330706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b45e424-5e08-4048-92d8-e23d0c167715 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:45.339206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b45e424-5e08-4048-92d8-e23d0c167715 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.186431 Jul 25 19:35:45.339844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 695/1364] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:45 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:45.871160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2296ebdc-63b7-43ec-ae11-351fb38c3902 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:45.873530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2296ebdc-63b7-43ec-ae11-351fb38c3902 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:45.881492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2296ebdc-63b7-43ec-ae11-351fb38c3902 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:45.882133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2296ebdc-63b7-43ec-ae11-351fb38c3902 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:45.882997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2296ebdc-63b7-43ec-ae11-351fb38c3902 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:45.883484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2296ebdc-63b7-43ec-ae11-351fb38c3902 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:45.900028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:45.919271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2296ebdc-63b7-43ec-ae11-351fb38c3902 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052429 Jul 25 19:35:45.919906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 670/1365] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:46.111299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-76f39ae9-39d9-4ec4-9185-49b15ea7c595 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:46.115430 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-76f39ae9-39d9-4ec4-9185-49b15ea7c595 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:46.122542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76f39ae9-39d9-4ec4-9185-49b15ea7c595 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:46.122940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76f39ae9-39d9-4ec4-9185-49b15ea7c595 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:46.123937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76f39ae9-39d9-4ec4-9185-49b15ea7c595 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:46.124433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76f39ae9-39d9-4ec4-9185-49b15ea7c595 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:46.175213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-76f39ae9-39d9-4ec4-9185-49b15ea7c595 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067848 Jul 25 19:35:46.176440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 696/1366] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:46.362763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ba8cacaa-701f-4f34-aa07-3134f7e6c27d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:46.363428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ba8cacaa-701f-4f34-aa07-3134f7e6c27d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:46.371623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba8cacaa-701f-4f34-aa07-3134f7e6c27d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:46.372065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba8cacaa-701f-4f34-aa07-3134f7e6c27d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:46.372920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba8cacaa-701f-4f34-aa07-3134f7e6c27d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:46.373303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba8cacaa-701f-4f34-aa07-3134f7e6c27d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:46.534435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ba8cacaa-701f-4f34-aa07-3134f7e6c27d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:46.545900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ba8cacaa-701f-4f34-aa07-3134f7e6c27d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.186711 Jul 25 19:35:46.546735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 671/1367] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:46 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:46.933341 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e09f50c9-1a3e-4353-9a1e-f5d85ddeb3cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:46.935694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e09f50c9-1a3e-4353-9a1e-f5d85ddeb3cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:46.944603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e09f50c9-1a3e-4353-9a1e-f5d85ddeb3cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:46.945125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e09f50c9-1a3e-4353-9a1e-f5d85ddeb3cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:46.945964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e09f50c9-1a3e-4353-9a1e-f5d85ddeb3cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:46.946447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e09f50c9-1a3e-4353-9a1e-f5d85ddeb3cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:46.982127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e09f50c9-1a3e-4353-9a1e-f5d85ddeb3cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053051 Jul 25 19:35:46.982754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 697/1368] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:47.194436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c8de930c-fc36-4d76-a95f-a26b4f2d77ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:47.196687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c8de930c-fc36-4d76-a95f-a26b4f2d77ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:47.203732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8de930c-fc36-4d76-a95f-a26b4f2d77ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:47.204178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8de930c-fc36-4d76-a95f-a26b4f2d77ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:47.204960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8de930c-fc36-4d76-a95f-a26b4f2d77ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:47.205395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8de930c-fc36-4d76-a95f-a26b4f2d77ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:47.243570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c8de930c-fc36-4d76-a95f-a26b4f2d77ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054103 Jul 25 19:35:47.244270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 672/1369] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:47.570573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5ebd775c-2c2c-40c3-900b-5fe5df788732 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:47.571862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5ebd775c-2c2c-40c3-900b-5fe5df788732 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:47.583955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ebd775c-2c2c-40c3-900b-5fe5df788732 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:47.584402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ebd775c-2c2c-40c3-900b-5fe5df788732 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:47.585369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ebd775c-2c2c-40c3-900b-5fe5df788732 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:47.585869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ebd775c-2c2c-40c3-900b-5fe5df788732 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:47.589253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:47.786164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5ebd775c-2c2c-40c3-900b-5fe5df788732 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:47.794706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5ebd775c-2c2c-40c3-900b-5fe5df788732 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.229054 Jul 25 19:35:47.795355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 698/1370] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:47 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:47.995989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0da1099c-33f0-4723-9d90-67534447311e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:47.998219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0da1099c-33f0-4723-9d90-67534447311e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:48.005726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0da1099c-33f0-4723-9d90-67534447311e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:48.006237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0da1099c-33f0-4723-9d90-67534447311e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:48.007139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0da1099c-33f0-4723-9d90-67534447311e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:48.007721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0da1099c-33f0-4723-9d90-67534447311e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:48.043850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0da1099c-33f0-4723-9d90-67534447311e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051975 Jul 25 19:35:48.044569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 673/1371] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:48.259000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4cb0f1de-37eb-46a7-a365-e4dd49311cb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:48.261601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4cb0f1de-37eb-46a7-a365-e4dd49311cb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:48.270080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cb0f1de-37eb-46a7-a365-e4dd49311cb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:48.270600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cb0f1de-37eb-46a7-a365-e4dd49311cb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:48.271450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cb0f1de-37eb-46a7-a365-e4dd49311cb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:48.272006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cb0f1de-37eb-46a7-a365-e4dd49311cb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:48.308442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4cb0f1de-37eb-46a7-a365-e4dd49311cb3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054039 Jul 25 19:35:48.309570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 699/1372] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:48.818060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-db900255-9237-4129-8553-f64067697b40 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:48.818840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-db900255-9237-4129-8553-f64067697b40 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:48.826191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db900255-9237-4129-8553-f64067697b40 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:48.826869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db900255-9237-4129-8553-f64067697b40 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:48.827870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db900255-9237-4129-8553-f64067697b40 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:48.828357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db900255-9237-4129-8553-f64067697b40 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:48.991883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-db900255-9237-4129-8553-f64067697b40 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:49.001631 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-db900255-9237-4129-8553-f64067697b40 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.188304 Jul 25 19:35:49.002382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 674/1373] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:48 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:49.057493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-caa521e8-a0cd-4607-9126-4a195926779d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:49.060212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-caa521e8-a0cd-4607-9126-4a195926779d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:49.068195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-caa521e8-a0cd-4607-9126-4a195926779d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:49.068709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-caa521e8-a0cd-4607-9126-4a195926779d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:49.069802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-caa521e8-a0cd-4607-9126-4a195926779d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:49.070391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-caa521e8-a0cd-4607-9126-4a195926779d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:49.107121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-caa521e8-a0cd-4607-9126-4a195926779d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053923 Jul 25 19:35:49.107945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 700/1374] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:49.325272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-29a50d59-a610-4bb6-a7b9-724066f95fba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:49.327911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-29a50d59-a610-4bb6-a7b9-724066f95fba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:49.334744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29a50d59-a610-4bb6-a7b9-724066f95fba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:49.335235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29a50d59-a610-4bb6-a7b9-724066f95fba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:49.336277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29a50d59-a610-4bb6-a7b9-724066f95fba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:49.336756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29a50d59-a610-4bb6-a7b9-724066f95fba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:49.372709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-29a50d59-a610-4bb6-a7b9-724066f95fba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051849 Jul 25 19:35:49.373359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 675/1375] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:50.024803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e22dfcf8-47be-4ef9-a249-5410ac4c3356 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:50.025400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e22dfcf8-47be-4ef9-a249-5410ac4c3356 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:50.032375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e22dfcf8-47be-4ef9-a249-5410ac4c3356 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:50.032825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e22dfcf8-47be-4ef9-a249-5410ac4c3356 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:50.033614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e22dfcf8-47be-4ef9-a249-5410ac4c3356 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:50.035151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e22dfcf8-47be-4ef9-a249-5410ac4c3356 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:50.123297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ff627177-68ab-4303-8e1d-bbba60142fde tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:50.128533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ff627177-68ab-4303-8e1d-bbba60142fde tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:50.137567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff627177-68ab-4303-8e1d-bbba60142fde tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:50.138223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff627177-68ab-4303-8e1d-bbba60142fde tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:50.139203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff627177-68ab-4303-8e1d-bbba60142fde tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:50.139805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff627177-68ab-4303-8e1d-bbba60142fde tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:50.200489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ff627177-68ab-4303-8e1d-bbba60142fde tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082485 Jul 25 19:35:50.201598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 676/1376] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:50.210160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e22dfcf8-47be-4ef9-a249-5410ac4c3356 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:50.218316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e22dfcf8-47be-4ef9-a249-5410ac4c3356 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.197581 Jul 25 19:35:50.218908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 701/1377] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:50 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:50.386119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-44fd1477-c03e-48f3-912c-dc897be31191 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:50.388647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-44fd1477-c03e-48f3-912c-dc897be31191 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:50.396404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44fd1477-c03e-48f3-912c-dc897be31191 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:50.396850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44fd1477-c03e-48f3-912c-dc897be31191 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:50.397646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44fd1477-c03e-48f3-912c-dc897be31191 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:50.398094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44fd1477-c03e-48f3-912c-dc897be31191 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:50.435810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-44fd1477-c03e-48f3-912c-dc897be31191 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053728 Jul 25 19:35:50.436749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 677/1378] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:51.216270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6c7791c7-fc21-4300-8aaa-1acf50e2d2fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:51.218700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6c7791c7-fc21-4300-8aaa-1acf50e2d2fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:51.227142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c7791c7-fc21-4300-8aaa-1acf50e2d2fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:51.227951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c7791c7-fc21-4300-8aaa-1acf50e2d2fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:51.228888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c7791c7-fc21-4300-8aaa-1acf50e2d2fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:51.229570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c7791c7-fc21-4300-8aaa-1acf50e2d2fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:51.243905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4f6e0842-d4bb-4379-b75d-da3f708e1a8d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:51.244831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4f6e0842-d4bb-4379-b75d-da3f708e1a8d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:51.251982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f6e0842-d4bb-4379-b75d-da3f708e1a8d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:51.252529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f6e0842-d4bb-4379-b75d-da3f708e1a8d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:51.254922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f6e0842-d4bb-4379-b75d-da3f708e1a8d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:51.255368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f6e0842-d4bb-4379-b75d-da3f708e1a8d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:51.284537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6c7791c7-fc21-4300-8aaa-1acf50e2d2fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072111 Jul 25 19:35:51.286059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 702/1379] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:51.434332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f6e0842-d4bb-4379-b75d-da3f708e1a8d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:51.444873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4f6e0842-d4bb-4379-b75d-da3f708e1a8d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.205913 Jul 25 19:35:51.445963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 678/1380] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:51 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:51.451371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-678d5fc0-eff8-4cd2-987f-3a710fe9a236 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:51.454090 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-678d5fc0-eff8-4cd2-987f-3a710fe9a236 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:51.457095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=82 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:51.464622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-678d5fc0-eff8-4cd2-987f-3a710fe9a236 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:51.465073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-678d5fc0-eff8-4cd2-987f-3a710fe9a236 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:51.465873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-678d5fc0-eff8-4cd2-987f-3a710fe9a236 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:51.466310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-678d5fc0-eff8-4cd2-987f-3a710fe9a236 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:51.501958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-678d5fc0-eff8-4cd2-987f-3a710fe9a236 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054940 Jul 25 19:35:51.502544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 703/1381] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:52.304053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ad3f15b7-85d6-445f-b019-0fc8c5de1369 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:52.306326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ad3f15b7-85d6-445f-b019-0fc8c5de1369 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:52.314439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad3f15b7-85d6-445f-b019-0fc8c5de1369 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:52.314937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad3f15b7-85d6-445f-b019-0fc8c5de1369 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:52.316535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad3f15b7-85d6-445f-b019-0fc8c5de1369 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:52.317217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad3f15b7-85d6-445f-b019-0fc8c5de1369 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:52.352887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ad3f15b7-85d6-445f-b019-0fc8c5de1369 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053934 Jul 25 19:35:52.353490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 679/1382] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:52 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:52.469818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f8c5649c-254e-492d-8775-a0162b45508d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:52.470445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f8c5649c-254e-492d-8775-a0162b45508d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:52.479329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8c5649c-254e-492d-8775-a0162b45508d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:52.479980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8c5649c-254e-492d-8775-a0162b45508d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:52.480860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8c5649c-254e-492d-8775-a0162b45508d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:52.481475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8c5649c-254e-492d-8775-a0162b45508d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:52.520985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-76251c43-d6fc-4b64-be84-344ee868cf22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:52.524846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-76251c43-d6fc-4b64-be84-344ee868cf22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:52.536007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76251c43-d6fc-4b64-be84-344ee868cf22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:52.536945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76251c43-d6fc-4b64-be84-344ee868cf22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:52.538325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76251c43-d6fc-4b64-be84-344ee868cf22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:52.538970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76251c43-d6fc-4b64-be84-344ee868cf22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:52.597324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-76251c43-d6fc-4b64-be84-344ee868cf22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082443 Jul 25 19:35:52.598222 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 680/1383] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:52 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:52.638350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f8c5649c-254e-492d-8775-a0162b45508d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:52.648483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f8c5649c-254e-492d-8775-a0162b45508d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.182472 Jul 25 19:35:52.649170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 704/1384] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:52 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:53.368841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d2d581cb-e80d-4bbe-a681-a1a0c90ef7db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:53.371245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d2d581cb-e80d-4bbe-a681-a1a0c90ef7db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:53.379217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2d581cb-e80d-4bbe-a681-a1a0c90ef7db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:53.379703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2d581cb-e80d-4bbe-a681-a1a0c90ef7db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:53.380578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2d581cb-e80d-4bbe-a681-a1a0c90ef7db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:53.381012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2d581cb-e80d-4bbe-a681-a1a0c90ef7db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:53.417909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d2d581cb-e80d-4bbe-a681-a1a0c90ef7db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053672 Jul 25 19:35:53.418570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 681/1385] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:53.614956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5d67c7d3-16ec-4e58-a16d-87bc01d52ffb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:53.618811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5d67c7d3-16ec-4e58-a16d-87bc01d52ffb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:53.631675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d67c7d3-16ec-4e58-a16d-87bc01d52ffb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:53.632394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d67c7d3-16ec-4e58-a16d-87bc01d52ffb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:53.633812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d67c7d3-16ec-4e58-a16d-87bc01d52ffb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:53.634595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d67c7d3-16ec-4e58-a16d-87bc01d52ffb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:53.671768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f0b4e215-1172-4d0e-91a7-41ad468ef723 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:53.672383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f0b4e215-1172-4d0e-91a7-41ad468ef723 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:53.680181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0b4e215-1172-4d0e-91a7-41ad468ef723 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:53.680625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0b4e215-1172-4d0e-91a7-41ad468ef723 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:53.682232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0b4e215-1172-4d0e-91a7-41ad468ef723 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:53.682909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0b4e215-1172-4d0e-91a7-41ad468ef723 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:53.691297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5d67c7d3-16ec-4e58-a16d-87bc01d52ffb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084005 Jul 25 19:35:53.692227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 705/1386] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:53.840678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f0b4e215-1172-4d0e-91a7-41ad468ef723 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:53.856421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f0b4e215-1172-4d0e-91a7-41ad468ef723 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.188243 Jul 25 19:35:53.857472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 682/1387] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:53 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:54.435827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13901bad-9e36-4f59-8e57-29ad1e3b632a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:54.439540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-13901bad-9e36-4f59-8e57-29ad1e3b632a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:54.449114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13901bad-9e36-4f59-8e57-29ad1e3b632a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:54.449593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13901bad-9e36-4f59-8e57-29ad1e3b632a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:54.450514 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13901bad-9e36-4f59-8e57-29ad1e3b632a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:54.450960 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13901bad-9e36-4f59-8e57-29ad1e3b632a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:54.488387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13901bad-9e36-4f59-8e57-29ad1e3b632a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060275 Jul 25 19:35:54.489333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 706/1388] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:54.707643 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-13e63a38-b59a-4dea-8b02-2a1aca71d0be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:54.709982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-13e63a38-b59a-4dea-8b02-2a1aca71d0be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:54.717203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13e63a38-b59a-4dea-8b02-2a1aca71d0be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:54.717647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13e63a38-b59a-4dea-8b02-2a1aca71d0be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:54.718436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13e63a38-b59a-4dea-8b02-2a1aca71d0be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:54.718874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13e63a38-b59a-4dea-8b02-2a1aca71d0be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:54.758689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-13e63a38-b59a-4dea-8b02-2a1aca71d0be tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056389 Jul 25 19:35:54.759277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 683/1389] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:35:54.889094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1b8718c3-db4f-4562-a41f-eaf784a58a22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:54.890205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1b8718c3-db4f-4562-a41f-eaf784a58a22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:54.902622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b8718c3-db4f-4562-a41f-eaf784a58a22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:54.903122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b8718c3-db4f-4562-a41f-eaf784a58a22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:54.905725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b8718c3-db4f-4562-a41f-eaf784a58a22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:54.906307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b8718c3-db4f-4562-a41f-eaf784a58a22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:55.084448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1b8718c3-db4f-4562-a41f-eaf784a58a22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:55.096257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1b8718c3-db4f-4562-a41f-eaf784a58a22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.218788 Jul 25 19:35:55.097239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 707/1390] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:54 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:55.502259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5ecf98d0-903f-405e-8712-28f59c7758db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:55.505913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5ecf98d0-903f-405e-8712-28f59c7758db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:55.520008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ecf98d0-903f-405e-8712-28f59c7758db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:55.520619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ecf98d0-903f-405e-8712-28f59c7758db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:55.521466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ecf98d0-903f-405e-8712-28f59c7758db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:55.522144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ecf98d0-903f-405e-8712-28f59c7758db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:55.575953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5ecf98d0-903f-405e-8712-28f59c7758db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077947 Jul 25 19:35:55.576743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 684/1391] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:55.773564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f3778970-4876-4b21-923c-694ffa328eaa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:55.776881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f3778970-4876-4b21-923c-694ffa328eaa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:55.784990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3778970-4876-4b21-923c-694ffa328eaa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:55.785495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3778970-4876-4b21-923c-694ffa328eaa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:55.786727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3778970-4876-4b21-923c-694ffa328eaa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:55.786902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3778970-4876-4b21-923c-694ffa328eaa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:55.825883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f3778970-4876-4b21-923c-694ffa328eaa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058381 Jul 25 19:35:55.826690 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 708/1392] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:56.121840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-886259a4-bc7f-4108-bb54-401cdc84f1ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:56.122486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-886259a4-bc7f-4108-bb54-401cdc84f1ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:56.130869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-886259a4-bc7f-4108-bb54-401cdc84f1ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:56.131327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-886259a4-bc7f-4108-bb54-401cdc84f1ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:56.132266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-886259a4-bc7f-4108-bb54-401cdc84f1ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:56.132700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-886259a4-bc7f-4108-bb54-401cdc84f1ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:56.366086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-886259a4-bc7f-4108-bb54-401cdc84f1ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:56.374569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-886259a4-bc7f-4108-bb54-401cdc84f1ec tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.256903 Jul 25 19:35:56.375172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 685/1393] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:56 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:56.600877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3e3427c5-6225-435e-9628-5982ce6c8c94 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:56.604523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3e3427c5-6225-435e-9628-5982ce6c8c94 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:56.612696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e3427c5-6225-435e-9628-5982ce6c8c94 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:56.612696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e3427c5-6225-435e-9628-5982ce6c8c94 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:56.613796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e3427c5-6225-435e-9628-5982ce6c8c94 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:56.614293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e3427c5-6225-435e-9628-5982ce6c8c94 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:56.652707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3e3427c5-6225-435e-9628-5982ce6c8c94 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056465 Jul 25 19:35:56.653764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 709/1394] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:56 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:56.839022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2b0d3dc1-b638-401f-92fa-f8968c785018 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:56.841384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2b0d3dc1-b638-401f-92fa-f8968c785018 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:56.849220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b0d3dc1-b638-401f-92fa-f8968c785018 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:56.849727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b0d3dc1-b638-401f-92fa-f8968c785018 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:56.850656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b0d3dc1-b638-401f-92fa-f8968c785018 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:56.851209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b0d3dc1-b638-401f-92fa-f8968c785018 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:56.888231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2b0d3dc1-b638-401f-92fa-f8968c785018 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053256 Jul 25 19:35:56.888739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 686/1395] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:57.399008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-23568ce7-9f37-41c0-b87e-555fed226c45 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:57.399829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-23568ce7-9f37-41c0-b87e-555fed226c45 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:57.407139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23568ce7-9f37-41c0-b87e-555fed226c45 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:57.407619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23568ce7-9f37-41c0-b87e-555fed226c45 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:57.408411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23568ce7-9f37-41c0-b87e-555fed226c45 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:57.408968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23568ce7-9f37-41c0-b87e-555fed226c45 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:57.568794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-23568ce7-9f37-41c0-b87e-555fed226c45 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:57.578753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-23568ce7-9f37-41c0-b87e-555fed226c45 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.184736 Jul 25 19:35:57.579432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 710/1396] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:57 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:35:57.666948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8175df96-54e9-436e-a486-0e01d9b7ee2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:57.669215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8175df96-54e9-436e-a486-0e01d9b7ee2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:57.676699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8175df96-54e9-436e-a486-0e01d9b7ee2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:57.677153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8175df96-54e9-436e-a486-0e01d9b7ee2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:57.677945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8175df96-54e9-436e-a486-0e01d9b7ee2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:57.678386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8175df96-54e9-436e-a486-0e01d9b7ee2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:57.681368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:35:57.714540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8175df96-54e9-436e-a486-0e01d9b7ee2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051636 Jul 25 19:35:57.715246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 687/1397] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:35:57.902345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50828468-97b4-4311-aeec-f58e881dc950 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:57.905147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50828468-97b4-4311-aeec-f58e881dc950 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:57.913439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50828468-97b4-4311-aeec-f58e881dc950 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:57.913876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50828468-97b4-4311-aeec-f58e881dc950 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:57.914738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50828468-97b4-4311-aeec-f58e881dc950 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:57.915171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50828468-97b4-4311-aeec-f58e881dc950 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:57.950213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50828468-97b4-4311-aeec-f58e881dc950 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052351 Jul 25 19:35:57.950804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 711/1398] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:35:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:35:58.603260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d2760192-863a-4239-ba46-5f15f0bfd320 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:58.603886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d2760192-863a-4239-ba46-5f15f0bfd320 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:58.610365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2760192-863a-4239-ba46-5f15f0bfd320 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:58.610796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2760192-863a-4239-ba46-5f15f0bfd320 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:58.611618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2760192-863a-4239-ba46-5f15f0bfd320 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:58.612144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2760192-863a-4239-ba46-5f15f0bfd320 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:58.778701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d2760192-863a-4239-ba46-5f15f0bfd320 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:35:58.789438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d2760192-863a-4239-ba46-5f15f0bfd320 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.190704 Jul 25 19:35:58.790132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 688/1399] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:58 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:35:58.818476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-27d27e3b-1e07-4e9a-a743-2d0341643893 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:58.820894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-27d27e3b-1e07-4e9a-a743-2d0341643893 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:58.827697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27d27e3b-1e07-4e9a-a743-2d0341643893 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:58.828202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27d27e3b-1e07-4e9a-a743-2d0341643893 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:58.829036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27d27e3b-1e07-4e9a-a743-2d0341643893 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:58.829544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27d27e3b-1e07-4e9a-a743-2d0341643893 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:58.889852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-27d27e3b-1e07-4e9a-a743-2d0341643893 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.164613 Jul 25 19:35:58.890818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 712/1400] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:58.969843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-802f40c1-aab2-44f6-89a0-da346b098310 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:35:58.973353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-802f40c1-aab2-44f6-89a0-da346b098310 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:58.980753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-802f40c1-aab2-44f6-89a0-da346b098310 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:58.981204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-802f40c1-aab2-44f6-89a0-da346b098310 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:58.982000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-802f40c1-aab2-44f6-89a0-da346b098310 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:58.982447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-802f40c1-aab2-44f6-89a0-da346b098310 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:59.124901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-802f40c1-aab2-44f6-89a0-da346b098310 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/action" status: 200 len: 41379 microversion: 2.1 time: 0.160910 Jul 25 19:35:59.125841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 689/1401] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 19:35:58 2022] POST /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888/action => generated 41379 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:35:59.824590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-022f05dc-c64f-45e0-a85d-dec621d62c93 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:59.825305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-022f05dc-c64f-45e0-a85d-dec621d62c93 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:59.834772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022f05dc-c64f-45e0-a85d-dec621d62c93 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:59.835318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022f05dc-c64f-45e0-a85d-dec621d62c93 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:59.836305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022f05dc-c64f-45e0-a85d-dec621d62c93 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:59.836910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022f05dc-c64f-45e0-a85d-dec621d62c93 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:59.908485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f3dbcb16-1b7b-428f-bc95-08f8814401f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:35:59.913795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f3dbcb16-1b7b-428f-bc95-08f8814401f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:35:59.924150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3dbcb16-1b7b-428f-bc95-08f8814401f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:59.924906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3dbcb16-1b7b-428f-bc95-08f8814401f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:59.926005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3dbcb16-1b7b-428f-bc95-08f8814401f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:35:59.926507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3dbcb16-1b7b-428f-bc95-08f8814401f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:35:59.965737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f3dbcb16-1b7b-428f-bc95-08f8814401f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062201 Jul 25 19:35:59.966363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 690/1402] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:35:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:36:00.041308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-022f05dc-c64f-45e0-a85d-dec621d62c93 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:00.050577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-022f05dc-c64f-45e0-a85d-dec621d62c93 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.229544 Jul 25 19:36:00.051503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 713/1403] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:35:59 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:00.981075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dde480eb-c393-4601-9081-e46f793c07e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:00.983400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dde480eb-c393-4601-9081-e46f793c07e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:00.991731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dde480eb-c393-4601-9081-e46f793c07e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:00.992231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dde480eb-c393-4601-9081-e46f793c07e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:00.993091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dde480eb-c393-4601-9081-e46f793c07e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:00.993544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dde480eb-c393-4601-9081-e46f793c07e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:01.029784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dde480eb-c393-4601-9081-e46f793c07e9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054144 Jul 25 19:36:01.030405 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 691/1404] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:01.073201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d1f535e-16cf-4d19-ab7a-e06fd7a118f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:01.073854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d1f535e-16cf-4d19-ab7a-e06fd7a118f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:01.082021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d1f535e-16cf-4d19-ab7a-e06fd7a118f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:01.082483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d1f535e-16cf-4d19-ab7a-e06fd7a118f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:01.083291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d1f535e-16cf-4d19-ab7a-e06fd7a118f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:01.083938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d1f535e-16cf-4d19-ab7a-e06fd7a118f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:01.248810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d1f535e-16cf-4d19-ab7a-e06fd7a118f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:01.253302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:01.265538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d1f535e-16cf-4d19-ab7a-e06fd7a118f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.196297 Jul 25 19:36:01.266616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 714/1405] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:01 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:02.046817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b3c49ecc-2783-4412-89f4-807711d49922 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:02.049138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b3c49ecc-2783-4412-89f4-807711d49922 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:02.057305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3c49ecc-2783-4412-89f4-807711d49922 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:02.057971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3c49ecc-2783-4412-89f4-807711d49922 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:02.059690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3c49ecc-2783-4412-89f4-807711d49922 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:02.059924 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3c49ecc-2783-4412-89f4-807711d49922 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:02.096122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b3c49ecc-2783-4412-89f4-807711d49922 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053329 Jul 25 19:36:02.097459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 692/1406] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:02.290018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ea95c1ad-7e32-4bd5-ab3d-33a5ea06da51 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:02.290674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ea95c1ad-7e32-4bd5-ab3d-33a5ea06da51 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:02.298162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea95c1ad-7e32-4bd5-ab3d-33a5ea06da51 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:02.298595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea95c1ad-7e32-4bd5-ab3d-33a5ea06da51 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:02.299408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea95c1ad-7e32-4bd5-ab3d-33a5ea06da51 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:02.300735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea95c1ad-7e32-4bd5-ab3d-33a5ea06da51 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:02.462327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ea95c1ad-7e32-4bd5-ab3d-33a5ea06da51 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:02.470294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ea95c1ad-7e32-4bd5-ab3d-33a5ea06da51 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.184965 Jul 25 19:36:02.470883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 715/1407] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:02 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:02.891435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:36:02.891786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:36:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:36:03.113980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e8e27a4d-31cc-413a-8b72-1cd188a0ac48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:03.116321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e8e27a4d-31cc-413a-8b72-1cd188a0ac48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:03.123730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8e27a4d-31cc-413a-8b72-1cd188a0ac48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:03.124188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8e27a4d-31cc-413a-8b72-1cd188a0ac48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:03.124971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8e27a4d-31cc-413a-8b72-1cd188a0ac48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:03.125413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8e27a4d-31cc-413a-8b72-1cd188a0ac48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:03.160937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e8e27a4d-31cc-413a-8b72-1cd188a0ac48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051853 Jul 25 19:36:03.161452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 693/1408] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:03.496407 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a5c006b0-f20e-4fe5-a2ec-cb188e6dc4cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:03.496987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a5c006b0-f20e-4fe5-a2ec-cb188e6dc4cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:03.505132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5c006b0-f20e-4fe5-a2ec-cb188e6dc4cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:03.505590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5c006b0-f20e-4fe5-a2ec-cb188e6dc4cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:03.506410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5c006b0-f20e-4fe5-a2ec-cb188e6dc4cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:03.507197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5c006b0-f20e-4fe5-a2ec-cb188e6dc4cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:03.673596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a5c006b0-f20e-4fe5-a2ec-cb188e6dc4cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:03.683039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a5c006b0-f20e-4fe5-a2ec-cb188e6dc4cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.192411 Jul 25 19:36:03.683649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 716/1409] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:03 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:04.174256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9caf9d1b-e754-4a83-8123-50aff2420828 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:04.177240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9caf9d1b-e754-4a83-8123-50aff2420828 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:04.184833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9caf9d1b-e754-4a83-8123-50aff2420828 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:04.185323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9caf9d1b-e754-4a83-8123-50aff2420828 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:04.186536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9caf9d1b-e754-4a83-8123-50aff2420828 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:04.187032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9caf9d1b-e754-4a83-8123-50aff2420828 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:04.223654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9caf9d1b-e754-4a83-8123-50aff2420828 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053505 Jul 25 19:36:04.224283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 694/1410] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:36:04.709129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7ad85289-de65-4c30-95a4-a18b0dcf5cd7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:04.709793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7ad85289-de65-4c30-95a4-a18b0dcf5cd7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:04.716847 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ad85289-de65-4c30-95a4-a18b0dcf5cd7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:04.717296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ad85289-de65-4c30-95a4-a18b0dcf5cd7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:04.718085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ad85289-de65-4c30-95a4-a18b0dcf5cd7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:04.718527 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ad85289-de65-4c30-95a4-a18b0dcf5cd7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:04.887400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7ad85289-de65-4c30-95a4-a18b0dcf5cd7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:04.896429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7ad85289-de65-4c30-95a4-a18b0dcf5cd7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.191867 Jul 25 19:36:04.897030 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 717/1411] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:04 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:05.238030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-11ed9c71-d390-4269-ad72-cb78795fa07d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:05.240395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-11ed9c71-d390-4269-ad72-cb78795fa07d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:05.247840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11ed9c71-d390-4269-ad72-cb78795fa07d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:05.248295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11ed9c71-d390-4269-ad72-cb78795fa07d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:05.249108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11ed9c71-d390-4269-ad72-cb78795fa07d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:05.249554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11ed9c71-d390-4269-ad72-cb78795fa07d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:05.286266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-11ed9c71-d390-4269-ad72-cb78795fa07d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053045 Jul 25 19:36:05.286872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 695/1412] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:36:05.920889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-93694a9a-dc44-451d-9837-8d2073a8ba20 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:05.921723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93694a9a-dc44-451d-9837-8d2073a8ba20 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:05.928489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93694a9a-dc44-451d-9837-8d2073a8ba20 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:05.928939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93694a9a-dc44-451d-9837-8d2073a8ba20 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:05.929728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93694a9a-dc44-451d-9837-8d2073a8ba20 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:05.930172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93694a9a-dc44-451d-9837-8d2073a8ba20 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:06.091096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93694a9a-dc44-451d-9837-8d2073a8ba20 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:06.100870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-93694a9a-dc44-451d-9837-8d2073a8ba20 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.184572 Jul 25 19:36:06.101476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 718/1413] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:05 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:06.299023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1ead1ab8-1237-4b23-98d2-77271801ce78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:06.301337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1ead1ab8-1237-4b23-98d2-77271801ce78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:06.304090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=76 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:06.310072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ead1ab8-1237-4b23-98d2-77271801ce78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:06.310522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ead1ab8-1237-4b23-98d2-77271801ce78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:06.311313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ead1ab8-1237-4b23-98d2-77271801ce78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:06.311913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ead1ab8-1237-4b23-98d2-77271801ce78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:06.348137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1ead1ab8-1237-4b23-98d2-77271801ce78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052070 Jul 25 19:36:06.348859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 696/1414] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:07.128277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ce4ae5d-0a7c-47eb-a2ed-8f98561c6df2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:07.129439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ce4ae5d-0a7c-47eb-a2ed-8f98561c6df2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:07.141381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce4ae5d-0a7c-47eb-a2ed-8f98561c6df2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:07.142153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce4ae5d-0a7c-47eb-a2ed-8f98561c6df2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:07.144233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce4ae5d-0a7c-47eb-a2ed-8f98561c6df2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:07.145029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce4ae5d-0a7c-47eb-a2ed-8f98561c6df2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:07.314692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9ce4ae5d-0a7c-47eb-a2ed-8f98561c6df2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:07.323361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ce4ae5d-0a7c-47eb-a2ed-8f98561c6df2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.203206 Jul 25 19:36:07.323993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 719/1415] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:07 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:07.363425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-06ad9613-325c-4844-be47-603579f0ccb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:07.365790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-06ad9613-325c-4844-be47-603579f0ccb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:07.372937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06ad9613-325c-4844-be47-603579f0ccb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:07.373385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06ad9613-325c-4844-be47-603579f0ccb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:07.374213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06ad9613-325c-4844-be47-603579f0ccb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:07.374663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06ad9613-325c-4844-be47-603579f0ccb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:07.409784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-06ad9613-325c-4844-be47-603579f0ccb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050472 Jul 25 19:36:07.410316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 697/1416] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:07.739611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-69cb47c6-30d7-4ed9-a2e8-62ad79304c48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:07.740284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-69cb47c6-30d7-4ed9-a2e8-62ad79304c48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:07.747003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69cb47c6-30d7-4ed9-a2e8-62ad79304c48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:07.747450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69cb47c6-30d7-4ed9-a2e8-62ad79304c48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:07.748269 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69cb47c6-30d7-4ed9-a2e8-62ad79304c48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:07.748706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69cb47c6-30d7-4ed9-a2e8-62ad79304c48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:08.352014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-490cf86d-fa93-4417-a3b9-e5af6a930836 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:08.352767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-490cf86d-fa93-4417-a3b9-e5af6a930836 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:08.360120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-490cf86d-fa93-4417-a3b9-e5af6a930836 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:08.360615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-490cf86d-fa93-4417-a3b9-e5af6a930836 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:08.361648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-490cf86d-fa93-4417-a3b9-e5af6a930836 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:08.362834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-490cf86d-fa93-4417-a3b9-e5af6a930836 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:08.521702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-490cf86d-fa93-4417-a3b9-e5af6a930836 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:08.530925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-490cf86d-fa93-4417-a3b9-e5af6a930836 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.182879 Jul 25 19:36:08.531641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 698/1417] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:08 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:08.541582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3a6396cf-5210-4d2f-b5cd-ec73194ef1d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:08.545583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3a6396cf-5210-4d2f-b5cd-ec73194ef1d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:08.557571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a6396cf-5210-4d2f-b5cd-ec73194ef1d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:08.558077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a6396cf-5210-4d2f-b5cd-ec73194ef1d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:08.558985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a6396cf-5210-4d2f-b5cd-ec73194ef1d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:08.559595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a6396cf-5210-4d2f-b5cd-ec73194ef1d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:08.594545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3a6396cf-5210-4d2f-b5cd-ec73194ef1d0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061049 Jul 25 19:36:08.595314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 699/1418] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:09.566690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b59ae312-b6b3-4ec5-b7c4-56af6dc7a3b0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:09.567793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b59ae312-b6b3-4ec5-b7c4-56af6dc7a3b0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:09.575101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b59ae312-b6b3-4ec5-b7c4-56af6dc7a3b0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:09.575574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b59ae312-b6b3-4ec5-b7c4-56af6dc7a3b0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:09.576366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b59ae312-b6b3-4ec5-b7c4-56af6dc7a3b0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:09.576798 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b59ae312-b6b3-4ec5-b7c4-56af6dc7a3b0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:09.729766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b59ae312-b6b3-4ec5-b7c4-56af6dc7a3b0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:09.738668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b59ae312-b6b3-4ec5-b7c4-56af6dc7a3b0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.176658 Jul 25 19:36:09.739262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 700/1419] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:09 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:09.744545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4b864d06-086d-42e3-b04e-2bf8236e7b63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:09.746528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4b864d06-086d-42e3-b04e-2bf8236e7b63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:09.753613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b864d06-086d-42e3-b04e-2bf8236e7b63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:09.754193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b864d06-086d-42e3-b04e-2bf8236e7b63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:09.754982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b864d06-086d-42e3-b04e-2bf8236e7b63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:09.755416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b864d06-086d-42e3-b04e-2bf8236e7b63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:09.793671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4b864d06-086d-42e3-b04e-2bf8236e7b63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053262 Jul 25 19:36:09.794265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 701/1420] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:10.774222 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-90dce59a-4fb0-4386-bfb4-3f2d36116667 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:10.775088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-90dce59a-4fb0-4386-bfb4-3f2d36116667 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:10.781992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-90dce59a-4fb0-4386-bfb4-3f2d36116667 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:10.782438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-90dce59a-4fb0-4386-bfb4-3f2d36116667 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:10.783219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-90dce59a-4fb0-4386-bfb4-3f2d36116667 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:10.783694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-90dce59a-4fb0-4386-bfb4-3f2d36116667 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:10.948183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-90dce59a-4fb0-4386-bfb4-3f2d36116667 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:10.960572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-90dce59a-4fb0-4386-bfb4-3f2d36116667 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.189863 Jul 25 19:36:10.961796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 702/1421] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:10 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:10.970868 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0cfeb11b-a190-456f-a39a-8e2a35104574 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:10.975106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0cfeb11b-a190-456f-a39a-8e2a35104574 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:10.986065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cfeb11b-a190-456f-a39a-8e2a35104574 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:10.986834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cfeb11b-a190-456f-a39a-8e2a35104574 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:10.989043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cfeb11b-a190-456f-a39a-8e2a35104574 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:10.989682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cfeb11b-a190-456f-a39a-8e2a35104574 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:11.046564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0cfeb11b-a190-456f-a39a-8e2a35104574 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082467 Jul 25 19:36:11.047473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 703/1422] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:11.984809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ca6760c5-f642-426c-9428-05b8a1f35f09 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:11.985563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ca6760c5-f642-426c-9428-05b8a1f35f09 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:11.992471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca6760c5-f642-426c-9428-05b8a1f35f09 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:11.992917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca6760c5-f642-426c-9428-05b8a1f35f09 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:11.993705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca6760c5-f642-426c-9428-05b8a1f35f09 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:11.994148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca6760c5-f642-426c-9428-05b8a1f35f09 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:11.997349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:12.188700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ca6760c5-f642-426c-9428-05b8a1f35f09 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:12.198193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ca6760c5-f642-426c-9428-05b8a1f35f09 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.217398 Jul 25 19:36:12.198854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 704/1423] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:11 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:12.204358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8a93eed0-4426-4926-8e9e-ff01c494bcb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:12.207364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8a93eed0-4426-4926-8e9e-ff01c494bcb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:12.217512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a93eed0-4426-4926-8e9e-ff01c494bcb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:12.218320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a93eed0-4426-4926-8e9e-ff01c494bcb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:12.219465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a93eed0-4426-4926-8e9e-ff01c494bcb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:12.220099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a93eed0-4426-4926-8e9e-ff01c494bcb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:12.257420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8a93eed0-4426-4926-8e9e-ff01c494bcb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057338 Jul 25 19:36:12.258288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 705/1424] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:13.230123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8896046e-2117-4384-8d59-d0ec63e49a4b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:13.230843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8896046e-2117-4384-8d59-d0ec63e49a4b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:13.239827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8896046e-2117-4384-8d59-d0ec63e49a4b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:13.240408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8896046e-2117-4384-8d59-d0ec63e49a4b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:13.241287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8896046e-2117-4384-8d59-d0ec63e49a4b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:13.241823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8896046e-2117-4384-8d59-d0ec63e49a4b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:13.412524 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8896046e-2117-4384-8d59-d0ec63e49a4b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:13.424624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8896046e-2117-4384-8d59-d0ec63e49a4b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.200037 Jul 25 19:36:13.425643 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 706/1425] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:13 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:13.431773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7d462070-0b5a-46b2-86c7-5e50a26f151d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:13.434326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7d462070-0b5a-46b2-86c7-5e50a26f151d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:13.441815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d462070-0b5a-46b2-86c7-5e50a26f151d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:13.442753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d462070-0b5a-46b2-86c7-5e50a26f151d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:13.443671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d462070-0b5a-46b2-86c7-5e50a26f151d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:13.444112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d462070-0b5a-46b2-86c7-5e50a26f151d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:13.480348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7d462070-0b5a-46b2-86c7-5e50a26f151d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053545 Jul 25 19:36:13.480960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 707/1426] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:14.451222 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a6b46c71-2177-464a-91ac-6a7372079edd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:14.451983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a6b46c71-2177-464a-91ac-6a7372079edd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:14.460710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a6b46c71-2177-464a-91ac-6a7372079edd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:14.461115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a6b46c71-2177-464a-91ac-6a7372079edd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:14.462111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a6b46c71-2177-464a-91ac-6a7372079edd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:14.462552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a6b46c71-2177-464a-91ac-6a7372079edd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:14.637034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a6b46c71-2177-464a-91ac-6a7372079edd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:14.646969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a6b46c71-2177-464a-91ac-6a7372079edd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.199888 Jul 25 19:36:14.647806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 708/1427] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:14 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:14.653418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-91ffb309-957e-4248-86c1-0311c3b36142 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:14.655667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-91ffb309-957e-4248-86c1-0311c3b36142 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:14.665622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91ffb309-957e-4248-86c1-0311c3b36142 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:14.666073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91ffb309-957e-4248-86c1-0311c3b36142 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:14.666859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91ffb309-957e-4248-86c1-0311c3b36142 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:14.667297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91ffb309-957e-4248-86c1-0311c3b36142 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:14.701657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-91ffb309-957e-4248-86c1-0311c3b36142 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052480 Jul 25 19:36:14.702259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 709/1428] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:15.682319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5cc9c601-9fbe-40e0-bb51-350459338bb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:15.683034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5cc9c601-9fbe-40e0-bb51-350459338bb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:15.690730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5cc9c601-9fbe-40e0-bb51-350459338bb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:15.691460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5cc9c601-9fbe-40e0-bb51-350459338bb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:15.692253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5cc9c601-9fbe-40e0-bb51-350459338bb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:15.692689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5cc9c601-9fbe-40e0-bb51-350459338bb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:15.851760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5cc9c601-9fbe-40e0-bb51-350459338bb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:15.866533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5cc9c601-9fbe-40e0-bb51-350459338bb9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.187723 Jul 25 19:36:15.867695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 710/1429] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:15 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:15.877063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1f9d5efb-6692-41ae-a5fd-8fa4dd73406c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:15.881388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1f9d5efb-6692-41ae-a5fd-8fa4dd73406c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:15.891784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1f9d5efb-6692-41ae-a5fd-8fa4dd73406c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:15.892591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1f9d5efb-6692-41ae-a5fd-8fa4dd73406c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:15.894549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1f9d5efb-6692-41ae-a5fd-8fa4dd73406c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:15.895264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1f9d5efb-6692-41ae-a5fd-8fa4dd73406c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:15.952384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1f9d5efb-6692-41ae-a5fd-8fa4dd73406c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082752 Jul 25 19:36:15.953364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 711/1430] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:16.889844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fcc600e8-cd4e-456a-be99-730353732677 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:16.890686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fcc600e8-cd4e-456a-be99-730353732677 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:16.898905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fcc600e8-cd4e-456a-be99-730353732677 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:16.899401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fcc600e8-cd4e-456a-be99-730353732677 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:16.900294 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fcc600e8-cd4e-456a-be99-730353732677 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:16.900770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fcc600e8-cd4e-456a-be99-730353732677 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:17.075012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fcc600e8-cd4e-456a-be99-730353732677 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:17.084571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fcc600e8-cd4e-456a-be99-730353732677 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.198705 Jul 25 19:36:17.085564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 712/1431] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:16 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:17.091323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c3260637-38f4-4f82-8470-db76c134243c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:17.093846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c3260637-38f4-4f82-8470-db76c134243c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:17.101571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c3260637-38f4-4f82-8470-db76c134243c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:17.102015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c3260637-38f4-4f82-8470-db76c134243c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:17.102800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c3260637-38f4-4f82-8470-db76c134243c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:17.103559 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c3260637-38f4-4f82-8470-db76c134243c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:17.139063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c3260637-38f4-4f82-8470-db76c134243c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052070 Jul 25 19:36:17.139965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 713/1432] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:17.744882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=35 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:17.771648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=35 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:18.111439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-23560414-f4d6-4573-847e-ff5ba4ffce12 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:18.111439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-23560414-f4d6-4573-847e-ff5ba4ffce12 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:18.120012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23560414-f4d6-4573-847e-ff5ba4ffce12 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:18.120672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23560414-f4d6-4573-847e-ff5ba4ffce12 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:18.121556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23560414-f4d6-4573-847e-ff5ba4ffce12 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:18.122093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23560414-f4d6-4573-847e-ff5ba4ffce12 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:18.284562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-23560414-f4d6-4573-847e-ff5ba4ffce12 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:18.293373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-23560414-f4d6-4573-847e-ff5ba4ffce12 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.186761 Jul 25 19:36:18.293973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 714/1433] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:18 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:18.298934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-05519f42-6d4f-4a6f-8595-f615c479a4f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:18.301324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-05519f42-6d4f-4a6f-8595-f615c479a4f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:18.308088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05519f42-6d4f-4a6f-8595-f615c479a4f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:18.308591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05519f42-6d4f-4a6f-8595-f615c479a4f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:18.309326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05519f42-6d4f-4a6f-8595-f615c479a4f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:18.309752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05519f42-6d4f-4a6f-8595-f615c479a4f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:18.345202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-05519f42-6d4f-4a6f-8595-f615c479a4f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050109 Jul 25 19:36:18.345956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 715/1434] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:19.316547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-07b13586-7604-4add-87a2-49aefc502171 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:19.317640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-07b13586-7604-4add-87a2-49aefc502171 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:19.325194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07b13586-7604-4add-87a2-49aefc502171 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:19.325646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07b13586-7604-4add-87a2-49aefc502171 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:19.326425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07b13586-7604-4add-87a2-49aefc502171 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:19.326857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07b13586-7604-4add-87a2-49aefc502171 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:19.497730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-07b13586-7604-4add-87a2-49aefc502171 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:19.513581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-07b13586-7604-4add-87a2-49aefc502171 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.201021 Jul 25 19:36:19.514618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 716/1435] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:19 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:19.523974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-587ff914-881a-4972-aec0-c88bef3a3588 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:19.527643 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-587ff914-881a-4972-aec0-c88bef3a3588 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:19.538535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-587ff914-881a-4972-aec0-c88bef3a3588 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:19.539238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-587ff914-881a-4972-aec0-c88bef3a3588 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:19.540621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-587ff914-881a-4972-aec0-c88bef3a3588 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:19.541344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-587ff914-881a-4972-aec0-c88bef3a3588 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:19.581327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-587ff914-881a-4972-aec0-c88bef3a3588 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064456 Jul 25 19:36:19.582193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 717/1436] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:20.541737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f26e3778-875e-49b0-acca-39927de6641f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:20.542496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f26e3778-875e-49b0-acca-39927de6641f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:20.550613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f26e3778-875e-49b0-acca-39927de6641f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:20.551137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f26e3778-875e-49b0-acca-39927de6641f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:20.552289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f26e3778-875e-49b0-acca-39927de6641f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:20.552756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f26e3778-875e-49b0-acca-39927de6641f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:20.710309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f26e3778-875e-49b0-acca-39927de6641f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:20.718721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f26e3778-875e-49b0-acca-39927de6641f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.181006 Jul 25 19:36:20.719319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 718/1437] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:20 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:20.725181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-07d89a6f-c715-4851-ac64-4507c71068a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:20.727410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-07d89a6f-c715-4851-ac64-4507c71068a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:20.734439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07d89a6f-c715-4851-ac64-4507c71068a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:20.734893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07d89a6f-c715-4851-ac64-4507c71068a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:20.735751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07d89a6f-c715-4851-ac64-4507c71068a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:20.736190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-07d89a6f-c715-4851-ac64-4507c71068a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:20.770632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-07d89a6f-c715-4851-ac64-4507c71068a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050150 Jul 25 19:36:20.771222 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 719/1438] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:21.747082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-972c585e-18d6-4333-b068-e35f6ac09f22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:21.748134 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-972c585e-18d6-4333-b068-e35f6ac09f22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:21.756289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-972c585e-18d6-4333-b068-e35f6ac09f22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:21.756748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-972c585e-18d6-4333-b068-e35f6ac09f22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:21.757607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-972c585e-18d6-4333-b068-e35f6ac09f22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:21.758056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-972c585e-18d6-4333-b068-e35f6ac09f22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:22.078978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-972c585e-18d6-4333-b068-e35f6ac09f22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:22.081814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:22.091094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-972c585e-18d6-4333-b068-e35f6ac09f22 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.349697 Jul 25 19:36:22.092056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 720/1439] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:21 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:22.099206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9b2b38dc-abc3-49ba-be04-6a702697003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:22.102621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9b2b38dc-abc3-49ba-be04-6a702697003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:22.114290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9b2b38dc-abc3-49ba-be04-6a702697003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:22.115097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9b2b38dc-abc3-49ba-be04-6a702697003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:22.116553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9b2b38dc-abc3-49ba-be04-6a702697003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:22.117358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9b2b38dc-abc3-49ba-be04-6a702697003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:22.167151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9b2b38dc-abc3-49ba-be04-6a702697003c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073542 Jul 25 19:36:22.169266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 721/1440] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:23.114038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2abe3d4b-764b-4d16-b2ab-80c1baef55e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:23.115116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2abe3d4b-764b-4d16-b2ab-80c1baef55e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:23.121952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2abe3d4b-764b-4d16-b2ab-80c1baef55e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:23.122407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2abe3d4b-764b-4d16-b2ab-80c1baef55e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:23.123247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2abe3d4b-764b-4d16-b2ab-80c1baef55e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:23.123735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2abe3d4b-764b-4d16-b2ab-80c1baef55e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:23.296180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2abe3d4b-764b-4d16-b2ab-80c1baef55e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:23.305827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2abe3d4b-764b-4d16-b2ab-80c1baef55e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.196429 Jul 25 19:36:23.306430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 722/1441] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:23 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:23.311620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7d6725a1-cfa4-4435-99d7-113153b6be96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:23.313794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7d6725a1-cfa4-4435-99d7-113153b6be96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:23.322101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d6725a1-cfa4-4435-99d7-113153b6be96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:23.322674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d6725a1-cfa4-4435-99d7-113153b6be96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:23.323737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d6725a1-cfa4-4435-99d7-113153b6be96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:23.324278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7d6725a1-cfa4-4435-99d7-113153b6be96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:23.360972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7d6725a1-cfa4-4435-99d7-113153b6be96 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053353 Jul 25 19:36:23.361581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 723/1442] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:24.332810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-af44272a-5e1d-4141-91b6-9cd34898c89d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:24.333507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-af44272a-5e1d-4141-91b6-9cd34898c89d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:24.340446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af44272a-5e1d-4141-91b6-9cd34898c89d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:24.340891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af44272a-5e1d-4141-91b6-9cd34898c89d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:24.341786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af44272a-5e1d-4141-91b6-9cd34898c89d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:24.342239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af44272a-5e1d-4141-91b6-9cd34898c89d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:24.520573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-af44272a-5e1d-4141-91b6-9cd34898c89d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:24.529314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-af44272a-5e1d-4141-91b6-9cd34898c89d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.201746 Jul 25 19:36:24.529926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 724/1443] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:24 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:24.535476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-58ed11c8-6355-480d-9bed-4b1e7c964dff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:24.537843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-58ed11c8-6355-480d-9bed-4b1e7c964dff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:24.545363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58ed11c8-6355-480d-9bed-4b1e7c964dff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:24.545841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58ed11c8-6355-480d-9bed-4b1e7c964dff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:24.546667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58ed11c8-6355-480d-9bed-4b1e7c964dff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:24.547111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58ed11c8-6355-480d-9bed-4b1e7c964dff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:24.584778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-58ed11c8-6355-480d-9bed-4b1e7c964dff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053643 Jul 25 19:36:24.585295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 725/1444] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:25.553288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f0aeb01e-338a-4f88-9c3f-67b04775d506 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:25.553979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f0aeb01e-338a-4f88-9c3f-67b04775d506 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:25.560753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0aeb01e-338a-4f88-9c3f-67b04775d506 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:25.561231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0aeb01e-338a-4f88-9c3f-67b04775d506 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:25.562019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0aeb01e-338a-4f88-9c3f-67b04775d506 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:25.562469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0aeb01e-338a-4f88-9c3f-67b04775d506 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:25.574381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:36:25.580271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:36:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e (ip 10.222.0.18) !!! Jul 25 19:36:25.738577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f0aeb01e-338a-4f88-9c3f-67b04775d506 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:25.747114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f0aeb01e-338a-4f88-9c3f-67b04775d506 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.198562 Jul 25 19:36:25.751585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 726/1445] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:25 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:25.753216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f3eaa4ed-baa0-4c40-8c1a-0a3dc891a496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:25.755688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f3eaa4ed-baa0-4c40-8c1a-0a3dc891a496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:25.762499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3eaa4ed-baa0-4c40-8c1a-0a3dc891a496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:25.762993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3eaa4ed-baa0-4c40-8c1a-0a3dc891a496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:25.763813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3eaa4ed-baa0-4c40-8c1a-0a3dc891a496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:25.764269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3eaa4ed-baa0-4c40-8c1a-0a3dc891a496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:25.801563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f3eaa4ed-baa0-4c40-8c1a-0a3dc891a496 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052690 Jul 25 19:36:25.802266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 727/1446] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:26.773049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2443352c-15c6-4e0c-a112-4f0868035d84 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:26.774657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2443352c-15c6-4e0c-a112-4f0868035d84 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:26.781999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2443352c-15c6-4e0c-a112-4f0868035d84 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:26.782352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2443352c-15c6-4e0c-a112-4f0868035d84 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:26.783155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2443352c-15c6-4e0c-a112-4f0868035d84 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:26.783724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2443352c-15c6-4e0c-a112-4f0868035d84 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:26.946318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2443352c-15c6-4e0c-a112-4f0868035d84 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:26.957072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2443352c-15c6-4e0c-a112-4f0868035d84 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.187092 Jul 25 19:36:26.957704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 728/1447] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:26 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:26.962664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ce3561a2-bd70-4a78-8dcf-6b5f5bfed874 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:26.964944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ce3561a2-bd70-4a78-8dcf-6b5f5bfed874 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:26.972297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce3561a2-bd70-4a78-8dcf-6b5f5bfed874 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:26.972755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce3561a2-bd70-4a78-8dcf-6b5f5bfed874 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:26.973577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce3561a2-bd70-4a78-8dcf-6b5f5bfed874 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:26.974023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce3561a2-bd70-4a78-8dcf-6b5f5bfed874 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:27.008397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ce3561a2-bd70-4a78-8dcf-6b5f5bfed874 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049562 Jul 25 19:36:27.009083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 729/1448] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:27.980751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df948b18-164f-4fdd-a895-678b75fa0c80 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:27.981499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df948b18-164f-4fdd-a895-678b75fa0c80 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:27.989363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df948b18-164f-4fdd-a895-678b75fa0c80 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:27.989866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df948b18-164f-4fdd-a895-678b75fa0c80 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:27.990714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df948b18-164f-4fdd-a895-678b75fa0c80 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:27.991227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df948b18-164f-4fdd-a895-678b75fa0c80 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:28.151069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df948b18-164f-4fdd-a895-678b75fa0c80 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:28.160660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df948b18-164f-4fdd-a895-678b75fa0c80 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.184025 Jul 25 19:36:28.161345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 730/1449] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:27 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:28.170507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-14ed968e-b025-43b4-8741-773bd2f94f15 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:28.174556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-14ed968e-b025-43b4-8741-773bd2f94f15 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:28.186054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14ed968e-b025-43b4-8741-773bd2f94f15 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:28.186855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14ed968e-b025-43b4-8741-773bd2f94f15 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:28.188329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14ed968e-b025-43b4-8741-773bd2f94f15 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:28.189099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14ed968e-b025-43b4-8741-773bd2f94f15 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:28.226805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-14ed968e-b025-43b4-8741-773bd2f94f15 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064001 Jul 25 19:36:28.227400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 731/1450] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:29.197196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8fc8f66a-8ada-4b87-98cf-13318a72f36f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:29.198137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8fc8f66a-8ada-4b87-98cf-13318a72f36f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:29.204825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fc8f66a-8ada-4b87-98cf-13318a72f36f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:29.205305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fc8f66a-8ada-4b87-98cf-13318a72f36f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:29.206100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fc8f66a-8ada-4b87-98cf-13318a72f36f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:29.206535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fc8f66a-8ada-4b87-98cf-13318a72f36f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:29.371671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8fc8f66a-8ada-4b87-98cf-13318a72f36f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:29.380622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8fc8f66a-8ada-4b87-98cf-13318a72f36f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.187364 Jul 25 19:36:29.381218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 732/1451] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:29 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:29.386732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9acee9ca-1dae-45fa-8f3c-e9130a98439c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:29.389025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9acee9ca-1dae-45fa-8f3c-e9130a98439c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:29.396472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9acee9ca-1dae-45fa-8f3c-e9130a98439c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:29.396920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9acee9ca-1dae-45fa-8f3c-e9130a98439c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:29.397709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9acee9ca-1dae-45fa-8f3c-e9130a98439c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:29.398148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9acee9ca-1dae-45fa-8f3c-e9130a98439c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:29.456178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9acee9ca-1dae-45fa-8f3c-e9130a98439c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072638 Jul 25 19:36:29.457315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 733/1452] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:29 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:30.416996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-edcbf61b-840d-4b79-a09f-3453fd80accb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:30.418204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-edcbf61b-840d-4b79-a09f-3453fd80accb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:30.425962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-edcbf61b-840d-4b79-a09f-3453fd80accb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:30.426555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-edcbf61b-840d-4b79-a09f-3453fd80accb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:30.427383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-edcbf61b-840d-4b79-a09f-3453fd80accb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:30.428014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-edcbf61b-840d-4b79-a09f-3453fd80accb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:30.608525 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-edcbf61b-840d-4b79-a09f-3453fd80accb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:30.620814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-edcbf61b-840d-4b79-a09f-3453fd80accb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.207942 Jul 25 19:36:30.621436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 734/1453] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:30 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:30.626587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e8ea95c6-b01b-4bf3-8541-6f48f90231fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:30.629899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e8ea95c6-b01b-4bf3-8541-6f48f90231fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:30.636897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8ea95c6-b01b-4bf3-8541-6f48f90231fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:30.637262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8ea95c6-b01b-4bf3-8541-6f48f90231fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:30.638239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8ea95c6-b01b-4bf3-8541-6f48f90231fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:30.638650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8ea95c6-b01b-4bf3-8541-6f48f90231fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:30.674664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e8ea95c6-b01b-4bf3-8541-6f48f90231fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051750 Jul 25 19:36:30.675306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 735/1454] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:31.647546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9273d4b8-0a81-4626-8262-df453e886e1d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:31.648349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9273d4b8-0a81-4626-8262-df453e886e1d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:31.655925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9273d4b8-0a81-4626-8262-df453e886e1d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:31.656378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9273d4b8-0a81-4626-8262-df453e886e1d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:31.657321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9273d4b8-0a81-4626-8262-df453e886e1d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:31.657807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9273d4b8-0a81-4626-8262-df453e886e1d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:31.826040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9273d4b8-0a81-4626-8262-df453e886e1d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:31.842893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9273d4b8-0a81-4626-8262-df453e886e1d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.199816 Jul 25 19:36:31.844023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 736/1455] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:31 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:31.854025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c8f24d93-8713-4b57-a370-bc103b3399c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:31.858159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c8f24d93-8713-4b57-a370-bc103b3399c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:31.871159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8f24d93-8713-4b57-a370-bc103b3399c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:31.872039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8f24d93-8713-4b57-a370-bc103b3399c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:31.874137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8f24d93-8713-4b57-a370-bc103b3399c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:31.875123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8f24d93-8713-4b57-a370-bc103b3399c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:31.902882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:31.936088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c8f24d93-8713-4b57-a370-bc103b3399c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090134 Jul 25 19:36:31.937103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 737/1456] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:32.867103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cdc09071-020d-4acf-b10f-64b41ba9933d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:32.867898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cdc09071-020d-4acf-b10f-64b41ba9933d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:32.875076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdc09071-020d-4acf-b10f-64b41ba9933d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:32.875546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdc09071-020d-4acf-b10f-64b41ba9933d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:32.876462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdc09071-020d-4acf-b10f-64b41ba9933d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:32.876806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdc09071-020d-4acf-b10f-64b41ba9933d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:33.068898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cdc09071-020d-4acf-b10f-64b41ba9933d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:33.078814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cdc09071-020d-4acf-b10f-64b41ba9933d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.215851 Jul 25 19:36:33.079373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 738/1457] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:32 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:33.084953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4e8de0ac-8991-40e9-bc76-2499e37f5d08 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:33.087160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4e8de0ac-8991-40e9-bc76-2499e37f5d08 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:33.094238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e8de0ac-8991-40e9-bc76-2499e37f5d08 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:33.094818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e8de0ac-8991-40e9-bc76-2499e37f5d08 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:33.095710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e8de0ac-8991-40e9-bc76-2499e37f5d08 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:33.097056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e8de0ac-8991-40e9-bc76-2499e37f5d08 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:33.135457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4e8de0ac-8991-40e9-bc76-2499e37f5d08 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054797 Jul 25 19:36:33.136194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 739/1458] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:34.115976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3961476a-dce5-49e5-976c-5c815b2df8e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:34.116834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3961476a-dce5-49e5-976c-5c815b2df8e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:34.123743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3961476a-dce5-49e5-976c-5c815b2df8e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:34.124191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3961476a-dce5-49e5-976c-5c815b2df8e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:34.124969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3961476a-dce5-49e5-976c-5c815b2df8e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:34.125408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3961476a-dce5-49e5-976c-5c815b2df8e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:34.304477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3961476a-dce5-49e5-976c-5c815b2df8e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:34.313214 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3961476a-dce5-49e5-976c-5c815b2df8e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.202611 Jul 25 19:36:34.313806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 740/1459] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:34 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:34.318965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ea494fa8-4b28-4301-ae9a-e627ce1be660 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:34.321207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ea494fa8-4b28-4301-ae9a-e627ce1be660 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:34.328063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ea494fa8-4b28-4301-ae9a-e627ce1be660 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:34.328584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ea494fa8-4b28-4301-ae9a-e627ce1be660 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:34.329286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ea494fa8-4b28-4301-ae9a-e627ce1be660 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:34.329714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ea494fa8-4b28-4301-ae9a-e627ce1be660 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:34.366730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ea494fa8-4b28-4301-ae9a-e627ce1be660 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051825 Jul 25 19:36:34.367336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 741/1460] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:35.338064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ca792c3f-ea4a-4ca1-8c71-2cf8abd37c9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:35.338881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ca792c3f-ea4a-4ca1-8c71-2cf8abd37c9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:35.348133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca792c3f-ea4a-4ca1-8c71-2cf8abd37c9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:35.348589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca792c3f-ea4a-4ca1-8c71-2cf8abd37c9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:35.349458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca792c3f-ea4a-4ca1-8c71-2cf8abd37c9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:35.350049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca792c3f-ea4a-4ca1-8c71-2cf8abd37c9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:35.512599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ca792c3f-ea4a-4ca1-8c71-2cf8abd37c9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:35.521721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ca792c3f-ea4a-4ca1-8c71-2cf8abd37c9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.187670 Jul 25 19:36:35.522332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 742/1461] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:35 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:35.527533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c8fa299c-66fd-4c3e-a5a1-cc04c44c6d35 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:35.530101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c8fa299c-66fd-4c3e-a5a1-cc04c44c6d35 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:35.543971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8fa299c-66fd-4c3e-a5a1-cc04c44c6d35 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:35.544757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8fa299c-66fd-4c3e-a5a1-cc04c44c6d35 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:35.546237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8fa299c-66fd-4c3e-a5a1-cc04c44c6d35 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:35.547044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8fa299c-66fd-4c3e-a5a1-cc04c44c6d35 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:35.607709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c8fa299c-66fd-4c3e-a5a1-cc04c44c6d35 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083857 Jul 25 19:36:35.608757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 743/1462] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:36.545343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-10820ad7-b0e0-46cb-8194-6cf32a4665a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:36.546075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-10820ad7-b0e0-46cb-8194-6cf32a4665a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:36.548577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=96 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:36.556632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-10820ad7-b0e0-46cb-8194-6cf32a4665a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:36.557081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-10820ad7-b0e0-46cb-8194-6cf32a4665a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:36.557867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-10820ad7-b0e0-46cb-8194-6cf32a4665a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:36.558307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-10820ad7-b0e0-46cb-8194-6cf32a4665a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:36.720082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-10820ad7-b0e0-46cb-8194-6cf32a4665a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:36.730648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-10820ad7-b0e0-46cb-8194-6cf32a4665a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.189225 Jul 25 19:36:36.731320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 744/1463] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:36 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:36.741322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b252fdf2-129b-4e06-8705-d5ecffe5c9a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:36.745264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b252fdf2-129b-4e06-8705-d5ecffe5c9a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:36.757591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b252fdf2-129b-4e06-8705-d5ecffe5c9a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:36.758404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b252fdf2-129b-4e06-8705-d5ecffe5c9a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:36.759654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b252fdf2-129b-4e06-8705-d5ecffe5c9a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:36.760184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b252fdf2-129b-4e06-8705-d5ecffe5c9a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:36.797230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b252fdf2-129b-4e06-8705-d5ecffe5c9a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064333 Jul 25 19:36:36.797802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 745/1464] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:37.766740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8a0b9986-b221-404d-b26a-3bf85e59c0c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:37.767831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8a0b9986-b221-404d-b26a-3bf85e59c0c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:37.775828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a0b9986-b221-404d-b26a-3bf85e59c0c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:37.776276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a0b9986-b221-404d-b26a-3bf85e59c0c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:37.777064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a0b9986-b221-404d-b26a-3bf85e59c0c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:37.777553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8a0b9986-b221-404d-b26a-3bf85e59c0c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:37.935823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8a0b9986-b221-404d-b26a-3bf85e59c0c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:37.944994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8a0b9986-b221-404d-b26a-3bf85e59c0c8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.182169 Jul 25 19:36:37.945592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 746/1465] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:37 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:37.950769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9d6e1f0b-9c20-4a51-bb84-65efcf0543de tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:37.953038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9d6e1f0b-9c20-4a51-bb84-65efcf0543de tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:37.961536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d6e1f0b-9c20-4a51-bb84-65efcf0543de tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:37.962074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d6e1f0b-9c20-4a51-bb84-65efcf0543de tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:37.963148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d6e1f0b-9c20-4a51-bb84-65efcf0543de tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:37.963704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d6e1f0b-9c20-4a51-bb84-65efcf0543de tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:38.004143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9d6e1f0b-9c20-4a51-bb84-65efcf0543de tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056667 Jul 25 19:36:38.004797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 747/1466] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:38.969305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2b6d2cf8-fd5a-427c-9e33-f48de0296508 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:38.970520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2b6d2cf8-fd5a-427c-9e33-f48de0296508 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:38.977826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b6d2cf8-fd5a-427c-9e33-f48de0296508 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:38.978344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b6d2cf8-fd5a-427c-9e33-f48de0296508 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:38.979534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b6d2cf8-fd5a-427c-9e33-f48de0296508 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:38.980016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b6d2cf8-fd5a-427c-9e33-f48de0296508 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:39.149811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2b6d2cf8-fd5a-427c-9e33-f48de0296508 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:39.158882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2b6d2cf8-fd5a-427c-9e33-f48de0296508 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.193452 Jul 25 19:36:39.159896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 748/1467] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:38 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:39.165068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-02d00a23-386e-4dbe-914b-fd64da3f99ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:39.167774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-02d00a23-386e-4dbe-914b-fd64da3f99ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:39.178199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02d00a23-386e-4dbe-914b-fd64da3f99ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:39.178648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02d00a23-386e-4dbe-914b-fd64da3f99ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:39.179547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02d00a23-386e-4dbe-914b-fd64da3f99ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:39.180087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02d00a23-386e-4dbe-914b-fd64da3f99ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:39.216448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-02d00a23-386e-4dbe-914b-fd64da3f99ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055436 Jul 25 19:36:39.217067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 749/1468] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:40.188902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4efedc98-a1bc-4153-97ac-654cb9af4b5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:40.189746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4efedc98-a1bc-4153-97ac-654cb9af4b5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:40.198032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4efedc98-a1bc-4153-97ac-654cb9af4b5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:40.198504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4efedc98-a1bc-4153-97ac-654cb9af4b5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:40.199339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4efedc98-a1bc-4153-97ac-654cb9af4b5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:40.199820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4efedc98-a1bc-4153-97ac-654cb9af4b5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:40.363272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4efedc98-a1bc-4153-97ac-654cb9af4b5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:40.379087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4efedc98-a1bc-4153-97ac-654cb9af4b5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.193680 Jul 25 19:36:40.380177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 750/1469] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:40 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:40.389376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9cd534e1-a7dc-4100-a113-1c667def5845 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:40.394085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9cd534e1-a7dc-4100-a113-1c667def5845 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:40.406210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cd534e1-a7dc-4100-a113-1c667def5845 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:40.407032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cd534e1-a7dc-4100-a113-1c667def5845 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:40.408740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cd534e1-a7dc-4100-a113-1c667def5845 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:40.409736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cd534e1-a7dc-4100-a113-1c667def5845 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:40.477449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9cd534e1-a7dc-4100-a113-1c667def5845 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094697 Jul 25 19:36:40.478810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 751/1470] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:41.401848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-baaccb87-a059-4ea9-8351-f5c28a0f4f96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:41.402636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-baaccb87-a059-4ea9-8351-f5c28a0f4f96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:41.410019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-baaccb87-a059-4ea9-8351-f5c28a0f4f96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:41.410724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-baaccb87-a059-4ea9-8351-f5c28a0f4f96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:41.411567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-baaccb87-a059-4ea9-8351-f5c28a0f4f96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:41.412011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-baaccb87-a059-4ea9-8351-f5c28a0f4f96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:41.591367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-baaccb87-a059-4ea9-8351-f5c28a0f4f96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:41.606983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-baaccb87-a059-4ea9-8351-f5c28a0f4f96 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.208627 Jul 25 19:36:41.608073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 752/1471] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:41 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:41.617211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c1b3ec40-ffc6-459e-9469-b5c1d7d9e1b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:41.621112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c1b3ec40-ffc6-459e-9469-b5c1d7d9e1b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:41.632942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1b3ec40-ffc6-459e-9469-b5c1d7d9e1b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:41.633710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1b3ec40-ffc6-459e-9469-b5c1d7d9e1b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:41.635093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1b3ec40-ffc6-459e-9469-b5c1d7d9e1b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:41.635906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1b3ec40-ffc6-459e-9469-b5c1d7d9e1b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:41.675048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c1b3ec40-ffc6-459e-9469-b5c1d7d9e1b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064950 Jul 25 19:36:41.675684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 753/1472] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:42.630733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ab95ce4c-d4cf-41f9-bf24-4b6b80f6208c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:42.631619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ab95ce4c-d4cf-41f9-bf24-4b6b80f6208c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:42.638720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab95ce4c-d4cf-41f9-bf24-4b6b80f6208c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:42.639173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab95ce4c-d4cf-41f9-bf24-4b6b80f6208c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:42.640090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab95ce4c-d4cf-41f9-bf24-4b6b80f6208c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:42.640533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab95ce4c-d4cf-41f9-bf24-4b6b80f6208c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:42.645915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:42.797984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ab95ce4c-d4cf-41f9-bf24-4b6b80f6208c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:42.807677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ab95ce4c-d4cf-41f9-bf24-4b6b80f6208c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.181452 Jul 25 19:36:42.808368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 754/1473] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:42 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:42.813662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-922486e8-4bc2-42d4-9122-fd48ecfa475e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:42.817104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-922486e8-4bc2-42d4-9122-fd48ecfa475e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:42.824672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-922486e8-4bc2-42d4-9122-fd48ecfa475e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:42.825278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-922486e8-4bc2-42d4-9122-fd48ecfa475e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:42.826139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-922486e8-4bc2-42d4-9122-fd48ecfa475e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:42.826655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-922486e8-4bc2-42d4-9122-fd48ecfa475e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:42.861544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-922486e8-4bc2-42d4-9122-fd48ecfa475e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051968 Jul 25 19:36:42.863329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 755/1474] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:43.831189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0e5f2330-27e6-44f4-a411-f0f7f9b562c5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:43.832109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0e5f2330-27e6-44f4-a411-f0f7f9b562c5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:43.839752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e5f2330-27e6-44f4-a411-f0f7f9b562c5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:43.840202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e5f2330-27e6-44f4-a411-f0f7f9b562c5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:43.840994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e5f2330-27e6-44f4-a411-f0f7f9b562c5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:43.841428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e5f2330-27e6-44f4-a411-f0f7f9b562c5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:44.017024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0e5f2330-27e6-44f4-a411-f0f7f9b562c5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:44.027159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0e5f2330-27e6-44f4-a411-f0f7f9b562c5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.199879 Jul 25 19:36:44.027807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 756/1475] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:43 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:44.033064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-69de8084-7b76-4c36-86c9-d3947f1cf426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:44.035975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-69de8084-7b76-4c36-86c9-d3947f1cf426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:44.042711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69de8084-7b76-4c36-86c9-d3947f1cf426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:44.043162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69de8084-7b76-4c36-86c9-d3947f1cf426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:44.044045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69de8084-7b76-4c36-86c9-d3947f1cf426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:44.044476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69de8084-7b76-4c36-86c9-d3947f1cf426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:44.082654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-69de8084-7b76-4c36-86c9-d3947f1cf426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053362 Jul 25 19:36:44.084038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 757/1476] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:45.053069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-091b2ca2-f669-446c-b7c5-6369884d606c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:45.053839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-091b2ca2-f669-446c-b7c5-6369884d606c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:45.061197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-091b2ca2-f669-446c-b7c5-6369884d606c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:45.061648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-091b2ca2-f669-446c-b7c5-6369884d606c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:45.062449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-091b2ca2-f669-446c-b7c5-6369884d606c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:45.062892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-091b2ca2-f669-446c-b7c5-6369884d606c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:45.249202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-091b2ca2-f669-446c-b7c5-6369884d606c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:45.258258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-091b2ca2-f669-446c-b7c5-6369884d606c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.209962 Jul 25 19:36:45.259044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 758/1477] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:45 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:45.265341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e59d77b0-0da5-4592-96d0-be1ebd2f2a6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:45.268243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e59d77b0-0da5-4592-96d0-be1ebd2f2a6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:45.276477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e59d77b0-0da5-4592-96d0-be1ebd2f2a6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:45.277183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e59d77b0-0da5-4592-96d0-be1ebd2f2a6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:45.278514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e59d77b0-0da5-4592-96d0-be1ebd2f2a6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:45.279195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e59d77b0-0da5-4592-96d0-be1ebd2f2a6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:45.313312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e59d77b0-0da5-4592-96d0-be1ebd2f2a6a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053108 Jul 25 19:36:45.313968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 759/1478] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:46.296529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c22ca8de-b594-4526-8712-765d6041c2bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:46.297343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c22ca8de-b594-4526-8712-765d6041c2bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:46.305181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c22ca8de-b594-4526-8712-765d6041c2bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:46.305675 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c22ca8de-b594-4526-8712-765d6041c2bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:46.306481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c22ca8de-b594-4526-8712-765d6041c2bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:46.306917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c22ca8de-b594-4526-8712-765d6041c2bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:46.461457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c22ca8de-b594-4526-8712-765d6041c2bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:46.476031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c22ca8de-b594-4526-8712-765d6041c2bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.183176 Jul 25 19:36:46.495546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 760/1479] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:46 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:46.495546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-75644df8-b1a9-4c79-9642-ca98dc7115a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:46.495546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-75644df8-b1a9-4c79-9642-ca98dc7115a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:46.499001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75644df8-b1a9-4c79-9642-ca98dc7115a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:46.499445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75644df8-b1a9-4c79-9642-ca98dc7115a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:46.500305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75644df8-b1a9-4c79-9642-ca98dc7115a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:46.500754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75644df8-b1a9-4c79-9642-ca98dc7115a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:46.539234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-75644df8-b1a9-4c79-9642-ca98dc7115a7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054265 Jul 25 19:36:46.539861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 761/1480] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:47.509236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf09a4a7-674f-4eea-ad27-4094f6ffab6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:47.510383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cf09a4a7-674f-4eea-ad27-4094f6ffab6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:47.522057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf09a4a7-674f-4eea-ad27-4094f6ffab6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:47.522901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf09a4a7-674f-4eea-ad27-4094f6ffab6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:47.524343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf09a4a7-674f-4eea-ad27-4094f6ffab6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:47.525088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf09a4a7-674f-4eea-ad27-4094f6ffab6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:47.708012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf09a4a7-674f-4eea-ad27-4094f6ffab6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:47.716416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cf09a4a7-674f-4eea-ad27-4094f6ffab6a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.214782 Jul 25 19:36:47.716978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 762/1481] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:47 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:47.723173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a60d5860-6b96-448c-9545-72ab5b86f622 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:47.726081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a60d5860-6b96-448c-9545-72ab5b86f622 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:47.732876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a60d5860-6b96-448c-9545-72ab5b86f622 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:47.733332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a60d5860-6b96-448c-9545-72ab5b86f622 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:47.734123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a60d5860-6b96-448c-9545-72ab5b86f622 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:47.734563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a60d5860-6b96-448c-9545-72ab5b86f622 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:47.769395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a60d5860-6b96-448c-9545-72ab5b86f622 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051179 Jul 25 19:36:47.769866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 763/1482] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:48.754452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a87f0276-22f5-4efc-b175-e5a108ce5c92 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:48.755189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a87f0276-22f5-4efc-b175-e5a108ce5c92 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:48.763099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a87f0276-22f5-4efc-b175-e5a108ce5c92 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:48.763570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a87f0276-22f5-4efc-b175-e5a108ce5c92 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:48.764360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a87f0276-22f5-4efc-b175-e5a108ce5c92 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:48.764794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a87f0276-22f5-4efc-b175-e5a108ce5c92 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:48.925811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a87f0276-22f5-4efc-b175-e5a108ce5c92 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:48.934500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a87f0276-22f5-4efc-b175-e5a108ce5c92 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.184653 Jul 25 19:36:48.935090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 764/1483] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:48 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:48.941738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a9ce59f6-b4dc-4cb7-84c8-045b968235a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:48.945080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a9ce59f6-b4dc-4cb7-84c8-045b968235a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:48.952407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a9ce59f6-b4dc-4cb7-84c8-045b968235a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:48.952988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a9ce59f6-b4dc-4cb7-84c8-045b968235a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:48.953975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a9ce59f6-b4dc-4cb7-84c8-045b968235a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:48.954536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a9ce59f6-b4dc-4cb7-84c8-045b968235a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:48.990733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a9ce59f6-b4dc-4cb7-84c8-045b968235a9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054503 Jul 25 19:36:48.991347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 765/1484] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:48 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:49.700951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-69cb47c6-30d7-4ed9-a2e8-62ad79304c48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lazy-loading 'services' on Instance uuid d238c56a-d3fb-4eaa-abb6-4f9155523e90 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:36:49.970019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e7be8e73-3b97-4753-9d67-556bc2708a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:49.972055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e7be8e73-3b97-4753-9d67-556bc2708a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:49.979595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7be8e73-3b97-4753-9d67-556bc2708a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:49.980088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7be8e73-3b97-4753-9d67-556bc2708a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:49.981067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7be8e73-3b97-4753-9d67-556bc2708a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:49.981565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7be8e73-3b97-4753-9d67-556bc2708a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:50.149067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e7be8e73-3b97-4753-9d67-556bc2708a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:50.158144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e7be8e73-3b97-4753-9d67-556bc2708a6e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.191989 Jul 25 19:36:50.159187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 766/1485] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:49 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:50.164497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf02c316-46af-4baa-97a5-3f3f963cce36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:50.166834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cf02c316-46af-4baa-97a5-3f3f963cce36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:50.178528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf02c316-46af-4baa-97a5-3f3f963cce36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:50.179263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf02c316-46af-4baa-97a5-3f3f963cce36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:50.180670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf02c316-46af-4baa-97a5-3f3f963cce36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:50.181371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf02c316-46af-4baa-97a5-3f3f963cce36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:50.242958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cf02c316-46af-4baa-97a5-3f3f963cce36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082118 Jul 25 19:36:50.243875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 767/1486] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:50.806891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bf61de75-759b-421c-98cf-5e93685be6be tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:50.807395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bf61de75-759b-421c-98cf-5e93685be6be tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:50.814268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf61de75-759b-421c-98cf-5e93685be6be tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:50.814709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf61de75-759b-421c-98cf-5e93685be6be tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:50.815501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf61de75-759b-421c-98cf-5e93685be6be tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:50.816023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf61de75-759b-421c-98cf-5e93685be6be tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:50.845198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bf61de75-759b-421c-98cf-5e93685be6be tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Going to try to terminate instance {{(pid=117952) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:36:50.959752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bf61de75-759b-421c-98cf-5e93685be6be tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 204 len: 0 microversion: 2.1 time: 0.156232 Jul 25 19:36:50.960751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 768/1487] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:36:50 2022] DELETE /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:36:50.973307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6046e44e-0603-449d-8831-9319143dd483 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:50.974102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6046e44e-0603-449d-8831-9319143dd483 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:50.981685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6046e44e-0603-449d-8831-9319143dd483 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:50.982158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6046e44e-0603-449d-8831-9319143dd483 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:50.983062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6046e44e-0603-449d-8831-9319143dd483 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:50.983797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6046e44e-0603-449d-8831-9319143dd483 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:50.986769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:51.172438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6046e44e-0603-449d-8831-9319143dd483 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:51.182490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6046e44e-0603-449d-8831-9319143dd483 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.214607 Jul 25 19:36:51.183091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 769/1488] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:50 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:51.187938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e82ea320-c45b-4333-b4d4-e1dba94ae69d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:51.188554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e82ea320-c45b-4333-b4d4-e1dba94ae69d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:51.197189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e82ea320-c45b-4333-b4d4-e1dba94ae69d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:51.197664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e82ea320-c45b-4333-b4d4-e1dba94ae69d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:51.198455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e82ea320-c45b-4333-b4d4-e1dba94ae69d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:51.198893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e82ea320-c45b-4333-b4d4-e1dba94ae69d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:51.377854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e82ea320-c45b-4333-b4d4-e1dba94ae69d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:51.386312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e82ea320-c45b-4333-b4d4-e1dba94ae69d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.202146 Jul 25 19:36:51.387029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 770/1489] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:51 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:51.396455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0ecaa87c-9873-4e88-8b95-5d2b35f0f325 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:51.400707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0ecaa87c-9873-4e88-8b95-5d2b35f0f325 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:51.413408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ecaa87c-9873-4e88-8b95-5d2b35f0f325 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:51.413992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ecaa87c-9873-4e88-8b95-5d2b35f0f325 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:51.414859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ecaa87c-9873-4e88-8b95-5d2b35f0f325 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:51.415422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ecaa87c-9873-4e88-8b95-5d2b35f0f325 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:51.451198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0ecaa87c-9873-4e88-8b95-5d2b35f0f325 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062712 Jul 25 19:36:51.451837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 771/1490] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:52.216775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f6c931f6-c940-4a18-a039-c89ebc1b5065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:52.217578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f6c931f6-c940-4a18-a039-c89ebc1b5065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:52.227220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6c931f6-c940-4a18-a039-c89ebc1b5065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:52.228243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6c931f6-c940-4a18-a039-c89ebc1b5065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:52.229342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6c931f6-c940-4a18-a039-c89ebc1b5065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:52.229914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f6c931f6-c940-4a18-a039-c89ebc1b5065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:52.397890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f6c931f6-c940-4a18-a039-c89ebc1b5065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:52.407337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f6c931f6-c940-4a18-a039-c89ebc1b5065 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.194547 Jul 25 19:36:52.408181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 772/1491] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:52 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:52.422238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-59f2958e-8656-45af-9353-54c88a50244f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:52.423037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-59f2958e-8656-45af-9353-54c88a50244f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:52.431187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59f2958e-8656-45af-9353-54c88a50244f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:52.431747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59f2958e-8656-45af-9353-54c88a50244f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:52.432566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59f2958e-8656-45af-9353-54c88a50244f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:52.433058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59f2958e-8656-45af-9353-54c88a50244f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:52.595676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-59f2958e-8656-45af-9353-54c88a50244f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:52.604864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-59f2958e-8656-45af-9353-54c88a50244f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.187083 Jul 25 19:36:52.605464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 773/1492] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:52 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:52.610636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-46d2eb51-f739-46e7-ab4e-1c0f58b1d150 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:52.613675 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-46d2eb51-f739-46e7-ab4e-1c0f58b1d150 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:52.621484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46d2eb51-f739-46e7-ab4e-1c0f58b1d150 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:52.621976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46d2eb51-f739-46e7-ab4e-1c0f58b1d150 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:52.622832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46d2eb51-f739-46e7-ab4e-1c0f58b1d150 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:52.623271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46d2eb51-f739-46e7-ab4e-1c0f58b1d150 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:52.660830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-46d2eb51-f739-46e7-ab4e-1c0f58b1d150 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053962 Jul 25 19:36:52.662142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 774/1493] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:52 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:53.431199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8009d57d-cade-42c6-a5d4-accda1a63151 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:53.432040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8009d57d-cade-42c6-a5d4-accda1a63151 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:53.439052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8009d57d-cade-42c6-a5d4-accda1a63151 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:53.439686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8009d57d-cade-42c6-a5d4-accda1a63151 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:53.440786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8009d57d-cade-42c6-a5d4-accda1a63151 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:53.441267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8009d57d-cade-42c6-a5d4-accda1a63151 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:53.612678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8009d57d-cade-42c6-a5d4-accda1a63151 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:53.629037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8009d57d-cade-42c6-a5d4-accda1a63151 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.201156 Jul 25 19:36:53.630042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 775/1494] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:53 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:53.638923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7806e940-54b2-4fb5-bf0b-b1940f28afae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:53.640059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7806e940-54b2-4fb5-bf0b-b1940f28afae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:53.652018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7806e940-54b2-4fb5-bf0b-b1940f28afae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:53.653009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7806e940-54b2-4fb5-bf0b-b1940f28afae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:53.654943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7806e940-54b2-4fb5-bf0b-b1940f28afae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:53.655881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7806e940-54b2-4fb5-bf0b-b1940f28afae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:53.813004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7806e940-54b2-4fb5-bf0b-b1940f28afae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:53.821774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7806e940-54b2-4fb5-bf0b-b1940f28afae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.190116 Jul 25 19:36:53.822393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 776/1495] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:53 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:53.827272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9836fead-d8d3-4aa8-841f-36e7bb810a9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:53.829507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9836fead-d8d3-4aa8-841f-36e7bb810a9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:53.836802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9836fead-d8d3-4aa8-841f-36e7bb810a9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:53.837245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9836fead-d8d3-4aa8-841f-36e7bb810a9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:53.838037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9836fead-d8d3-4aa8-841f-36e7bb810a9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:53.838541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9836fead-d8d3-4aa8-841f-36e7bb810a9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:53.876131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9836fead-d8d3-4aa8-841f-36e7bb810a9f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052615 Jul 25 19:36:53.876880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 777/1496] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:54.653236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7eb19217-2d19-4dbf-82fa-724107e861da tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:54.654251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7eb19217-2d19-4dbf-82fa-724107e861da tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:54.665923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7eb19217-2d19-4dbf-82fa-724107e861da tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:54.666692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7eb19217-2d19-4dbf-82fa-724107e861da tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:54.668069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7eb19217-2d19-4dbf-82fa-724107e861da tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:54.668836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7eb19217-2d19-4dbf-82fa-724107e861da tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:54.827998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7eb19217-2d19-4dbf-82fa-724107e861da tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:54.838049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7eb19217-2d19-4dbf-82fa-724107e861da tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.189288 Jul 25 19:36:54.838637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 778/1497] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:54 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:54.851500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4a27a101-ecfd-4a8a-99a5-8fdf012e44d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:54.852769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4a27a101-ecfd-4a8a-99a5-8fdf012e44d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:54.865240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a27a101-ecfd-4a8a-99a5-8fdf012e44d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:54.866029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a27a101-ecfd-4a8a-99a5-8fdf012e44d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:54.866892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a27a101-ecfd-4a8a-99a5-8fdf012e44d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:54.867383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a27a101-ecfd-4a8a-99a5-8fdf012e44d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:55.027954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4a27a101-ecfd-4a8a-99a5-8fdf012e44d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:55.036361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4a27a101-ecfd-4a8a-99a5-8fdf012e44d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.193185 Jul 25 19:36:55.036976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 779/1498] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:54 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:55.041873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-525149db-aa97-4fa5-bcc0-135a9bd27ecc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:55.044115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-525149db-aa97-4fa5-bcc0-135a9bd27ecc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:55.052055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-525149db-aa97-4fa5-bcc0-135a9bd27ecc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:55.052503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-525149db-aa97-4fa5-bcc0-135a9bd27ecc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:55.053281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-525149db-aa97-4fa5-bcc0-135a9bd27ecc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:55.053721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-525149db-aa97-4fa5-bcc0-135a9bd27ecc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:55.087282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-525149db-aa97-4fa5-bcc0-135a9bd27ecc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049219 Jul 25 19:36:55.088190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 780/1499] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:55.874921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7bca855f-5d41-4333-b5df-6a7e1433eb2d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:55.875848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7bca855f-5d41-4333-b5df-6a7e1433eb2d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:55.883433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7bca855f-5d41-4333-b5df-6a7e1433eb2d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:55.883992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7bca855f-5d41-4333-b5df-6a7e1433eb2d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:55.884871 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7bca855f-5d41-4333-b5df-6a7e1433eb2d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:55.885483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7bca855f-5d41-4333-b5df-6a7e1433eb2d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:56.077186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7bca855f-5d41-4333-b5df-6a7e1433eb2d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:56.088115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7bca855f-5d41-4333-b5df-6a7e1433eb2d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.217448 Jul 25 19:36:56.103665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 781/1500] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:55 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:56.117707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8ccac5f5-c59b-4cba-874c-dec1633af832 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:56.118865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8ccac5f5-c59b-4cba-874c-dec1633af832 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:56.130471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ccac5f5-c59b-4cba-874c-dec1633af832 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:56.131182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ccac5f5-c59b-4cba-874c-dec1633af832 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:56.132593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ccac5f5-c59b-4cba-874c-dec1633af832 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:56.135372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ccac5f5-c59b-4cba-874c-dec1633af832 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:56.345245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8ccac5f5-c59b-4cba-874c-dec1633af832 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:56.354795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8ccac5f5-c59b-4cba-874c-dec1633af832 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.248744 Jul 25 19:36:56.355792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 782/1501] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:56 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:56.361181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7125fdb1-57f2-4c1e-90cd-af2a91fd410b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:56.364464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7125fdb1-57f2-4c1e-90cd-af2a91fd410b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:56.373326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7125fdb1-57f2-4c1e-90cd-af2a91fd410b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:56.373899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7125fdb1-57f2-4c1e-90cd-af2a91fd410b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:56.374937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7125fdb1-57f2-4c1e-90cd-af2a91fd410b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:56.375912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7125fdb1-57f2-4c1e-90cd-af2a91fd410b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:56.417941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7125fdb1-57f2-4c1e-90cd-af2a91fd410b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060560 Jul 25 19:36:56.418574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 783/1502] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:56 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:57.121663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c731804a-43e8-4205-acab-5fbcd8d0b54e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:57.122415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c731804a-43e8-4205-acab-5fbcd8d0b54e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:57.130236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c731804a-43e8-4205-acab-5fbcd8d0b54e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:57.130883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c731804a-43e8-4205-acab-5fbcd8d0b54e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:57.131857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c731804a-43e8-4205-acab-5fbcd8d0b54e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:57.132397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c731804a-43e8-4205-acab-5fbcd8d0b54e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:57.295528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c731804a-43e8-4205-acab-5fbcd8d0b54e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:57.310763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c731804a-43e8-4205-acab-5fbcd8d0b54e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.192526 Jul 25 19:36:57.311846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 784/1503] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:57 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:57.380492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c12e58a0-0cfa-409e-9713-544dd2b825b2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:57.381254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c12e58a0-0cfa-409e-9713-544dd2b825b2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:57.388003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c12e58a0-0cfa-409e-9713-544dd2b825b2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:57.388591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c12e58a0-0cfa-409e-9713-544dd2b825b2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:57.389467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c12e58a0-0cfa-409e-9713-544dd2b825b2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:57.390126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c12e58a0-0cfa-409e-9713-544dd2b825b2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:57.553562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c12e58a0-0cfa-409e-9713-544dd2b825b2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:57.555890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:57.562575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c12e58a0-0cfa-409e-9713-544dd2b825b2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.187779 Jul 25 19:36:57.563183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 785/1504] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:57 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:57.569129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a149263a-43f5-47cf-88c0-69c66ae085a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:57.571367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a149263a-43f5-47cf-88c0-69c66ae085a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:57.579328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a149263a-43f5-47cf-88c0-69c66ae085a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:57.579820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a149263a-43f5-47cf-88c0-69c66ae085a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:57.581606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a149263a-43f5-47cf-88c0-69c66ae085a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:57.582046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a149263a-43f5-47cf-88c0-69c66ae085a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:57.618434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a149263a-43f5-47cf-88c0-69c66ae085a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054077 Jul 25 19:36:57.619126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 786/1505] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Jul 25 19:36:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:36:58.348487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-515b3feb-f611-4a3a-a039-55e433a21f03 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:58.349236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-515b3feb-f611-4a3a-a039-55e433a21f03 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:58.356762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-515b3feb-f611-4a3a-a039-55e433a21f03 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:58.357125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-515b3feb-f611-4a3a-a039-55e433a21f03 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:58.357920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-515b3feb-f611-4a3a-a039-55e433a21f03 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:58.358365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-515b3feb-f611-4a3a-a039-55e433a21f03 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:58.545720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-515b3feb-f611-4a3a-a039-55e433a21f03 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:58.561249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-515b3feb-f611-4a3a-a039-55e433a21f03 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.216419 Jul 25 19:36:58.562306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 787/1506] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:58 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:58.588869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e1ff84e2-f14e-4319-8306-98e0d860babd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:58.589491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e1ff84e2-f14e-4319-8306-98e0d860babd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:58.596561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1ff84e2-f14e-4319-8306-98e0d860babd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:58.597061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1ff84e2-f14e-4319-8306-98e0d860babd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:58.597900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1ff84e2-f14e-4319-8306-98e0d860babd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:58.598342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1ff84e2-f14e-4319-8306-98e0d860babd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:58.757365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e1ff84e2-f14e-4319-8306-98e0d860babd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:58.766002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e1ff84e2-f14e-4319-8306-98e0d860babd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.181593 Jul 25 19:36:58.766603 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 788/1507] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:58 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:58.772267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5380ebdd-3a51-4dee-b552-cd2402c7456d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:36:58.774523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5380ebdd-3a51-4dee-b552-cd2402c7456d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:58.781152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5380ebdd-3a51-4dee-b552-cd2402c7456d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:58.781611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5380ebdd-3a51-4dee-b552-cd2402c7456d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:58.782427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5380ebdd-3a51-4dee-b552-cd2402c7456d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:58.782874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5380ebdd-3a51-4dee-b552-cd2402c7456d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:58.896451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5380ebdd-3a51-4dee-b552-cd2402c7456d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "POST /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/action" status: 200 len: 37483 microversion: 2.20 time: 0.128524 Jul 25 19:36:58.897137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 789/1508] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Jul 25 19:36:58 2022] POST /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031/action => generated 37483 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:36:59.587252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-367d5637-c69a-4c1b-a104-545a6cde2cff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:59.588268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-367d5637-c69a-4c1b-a104-545a6cde2cff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:59.598173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-367d5637-c69a-4c1b-a104-545a6cde2cff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:59.598682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-367d5637-c69a-4c1b-a104-545a6cde2cff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:59.599656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-367d5637-c69a-4c1b-a104-545a6cde2cff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:59.600216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-367d5637-c69a-4c1b-a104-545a6cde2cff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:59.708857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:59.764297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-367d5637-c69a-4c1b-a104-545a6cde2cff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:59.773998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-367d5637-c69a-4c1b-a104-545a6cde2cff tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.192003 Jul 25 19:36:59.774599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 790/1509] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:59 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:36:59.804364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2edcb015-d562-4f03-b0a6-7b2729edc035 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:59.805047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2edcb015-d562-4f03-b0a6-7b2729edc035 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:59.807320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:59.813765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2edcb015-d562-4f03-b0a6-7b2729edc035 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:59.814212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2edcb015-d562-4f03-b0a6-7b2729edc035 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:59.815577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2edcb015-d562-4f03-b0a6-7b2729edc035 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:59.816030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2edcb015-d562-4f03-b0a6-7b2729edc035 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:00.004245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2edcb015-d562-4f03-b0a6-7b2729edc035 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:00.012662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2edcb015-d562-4f03-b0a6-7b2729edc035 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.213723 Jul 25 19:37:00.013281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 791/1510] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:59 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:00.797410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-25da70dd-eb2c-4f23-b3dd-49ed7aa9a9a1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:00.798178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-25da70dd-eb2c-4f23-b3dd-49ed7aa9a9a1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:00.806057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-25da70dd-eb2c-4f23-b3dd-49ed7aa9a9a1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:00.806524 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-25da70dd-eb2c-4f23-b3dd-49ed7aa9a9a1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:00.807306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-25da70dd-eb2c-4f23-b3dd-49ed7aa9a9a1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:00.807784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-25da70dd-eb2c-4f23-b3dd-49ed7aa9a9a1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:00.973998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-25da70dd-eb2c-4f23-b3dd-49ed7aa9a9a1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:00.983358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-25da70dd-eb2c-4f23-b3dd-49ed7aa9a9a1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.189940 Jul 25 19:37:00.984059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 792/1511] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:00 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:01.035122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a034a7cf-190c-4879-b0f4-b0e814ed576f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:01.035955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a034a7cf-190c-4879-b0f4-b0e814ed576f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:01.043200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a034a7cf-190c-4879-b0f4-b0e814ed576f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:01.043861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a034a7cf-190c-4879-b0f4-b0e814ed576f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:01.044734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a034a7cf-190c-4879-b0f4-b0e814ed576f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:01.045214 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a034a7cf-190c-4879-b0f4-b0e814ed576f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:01.244466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a034a7cf-190c-4879-b0f4-b0e814ed576f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:01.254060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a034a7cf-190c-4879-b0f4-b0e814ed576f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.222475 Jul 25 19:37:01.254672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 793/1512] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:01 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:02.007148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f270ae10-d340-48bd-a306-446e2d20a5d7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:02.008122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f270ae10-d340-48bd-a306-446e2d20a5d7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:02.015227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f270ae10-d340-48bd-a306-446e2d20a5d7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:02.015784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f270ae10-d340-48bd-a306-446e2d20a5d7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:02.016624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f270ae10-d340-48bd-a306-446e2d20a5d7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:02.017106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f270ae10-d340-48bd-a306-446e2d20a5d7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:02.179346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f270ae10-d340-48bd-a306-446e2d20a5d7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:02.188104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f270ae10-d340-48bd-a306-446e2d20a5d7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.185411 Jul 25 19:37:02.188707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 794/1513] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:02 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:02.276192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-472a0078-6aab-4978-baec-7ad096eca852 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:02.276705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-472a0078-6aab-4978-baec-7ad096eca852 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:02.283086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-472a0078-6aab-4978-baec-7ad096eca852 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:02.283646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-472a0078-6aab-4978-baec-7ad096eca852 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:02.284647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-472a0078-6aab-4978-baec-7ad096eca852 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:02.285090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-472a0078-6aab-4978-baec-7ad096eca852 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:02.435246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-472a0078-6aab-4978-baec-7ad096eca852 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:02.444291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-472a0078-6aab-4978-baec-7ad096eca852 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.172062 Jul 25 19:37:02.444888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 795/1514] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:02 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:03.216896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-519cbe1c-03f0-4e23-8ffa-b31f35b9eaf6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:03.218057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-519cbe1c-03f0-4e23-8ffa-b31f35b9eaf6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:03.232354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-519cbe1c-03f0-4e23-8ffa-b31f35b9eaf6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:03.233125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-519cbe1c-03f0-4e23-8ffa-b31f35b9eaf6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:03.234509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-519cbe1c-03f0-4e23-8ffa-b31f35b9eaf6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:03.235282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-519cbe1c-03f0-4e23-8ffa-b31f35b9eaf6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:03.412591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-519cbe1c-03f0-4e23-8ffa-b31f35b9eaf6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:03.421487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-519cbe1c-03f0-4e23-8ffa-b31f35b9eaf6 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.212689 Jul 25 19:37:03.422267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 796/1515] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:03 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:03.468491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-31b83cfd-ecfe-4fc2-b6dd-10017d97a72d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:03.469109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-31b83cfd-ecfe-4fc2-b6dd-10017d97a72d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:03.476720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31b83cfd-ecfe-4fc2-b6dd-10017d97a72d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:03.477172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31b83cfd-ecfe-4fc2-b6dd-10017d97a72d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:03.477971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31b83cfd-ecfe-4fc2-b6dd-10017d97a72d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:03.478572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31b83cfd-ecfe-4fc2-b6dd-10017d97a72d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:03.667672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-31b83cfd-ecfe-4fc2-b6dd-10017d97a72d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:03.677090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-31b83cfd-ecfe-4fc2-b6dd-10017d97a72d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.212455 Jul 25 19:37:03.677721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 797/1516] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:03 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:04.446440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c47de366-e7d5-49cb-a2e6-cd7b8027a697 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:04.447166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c47de366-e7d5-49cb-a2e6-cd7b8027a697 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:04.456621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47de366-e7d5-49cb-a2e6-cd7b8027a697 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:04.457158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47de366-e7d5-49cb-a2e6-cd7b8027a697 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:04.458178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47de366-e7d5-49cb-a2e6-cd7b8027a697 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:04.459103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47de366-e7d5-49cb-a2e6-cd7b8027a697 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:04.618064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c47de366-e7d5-49cb-a2e6-cd7b8027a697 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:04.627404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c47de366-e7d5-49cb-a2e6-cd7b8027a697 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.185177 Jul 25 19:37:04.628169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 798/1517] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:04 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:04.700793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c85e85ae-5d70-4287-b5ba-6d267ba41493 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:04.701657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c85e85ae-5d70-4287-b5ba-6d267ba41493 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:04.709191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c85e85ae-5d70-4287-b5ba-6d267ba41493 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:04.709707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c85e85ae-5d70-4287-b5ba-6d267ba41493 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:04.710662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c85e85ae-5d70-4287-b5ba-6d267ba41493 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:04.711098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c85e85ae-5d70-4287-b5ba-6d267ba41493 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:04.870711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c85e85ae-5d70-4287-b5ba-6d267ba41493 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:04.880608 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c85e85ae-5d70-4287-b5ba-6d267ba41493 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.183997 Jul 25 19:37:04.881206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 799/1518] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:04 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:05.651470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e8731dcd-e73c-4ae7-ab65-9fd819da2bfb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:05.652221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e8731dcd-e73c-4ae7-ab65-9fd819da2bfb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:05.660114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8731dcd-e73c-4ae7-ab65-9fd819da2bfb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:05.660569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8731dcd-e73c-4ae7-ab65-9fd819da2bfb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:05.661365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8731dcd-e73c-4ae7-ab65-9fd819da2bfb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:05.661813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8731dcd-e73c-4ae7-ab65-9fd819da2bfb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:05.843464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e8731dcd-e73c-4ae7-ab65-9fd819da2bfb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:05.853419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e8731dcd-e73c-4ae7-ab65-9fd819da2bfb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.205943 Jul 25 19:37:05.854303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 800/1519] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:05 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:05.903525 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-77c85621-dc7f-4caa-b278-10a75615c52c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:05.904169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-77c85621-dc7f-4caa-b278-10a75615c52c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:05.911122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77c85621-dc7f-4caa-b278-10a75615c52c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:05.911599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77c85621-dc7f-4caa-b278-10a75615c52c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:05.912394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77c85621-dc7f-4caa-b278-10a75615c52c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:05.912836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77c85621-dc7f-4caa-b278-10a75615c52c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:06.068347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-77c85621-dc7f-4caa-b278-10a75615c52c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:06.076683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-77c85621-dc7f-4caa-b278-10a75615c52c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.177154 Jul 25 19:37:06.077283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 801/1520] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:05 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:06.878480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-213a730d-8ca4-4ce1-8598-ad3e2b4fd4bc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:06.879202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-213a730d-8ca4-4ce1-8598-ad3e2b4fd4bc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:06.887790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-213a730d-8ca4-4ce1-8598-ad3e2b4fd4bc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:06.888285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-213a730d-8ca4-4ce1-8598-ad3e2b4fd4bc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:06.889138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-213a730d-8ca4-4ce1-8598-ad3e2b4fd4bc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:06.889614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-213a730d-8ca4-4ce1-8598-ad3e2b4fd4bc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:07.059079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-213a730d-8ca4-4ce1-8598-ad3e2b4fd4bc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:07.061759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:37:07.069981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-213a730d-8ca4-4ce1-8598-ad3e2b4fd4bc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.196452 Jul 25 19:37:07.070592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 802/1521] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:06 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:07.113420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-62722162-3c16-4765-b502-5ebf94bce707 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:07.114034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-62722162-3c16-4765-b502-5ebf94bce707 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:07.120950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-62722162-3c16-4765-b502-5ebf94bce707 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:07.121406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-62722162-3c16-4765-b502-5ebf94bce707 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:07.122194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-62722162-3c16-4765-b502-5ebf94bce707 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:07.122633 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-62722162-3c16-4765-b502-5ebf94bce707 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:07.325747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-62722162-3c16-4765-b502-5ebf94bce707 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:07.335654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-62722162-3c16-4765-b502-5ebf94bce707 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.226929 Jul 25 19:37:07.336341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 803/1522] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:07 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:07.800989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:07.801677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:07.808573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:07.809022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:07.809874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:07.810379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:17.806185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=27 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:37:17.833120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=11 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:38:08.064201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-69cb47c6-30d7-4ed9-a2e8-62ad79304c48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16" status: 202 len: 0 microversion: 2.1 time: 120.328403 Jul 25 19:38:08.066432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 720/1523] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 19:36:07 2022] DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 => generated 0 bytes in 120333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:38:08.074219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8e6e970c-a0e8-4a3a-a70e-519f12470536 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:08.075224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8e6e970c-a0e8-4a3a-a70e-519f12470536 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:08.086202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e6e970c-a0e8-4a3a-a70e-519f12470536 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:08.087023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e6e970c-a0e8-4a3a-a70e-519f12470536 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:08.088267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e6e970c-a0e8-4a3a-a70e-519f12470536 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:08.089027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e6e970c-a0e8-4a3a-a70e-519f12470536 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:08.310162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8e6e970c-a0e8-4a3a-a70e-519f12470536 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:08.321033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8e6e970c-a0e8-4a3a-a70e-519f12470536 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.252978 Jul 25 19:38:08.321850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 721/1524] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:08 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:38:08.327924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-26a7ed49-8b2a-4fa0-902f-5e67722324b3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:08.328552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-26a7ed49-8b2a-4fa0-902f-5e67722324b3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:08.337806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26a7ed49-8b2a-4fa0-902f-5e67722324b3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:08.338418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26a7ed49-8b2a-4fa0-902f-5e67722324b3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:08.339447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26a7ed49-8b2a-4fa0-902f-5e67722324b3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:08.351542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lazy-loading 'services' on Instance uuid d238c56a-d3fb-4eaa-abb6-4f9155523e90 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:38:08.356873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26a7ed49-8b2a-4fa0-902f-5e67722324b3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:08.575022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26a7ed49-8b2a-4fa0-902f-5e67722324b3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:08.584879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-26a7ed49-8b2a-4fa0-902f-5e67722324b3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.261677 Jul 25 19:38:08.585466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 722/1525] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:08 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:38:08.590438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:08.590937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:08.598337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:08.598777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:08.599593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:08.600025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:18.357745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:38:18.594611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:38:18.622427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:38:18.891963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:38:18.892279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:38:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 (ip 10.222.0.18) !!! Jul 25 19:38:38.986201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:38:38.987116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:38:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 (ip 10.222.0.18) !!! Jul 25 19:38:49.921866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ebf47045-6e2d-488b-8c18-ab9fa447147a) Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Request method failure captured: Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 HTTP/1.1 Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u6T5C8He6CStrqmlyDl-YP4QcYi_cXPhJz0ErQMWUPS7hCSJSFY9Xp2dBtodhQd2YBTHGfKJxGlXeJS6IBLiM7lcKMx0z-ZlYjVJhQL6o6V0Y3ivXn35tPel-t7PaYn45tlD_1Z_FUt9RfSTUzPcCAAtuyfA_vbAGRgre8t11bdSyc Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 19:38:49.927188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 19:38:49.931142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_43cfdd0ba7de4e46a17d4c0d698159cf", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:38:49.931142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:38:49.931142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:38:49.931142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:38:49.931142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:38:49.931142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 19:38:49.931142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 19:38:49.931142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 324738dd872e445ba845a101f45fa595 Jul 25 19:38:49.931142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:38:49.931142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ebf47045-6e2d-488b-8c18-ab9fa447147a) Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'server_id': 'd238c56a-d3fb-4eaa-abb6-4f9155523e90', 'id': '0e1d33df-af4c-4066-b230-5e7f93c81a16'} Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:38:49.932391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ebf47045-6e2d-488b-8c18-ab9fa447147a) Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:38:49.935059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ebf47045-6e2d-488b-8c18-ab9fa447147a) Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:38:49.937683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ebf47045-6e2d-488b-8c18-ab9fa447147a) Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:38:49.940923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ebf47045-6e2d-488b-8c18-ab9fa447147a) Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ebf47045-6e2d-488b-8c18-ab9fa447147a) Jul 25 19:38:49.943581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:38:49.945832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ebf47045-6e2d-488b-8c18-ab9fa447147a) {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:38:49.945832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ed557f3f-9d18-4d3d-8745-4930e5c0a66e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16" status: 400 len: 269 microversion: 2.1 time: 102.133780 Jul 25 19:38:49.945832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 804/1526] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 19:37:07 2022] DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 => generated 269 bytes in 102136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 19:38:49.945832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-38a338b4-9182-458a-8185-7843d04e5bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:49.946821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-38a338b4-9182-458a-8185-7843d04e5bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:49.953740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38a338b4-9182-458a-8185-7843d04e5bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:49.954667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38a338b4-9182-458a-8185-7843d04e5bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:49.955980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38a338b4-9182-458a-8185-7843d04e5bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:49.956729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38a338b4-9182-458a-8185-7843d04e5bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:50.034745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lazy-loading 'services' on Instance uuid d238c56a-d3fb-4eaa-abb6-4f9155523e90 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:38:50.210672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-38a338b4-9182-458a-8185-7843d04e5bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:50.225535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-38a338b4-9182-458a-8185-7843d04e5bbc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.292946 Jul 25 19:38:50.226807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 805/1527] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:49 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:38:50.413444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3097311c-2b0a-4fa1-82c8-8e03beba0de7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:50.414632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3097311c-2b0a-4fa1-82c8-8e03beba0de7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:50.426472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3097311c-2b0a-4fa1-82c8-8e03beba0de7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:50.427251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3097311c-2b0a-4fa1-82c8-8e03beba0de7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:50.428551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3097311c-2b0a-4fa1-82c8-8e03beba0de7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:50.429225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3097311c-2b0a-4fa1-82c8-8e03beba0de7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:50.624968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3097311c-2b0a-4fa1-82c8-8e03beba0de7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:50.633738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3097311c-2b0a-4fa1-82c8-8e03beba0de7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.405200 Jul 25 19:38:50.634351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 806/1528] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:50 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:38:50.639347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b1a4ee2a-853d-483b-a474-a5aa1caf6b4a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:50.642742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b1a4ee2a-853d-483b-a474-a5aa1caf6b4a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:50.649640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1a4ee2a-853d-483b-a474-a5aa1caf6b4a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:50.650088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1a4ee2a-853d-483b-a474-a5aa1caf6b4a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:50.650893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1a4ee2a-853d-483b-a474-a5aa1caf6b4a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:50.651338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1a4ee2a-853d-483b-a474-a5aa1caf6b4a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:50.689025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b1a4ee2a-853d-483b-a474-a5aa1caf6b4a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052551 Jul 25 19:38:50.690301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 807/1529] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:38:50 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:38:51.248781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d5a39629-4eba-4228-a511-97ea78f77da8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:51.249851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d5a39629-4eba-4228-a511-97ea78f77da8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:51.258364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5a39629-4eba-4228-a511-97ea78f77da8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:51.259074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5a39629-4eba-4228-a511-97ea78f77da8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:51.260366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5a39629-4eba-4228-a511-97ea78f77da8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:51.262353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5a39629-4eba-4228-a511-97ea78f77da8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:51.441479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d5a39629-4eba-4228-a511-97ea78f77da8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:51.450274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d5a39629-4eba-4228-a511-97ea78f77da8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.205698 Jul 25 19:38:51.450981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 808/1530] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:51 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:51.707036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eb3c5acd-c941-4664-a9f2-161a9790362a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:51.710681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eb3c5acd-c941-4664-a9f2-161a9790362a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:51.725359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb3c5acd-c941-4664-a9f2-161a9790362a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:51.725735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb3c5acd-c941-4664-a9f2-161a9790362a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:51.727258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb3c5acd-c941-4664-a9f2-161a9790362a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:51.728119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb3c5acd-c941-4664-a9f2-161a9790362a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:51.792913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eb3c5acd-c941-4664-a9f2-161a9790362a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093304 Jul 25 19:38:51.794040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 809/1531] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:38:51 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:38:51.803491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4198e245-bb1d-4437-a892-b29c06abbf90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:51.804556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4198e245-bb1d-4437-a892-b29c06abbf90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:51.824256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4198e245-bb1d-4437-a892-b29c06abbf90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:51.825047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4198e245-bb1d-4437-a892-b29c06abbf90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:51.826673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4198e245-bb1d-4437-a892-b29c06abbf90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:51.827471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4198e245-bb1d-4437-a892-b29c06abbf90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:51.877816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4198e245-bb1d-4437-a892-b29c06abbf90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Going to try to terminate instance {{(pid=117952) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:38:52.003647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4198e245-bb1d-4437-a892-b29c06abbf90 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 204 len: 0 microversion: 2.1 time: 0.207573 Jul 25 19:38:52.004331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 810/1532] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:38:51 2022] DELETE /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:38:52.081519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-2027c325-dc18-43c0-99c4-f6dc1d6197ac req-9ac11319-d6cc-4d20-bf9f-12dc5d4dc3ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44f6c42-c9a6-4a85-8776-d2f694f0ac8e", "tag": "7198e141-c0f4-476e-81a3-f0ece4990c63"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:38:52.091906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-2027c325-dc18-43c0-99c4-f6dc1d6197ac req-9ac11319-d6cc-4d20-bf9f-12dc5d4dc3ad service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:52.092351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-2027c325-dc18-43c0-99c4-f6dc1d6197ac req-9ac11319-d6cc-4d20-bf9f-12dc5d4dc3ad service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:52.105654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-2027c325-dc18-43c0-99c4-f6dc1d6197ac req-9ac11319-d6cc-4d20-bf9f-12dc5d4dc3ad service nova] Creating event network-changed:7198e141-c0f4-476e-81a3-f0ece4990c63 for instance a44f6c42-c9a6-4a85-8776-d2f694f0ac8e on hv-cinder-85093 Jul 25 19:38:52.114218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-2027c325-dc18-43c0-99c4-f6dc1d6197ac req-9ac11319-d6cc-4d20-bf9f-12dc5d4dc3ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107156 Jul 25 19:38:52.115173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 811/1533] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:38:52.130060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-96312682-6549-493b-869b-13ceaa462f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:52.130883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-96312682-6549-493b-869b-13ceaa462f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:52.138128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96312682-6549-493b-869b-13ceaa462f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:52.138731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96312682-6549-493b-869b-13ceaa462f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:52.139652 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96312682-6549-493b-869b-13ceaa462f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:52.140225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96312682-6549-493b-869b-13ceaa462f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:52.396630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-96312682-6549-493b-869b-13ceaa462f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:52.409158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-96312682-6549-493b-869b-13ceaa462f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1569 microversion: 2.1 time: 0.292280 Jul 25 19:38:52.411028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 812/1534] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:52 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1569 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:38:52.478725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bc58c7e0-55d3-4ca3-b7b8-3c8d038ecd56 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:52.479972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bc58c7e0-55d3-4ca3-b7b8-3c8d038ecd56 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:52.492816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc58c7e0-55d3-4ca3-b7b8-3c8d038ecd56 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:52.493886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc58c7e0-55d3-4ca3-b7b8-3c8d038ecd56 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:52.495325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc58c7e0-55d3-4ca3-b7b8-3c8d038ecd56 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:52.496141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc58c7e0-55d3-4ca3-b7b8-3c8d038ecd56 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:52.810404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bc58c7e0-55d3-4ca3-b7b8-3c8d038ecd56 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:52.826461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bc58c7e0-55d3-4ca3-b7b8-3c8d038ecd56 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.354463 Jul 25 19:38:52.834948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 813/1535] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:52 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:52.836473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8ca3d582-d368-4aa0-85b5-4af00c48b5a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:52.841245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8ca3d582-d368-4aa0-85b5-4af00c48b5a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:52.849153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ca3d582-d368-4aa0-85b5-4af00c48b5a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:52.849615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ca3d582-d368-4aa0-85b5-4af00c48b5a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:52.850493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ca3d582-d368-4aa0-85b5-4af00c48b5a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:52.850933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ca3d582-d368-4aa0-85b5-4af00c48b5a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:52.896640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8ca3d582-d368-4aa0-85b5-4af00c48b5a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067646 Jul 25 19:38:52.897579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 814/1536] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:38:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:38:53.441935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-06655a38-c014-4947-8ce0-024f9c94e6fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:53.442618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-06655a38-c014-4947-8ce0-024f9c94e6fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:53.449181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06655a38-c014-4947-8ce0-024f9c94e6fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:53.449827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06655a38-c014-4947-8ce0-024f9c94e6fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:53.450733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06655a38-c014-4947-8ce0-024f9c94e6fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:53.451217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06655a38-c014-4947-8ce0-024f9c94e6fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:53.620029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-06655a38-c014-4947-8ce0-024f9c94e6fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:53.629263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-06655a38-c014-4947-8ce0-024f9c94e6fa tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.192197 Jul 25 19:38:53.629939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 815/1537] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:53 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:53.858366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-94fa6376-20f0-418b-9b24-f4f8735a4795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:53.859421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-94fa6376-20f0-418b-9b24-f4f8735a4795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:53.867879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94fa6376-20f0-418b-9b24-f4f8735a4795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:53.868329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94fa6376-20f0-418b-9b24-f4f8735a4795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:53.869136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94fa6376-20f0-418b-9b24-f4f8735a4795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:53.869573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-94fa6376-20f0-418b-9b24-f4f8735a4795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:54.024896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-94fa6376-20f0-418b-9b24-f4f8735a4795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:54.034716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-94fa6376-20f0-418b-9b24-f4f8735a4795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.180920 Jul 25 19:38:54.035401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 816/1538] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:53 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:54.041529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-912ebe4b-b8df-4368-849a-a99df9ada48d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:54.044003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-912ebe4b-b8df-4368-849a-a99df9ada48d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:54.052376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-912ebe4b-b8df-4368-849a-a99df9ada48d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:54.052830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-912ebe4b-b8df-4368-849a-a99df9ada48d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:54.053676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-912ebe4b-b8df-4368-849a-a99df9ada48d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:54.054114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-912ebe4b-b8df-4368-849a-a99df9ada48d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:54.090078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-912ebe4b-b8df-4368-849a-a99df9ada48d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053286 Jul 25 19:38:54.090688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 817/1539] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:38:54 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:38:54.653374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c8928c9a-fdfa-45f3-bdaf-408c212c5eea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:54.654204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c8928c9a-fdfa-45f3-bdaf-408c212c5eea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:54.661451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8928c9a-fdfa-45f3-bdaf-408c212c5eea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:54.661951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8928c9a-fdfa-45f3-bdaf-408c212c5eea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:54.662778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8928c9a-fdfa-45f3-bdaf-408c212c5eea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:54.663266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8928c9a-fdfa-45f3-bdaf-408c212c5eea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:54.824008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c8928c9a-fdfa-45f3-bdaf-408c212c5eea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:54.833053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c8928c9a-fdfa-45f3-bdaf-408c212c5eea tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.183753 Jul 25 19:38:54.833677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 818/1540] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:54 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:55.070369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bd1c8047-72e0-41ee-9305-a5d61eb18501 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:55.070995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bd1c8047-72e0-41ee-9305-a5d61eb18501 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:55.079262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bd1c8047-72e0-41ee-9305-a5d61eb18501 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:55.084028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bd1c8047-72e0-41ee-9305-a5d61eb18501 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:55.085074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bd1c8047-72e0-41ee-9305-a5d61eb18501 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:55.085571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bd1c8047-72e0-41ee-9305-a5d61eb18501 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:55.252357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bd1c8047-72e0-41ee-9305-a5d61eb18501 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:55.261745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bd1c8047-72e0-41ee-9305-a5d61eb18501 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.195153 Jul 25 19:38:55.267787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 819/1541] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:55 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:55.273818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7c0769cb-7842-41f7-b1d8-8fdaff1a5bd6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:55.276712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7c0769cb-7842-41f7-b1d8-8fdaff1a5bd6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:55.285023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c0769cb-7842-41f7-b1d8-8fdaff1a5bd6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:55.285480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c0769cb-7842-41f7-b1d8-8fdaff1a5bd6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:55.286328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c0769cb-7842-41f7-b1d8-8fdaff1a5bd6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:55.286734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c0769cb-7842-41f7-b1d8-8fdaff1a5bd6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:55.308057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:38:55.325217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7c0769cb-7842-41f7-b1d8-8fdaff1a5bd6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055801 Jul 25 19:38:55.325676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 820/1542] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:38:55 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:38:55.858092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1c1ba062-fa22-411a-b259-25bd89bd76e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:55.858907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1c1ba062-fa22-411a-b259-25bd89bd76e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:55.866030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c1ba062-fa22-411a-b259-25bd89bd76e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:55.866542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c1ba062-fa22-411a-b259-25bd89bd76e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:55.867383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c1ba062-fa22-411a-b259-25bd89bd76e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:55.867950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c1ba062-fa22-411a-b259-25bd89bd76e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:56.083642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1c1ba062-fa22-411a-b259-25bd89bd76e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:56.091836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1c1ba062-fa22-411a-b259-25bd89bd76e5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.238619 Jul 25 19:38:56.092581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 821/1543] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:55 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:56.284369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3caee0b8-9948-4445-bd3f-d77241b8de1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:56.285052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3caee0b8-9948-4445-bd3f-d77241b8de1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:56.292853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3caee0b8-9948-4445-bd3f-d77241b8de1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:56.293353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3caee0b8-9948-4445-bd3f-d77241b8de1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:56.294252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3caee0b8-9948-4445-bd3f-d77241b8de1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:56.294728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3caee0b8-9948-4445-bd3f-d77241b8de1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:56.479220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3caee0b8-9948-4445-bd3f-d77241b8de1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:56.489207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3caee0b8-9948-4445-bd3f-d77241b8de1e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.208875 Jul 25 19:38:56.490162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 822/1544] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:56 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:56.499060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-211b5b3b-0910-4c5d-a3cd-cdf6b8c05884 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:56.503777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-211b5b3b-0910-4c5d-a3cd-cdf6b8c05884 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:56.515754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-211b5b3b-0910-4c5d-a3cd-cdf6b8c05884 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:56.517064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-211b5b3b-0910-4c5d-a3cd-cdf6b8c05884 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:56.518243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-211b5b3b-0910-4c5d-a3cd-cdf6b8c05884 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:56.518771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-211b5b3b-0910-4c5d-a3cd-cdf6b8c05884 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:56.557658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-211b5b3b-0910-4c5d-a3cd-cdf6b8c05884 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066133 Jul 25 19:38:56.558849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 823/1545] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:38:56 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:38:57.116322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0ca5859a-ad37-4e31-8616-7ab344d9bb8b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:57.117551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0ca5859a-ad37-4e31-8616-7ab344d9bb8b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:57.124574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ca5859a-ad37-4e31-8616-7ab344d9bb8b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:57.126075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ca5859a-ad37-4e31-8616-7ab344d9bb8b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:57.127032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ca5859a-ad37-4e31-8616-7ab344d9bb8b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:57.127537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ca5859a-ad37-4e31-8616-7ab344d9bb8b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:57.284893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0ca5859a-ad37-4e31-8616-7ab344d9bb8b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:57.297400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0ca5859a-ad37-4e31-8616-7ab344d9bb8b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.185007 Jul 25 19:38:57.298233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 824/1546] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:57 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:57.527795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-acad5d6f-4ebb-4257-a802-c1bda3977ffe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:57.528479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-acad5d6f-4ebb-4257-a802-c1bda3977ffe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:57.535765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-acad5d6f-4ebb-4257-a802-c1bda3977ffe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:57.536238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-acad5d6f-4ebb-4257-a802-c1bda3977ffe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:57.537016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-acad5d6f-4ebb-4257-a802-c1bda3977ffe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:57.537447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-acad5d6f-4ebb-4257-a802-c1bda3977ffe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:57.697767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-acad5d6f-4ebb-4257-a802-c1bda3977ffe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:57.707666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-acad5d6f-4ebb-4257-a802-c1bda3977ffe tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.186968 Jul 25 19:38:57.708715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 825/1547] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:57 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:38:57.714813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-77b522a7-6391-4344-8369-9b2b1ed2d18f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:57.716841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-77b522a7-6391-4344-8369-9b2b1ed2d18f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:57.723980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77b522a7-6391-4344-8369-9b2b1ed2d18f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:57.724426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77b522a7-6391-4344-8369-9b2b1ed2d18f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:57.725374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77b522a7-6391-4344-8369-9b2b1ed2d18f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:57.725814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77b522a7-6391-4344-8369-9b2b1ed2d18f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:57.764606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-77b522a7-6391-4344-8369-9b2b1ed2d18f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054604 Jul 25 19:38:57.765217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 826/1548] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:38:57 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:38:58.333831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-99272e37-7aa8-4a82-a2e9-d8308fa8c2a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:58.334824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-99272e37-7aa8-4a82-a2e9-d8308fa8c2a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:58.343093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99272e37-7aa8-4a82-a2e9-d8308fa8c2a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:58.343763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99272e37-7aa8-4a82-a2e9-d8308fa8c2a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:58.346421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99272e37-7aa8-4a82-a2e9-d8308fa8c2a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:58.347091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99272e37-7aa8-4a82-a2e9-d8308fa8c2a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:58.533348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-99272e37-7aa8-4a82-a2e9-d8308fa8c2a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:58.542483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-99272e37-7aa8-4a82-a2e9-d8308fa8c2a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.213039 Jul 25 19:38:58.543247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 827/1549] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:58 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:38:58.733853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-022248e3-598f-4e89-9fd6-1ef833a4acba tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:58.734687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-022248e3-598f-4e89-9fd6-1ef833a4acba tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:58.741593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-022248e3-598f-4e89-9fd6-1ef833a4acba tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:58.742084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-022248e3-598f-4e89-9fd6-1ef833a4acba tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:58.742872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-022248e3-598f-4e89-9fd6-1ef833a4acba tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:58.743340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-022248e3-598f-4e89-9fd6-1ef833a4acba tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:58.897826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-022248e3-598f-4e89-9fd6-1ef833a4acba tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:58.907503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-022248e3-598f-4e89-9fd6-1ef833a4acba tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.177711 Jul 25 19:38:58.908359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 828/1550] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:58 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:58.913422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-56f9a571-8ebf-4297-b59c-2b30af6bf664 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:58.915713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-56f9a571-8ebf-4297-b59c-2b30af6bf664 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:58.924367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-56f9a571-8ebf-4297-b59c-2b30af6bf664 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:58.924932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-56f9a571-8ebf-4297-b59c-2b30af6bf664 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:58.925772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-56f9a571-8ebf-4297-b59c-2b30af6bf664 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:58.926218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-56f9a571-8ebf-4297-b59c-2b30af6bf664 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:58.962995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-56f9a571-8ebf-4297-b59c-2b30af6bf664 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053482 Jul 25 19:38:58.963775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 829/1551] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:38:58 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:38:59.572419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-71dc9665-ec85-431c-a097-80e1752c9f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:59.573238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-71dc9665-ec85-431c-a097-80e1752c9f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:59.580558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71dc9665-ec85-431c-a097-80e1752c9f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:59.581151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71dc9665-ec85-431c-a097-80e1752c9f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:59.582045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71dc9665-ec85-431c-a097-80e1752c9f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:59.582580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71dc9665-ec85-431c-a097-80e1752c9f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:59.779169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-71dc9665-ec85-431c-a097-80e1752c9f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:38:59.788503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-71dc9665-ec85-431c-a097-80e1752c9f50 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.219935 Jul 25 19:38:59.789123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 830/1552] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:59 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:38:59.933252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-71a6a587-4203-4def-9864-f6c0203b8311 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:38:59.933820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-71a6a587-4203-4def-9864-f6c0203b8311 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:38:59.941415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71a6a587-4203-4def-9864-f6c0203b8311 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:59.941881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71a6a587-4203-4def-9864-f6c0203b8311 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:38:59.942704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71a6a587-4203-4def-9864-f6c0203b8311 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:38:59.943233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-71a6a587-4203-4def-9864-f6c0203b8311 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:00.042196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:00.100516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-71a6a587-4203-4def-9864-f6c0203b8311 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:00.117811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-71a6a587-4203-4def-9864-f6c0203b8311 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.188529 Jul 25 19:39:00.131856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 831/1553] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:38:59 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:00.131856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-82943ceb-e27e-46a5-b8c3-464513801f17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:00.135159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-82943ceb-e27e-46a5-b8c3-464513801f17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:00.147270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82943ceb-e27e-46a5-b8c3-464513801f17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:00.148081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82943ceb-e27e-46a5-b8c3-464513801f17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:00.149480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82943ceb-e27e-46a5-b8c3-464513801f17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:00.150270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82943ceb-e27e-46a5-b8c3-464513801f17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:00.191828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-82943ceb-e27e-46a5-b8c3-464513801f17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071180 Jul 25 19:39:00.192398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 832/1554] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:39:00 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:39:00.810807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fa784abd-cec2-4443-9105-03d7f0cf71a6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:00.811601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fa784abd-cec2-4443-9105-03d7f0cf71a6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:00.821147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa784abd-cec2-4443-9105-03d7f0cf71a6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:00.821817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa784abd-cec2-4443-9105-03d7f0cf71a6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:00.822954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa784abd-cec2-4443-9105-03d7f0cf71a6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:00.823470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa784abd-cec2-4443-9105-03d7f0cf71a6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:00.978588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fa784abd-cec2-4443-9105-03d7f0cf71a6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:00.987888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fa784abd-cec2-4443-9105-03d7f0cf71a6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.180941 Jul 25 19:39:00.989338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 833/1555] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:00 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:01.153834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-70ecfe3a-c952-48ed-b8e8-43b654304da3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:01.154357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-70ecfe3a-c952-48ed-b8e8-43b654304da3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:01.160953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70ecfe3a-c952-48ed-b8e8-43b654304da3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:01.161554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70ecfe3a-c952-48ed-b8e8-43b654304da3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:01.162753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70ecfe3a-c952-48ed-b8e8-43b654304da3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:01.163034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70ecfe3a-c952-48ed-b8e8-43b654304da3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:01.330066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-70ecfe3a-c952-48ed-b8e8-43b654304da3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:01.339066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-70ecfe3a-c952-48ed-b8e8-43b654304da3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.189179 Jul 25 19:39:01.339720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 834/1556] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:01 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:01.345293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d9b92a9d-7dc6-4d75-9982-746f16eda194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:01.348112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d9b92a9d-7dc6-4d75-9982-746f16eda194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:01.354919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9b92a9d-7dc6-4d75-9982-746f16eda194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:01.355368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9b92a9d-7dc6-4d75-9982-746f16eda194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:01.356466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9b92a9d-7dc6-4d75-9982-746f16eda194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:01.356926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9b92a9d-7dc6-4d75-9982-746f16eda194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:01.393193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d9b92a9d-7dc6-4d75-9982-746f16eda194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052365 Jul 25 19:39:01.393794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 835/1557] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:39:01 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:39:02.011082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-77eda182-f4d3-42f6-a083-30d04c506dbb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:02.012194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-77eda182-f4d3-42f6-a083-30d04c506dbb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:02.022019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77eda182-f4d3-42f6-a083-30d04c506dbb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:02.022704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77eda182-f4d3-42f6-a083-30d04c506dbb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:02.023654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77eda182-f4d3-42f6-a083-30d04c506dbb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:02.024228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-77eda182-f4d3-42f6-a083-30d04c506dbb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:02.189443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-77eda182-f4d3-42f6-a083-30d04c506dbb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:02.198176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-77eda182-f4d3-42f6-a083-30d04c506dbb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.191128 Jul 25 19:39:02.198965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 836/1558] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:02 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:02.369163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6207ff26-8e26-416e-a57d-929a3dbc69bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:02.370171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6207ff26-8e26-416e-a57d-929a3dbc69bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:02.378747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6207ff26-8e26-416e-a57d-929a3dbc69bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:02.379384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6207ff26-8e26-416e-a57d-929a3dbc69bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:02.380412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6207ff26-8e26-416e-a57d-929a3dbc69bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:02.380952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6207ff26-8e26-416e-a57d-929a3dbc69bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:02.385858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:02.536319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6207ff26-8e26-416e-a57d-929a3dbc69bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:02.546267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6207ff26-8e26-416e-a57d-929a3dbc69bf tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.184289 Jul 25 19:39:02.559635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 837/1559] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:02 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:02.559635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b633957d-8a63-468c-913b-b7436e394ef8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:02.559635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b633957d-8a63-468c-913b-b7436e394ef8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:02.566180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b633957d-8a63-468c-913b-b7436e394ef8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:02.566692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b633957d-8a63-468c-913b-b7436e394ef8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:02.567582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b633957d-8a63-468c-913b-b7436e394ef8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:02.568128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b633957d-8a63-468c-913b-b7436e394ef8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:02.605163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b633957d-8a63-468c-913b-b7436e394ef8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055638 Jul 25 19:39:02.605822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 838/1560] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:39:02 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:39:03.227163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9fca47c8-a39a-426a-983e-268cb95e1228 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:03.228494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9fca47c8-a39a-426a-983e-268cb95e1228 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:03.238965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9fca47c8-a39a-426a-983e-268cb95e1228 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:03.239491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9fca47c8-a39a-426a-983e-268cb95e1228 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:03.240398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9fca47c8-a39a-426a-983e-268cb95e1228 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:03.240904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9fca47c8-a39a-426a-983e-268cb95e1228 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:03.397430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9fca47c8-a39a-426a-983e-268cb95e1228 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:03.406999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9fca47c8-a39a-426a-983e-268cb95e1228 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.187671 Jul 25 19:39:03.407708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 839/1561] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:03 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:03.571546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8ad7eddf-43c8-459a-adab-42db3f21f08d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:03.572372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8ad7eddf-43c8-459a-adab-42db3f21f08d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:03.579800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ad7eddf-43c8-459a-adab-42db3f21f08d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:03.580313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ad7eddf-43c8-459a-adab-42db3f21f08d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:03.581157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ad7eddf-43c8-459a-adab-42db3f21f08d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:03.581698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ad7eddf-43c8-459a-adab-42db3f21f08d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:03.736888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8ad7eddf-43c8-459a-adab-42db3f21f08d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:03.745920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8ad7eddf-43c8-459a-adab-42db3f21f08d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.178203 Jul 25 19:39:03.746669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 840/1562] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:03 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:03.752608 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ff63c226-0626-4621-bfa7-91a33571117d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:03.754943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ff63c226-0626-4621-bfa7-91a33571117d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:03.761454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff63c226-0626-4621-bfa7-91a33571117d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:03.761915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff63c226-0626-4621-bfa7-91a33571117d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:03.762706 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff63c226-0626-4621-bfa7-91a33571117d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:03.763146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff63c226-0626-4621-bfa7-91a33571117d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:03.797991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ff63c226-0626-4621-bfa7-91a33571117d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049528 Jul 25 19:39:03.798589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 841/1563] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:39:03 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:39:04.429095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8040fdd1-6ee1-45e5-8233-528185284e9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:04.430051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8040fdd1-6ee1-45e5-8233-528185284e9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:04.436469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8040fdd1-6ee1-45e5-8233-528185284e9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:04.436963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8040fdd1-6ee1-45e5-8233-528185284e9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:04.437857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8040fdd1-6ee1-45e5-8233-528185284e9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:04.438354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8040fdd1-6ee1-45e5-8233-528185284e9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:04.593604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8040fdd1-6ee1-45e5-8233-528185284e9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:04.603316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8040fdd1-6ee1-45e5-8233-528185284e9a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.178064 Jul 25 19:39:04.604186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 842/1564] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:04 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:04.782395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d3148289-cfaf-4967-82c7-a39bb0702ed5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:04.782744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d3148289-cfaf-4967-82c7-a39bb0702ed5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:04.790679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3148289-cfaf-4967-82c7-a39bb0702ed5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:04.791120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3148289-cfaf-4967-82c7-a39bb0702ed5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:04.792457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3148289-cfaf-4967-82c7-a39bb0702ed5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:04.793277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3148289-cfaf-4967-82c7-a39bb0702ed5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:04.945435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d3148289-cfaf-4967-82c7-a39bb0702ed5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:04.955420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d3148289-cfaf-4967-82c7-a39bb0702ed5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.178481 Jul 25 19:39:04.956062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 843/1565] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:04 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:04.960991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f538e08c-83c1-4cbf-b321-2a4352fb34d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:04.963243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f538e08c-83c1-4cbf-b321-2a4352fb34d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:04.969857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f538e08c-83c1-4cbf-b321-2a4352fb34d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:04.970464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f538e08c-83c1-4cbf-b321-2a4352fb34d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:04.971268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f538e08c-83c1-4cbf-b321-2a4352fb34d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:04.971740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f538e08c-83c1-4cbf-b321-2a4352fb34d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:05.005136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f538e08c-83c1-4cbf-b321-2a4352fb34d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047968 Jul 25 19:39:05.005724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 844/1566] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:39:04 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:39:05.627981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7c4f6198-f578-4837-9b4d-6c7d46974141 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:05.628837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7c4f6198-f578-4837-9b4d-6c7d46974141 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:05.635982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c4f6198-f578-4837-9b4d-6c7d46974141 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:05.636438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c4f6198-f578-4837-9b4d-6c7d46974141 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:05.637237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c4f6198-f578-4837-9b4d-6c7d46974141 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:05.637679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c4f6198-f578-4837-9b4d-6c7d46974141 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:05.799557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7c4f6198-f578-4837-9b4d-6c7d46974141 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:05.808254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7c4f6198-f578-4837-9b4d-6c7d46974141 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.184735 Jul 25 19:39:05.809389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 845/1567] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:05 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:05.985561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4bffae46-3d0d-45eb-8575-a92b37c2f457 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:05.986124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4bffae46-3d0d-45eb-8575-a92b37c2f457 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:05.992881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4bffae46-3d0d-45eb-8575-a92b37c2f457 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:05.993307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4bffae46-3d0d-45eb-8575-a92b37c2f457 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:05.994108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4bffae46-3d0d-45eb-8575-a92b37c2f457 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:05.994552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4bffae46-3d0d-45eb-8575-a92b37c2f457 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:06.149968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4bffae46-3d0d-45eb-8575-a92b37c2f457 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:06.159590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4bffae46-3d0d-45eb-8575-a92b37c2f457 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.179021 Jul 25 19:39:06.160333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 846/1568] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:05 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:06.167067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-248818c4-139f-4b2c-a613-afc669a795d2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:06.170466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-248818c4-139f-4b2c-a613-afc669a795d2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:06.179768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-248818c4-139f-4b2c-a613-afc669a795d2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:06.180412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-248818c4-139f-4b2c-a613-afc669a795d2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:06.181330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-248818c4-139f-4b2c-a613-afc669a795d2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:06.181872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-248818c4-139f-4b2c-a613-afc669a795d2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:06.218383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-248818c4-139f-4b2c-a613-afc669a795d2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056898 Jul 25 19:39:06.219201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 847/1569] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:39:06 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:39:06.834599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-50772bd3-b19e-45ec-b19d-b65dc201b1cb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:06.835353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-50772bd3-b19e-45ec-b19d-b65dc201b1cb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:06.842999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-50772bd3-b19e-45ec-b19d-b65dc201b1cb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:06.843555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-50772bd3-b19e-45ec-b19d-b65dc201b1cb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:06.844546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-50772bd3-b19e-45ec-b19d-b65dc201b1cb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:06.845362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-50772bd3-b19e-45ec-b19d-b65dc201b1cb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:07.005447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-50772bd3-b19e-45ec-b19d-b65dc201b1cb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:07.013543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-50772bd3-b19e-45ec-b19d-b65dc201b1cb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.183484 Jul 25 19:39:07.014146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 848/1570] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:06 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:07.185576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-72ed0466-3ab5-4efa-8269-3e2bc5b236cc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:07.186203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-72ed0466-3ab5-4efa-8269-3e2bc5b236cc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:07.193057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72ed0466-3ab5-4efa-8269-3e2bc5b236cc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:07.193509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72ed0466-3ab5-4efa-8269-3e2bc5b236cc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:07.194306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72ed0466-3ab5-4efa-8269-3e2bc5b236cc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:07.194745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72ed0466-3ab5-4efa-8269-3e2bc5b236cc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:07.350161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-72ed0466-3ab5-4efa-8269-3e2bc5b236cc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:07.360759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-72ed0466-3ab5-4efa-8269-3e2bc5b236cc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.178952 Jul 25 19:39:07.361442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 849/1571] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:07 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:07.367039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-99497e61-4307-47b2-9f19-1958241991dc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:07.369637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-99497e61-4307-47b2-9f19-1958241991dc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:07.377860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99497e61-4307-47b2-9f19-1958241991dc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:07.378358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99497e61-4307-47b2-9f19-1958241991dc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:07.379218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99497e61-4307-47b2-9f19-1958241991dc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:07.379693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99497e61-4307-47b2-9f19-1958241991dc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:07.420431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-99497e61-4307-47b2-9f19-1958241991dc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057786 Jul 25 19:39:07.421217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 850/1572] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:39:07 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:39:07.923063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:07.924149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:07.928000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:07.932740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:07.933174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:07.933959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:07.934397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:17.956431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=86 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:22.901040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:39:22.901694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 (ip 10.222.0.18) !!! Jul 25 19:39:45.613500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:39:45.614514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:39:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 (ip 10.222.0.18) !!! Jul 25 19:40:08.843495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a912fd9-2b53-4067-99a5-566ac2e1e0ad) Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Request method failure captured: Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 HTTP/1.1 Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u6T5C8He6CStrqmlyDl-YP4QcYi_cXPhJz0ErQMWUPS7hCSJSFY9Xp2dBtodhQd2YBTHGfKJxGlXeJS6IBLiM7lcKMx0z-ZlYjVJhQL6o6V0Y3ivXn35tPel-t7PaYn45tlD_1Z_FUt9RfSTUzPcCAAtuyfA_vbAGRgre8t11bdSyc Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:40:08.849000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:40:08.850810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_43cfdd0ba7de4e46a17d4c0d698159cf", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:40:08.850810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:40:08.850810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:40:08.850810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:40:08.850810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:40:08.850810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:40:08.850810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:40:08.850810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 324738dd872e445ba845a101f45fa595 Jul 25 19:40:08.850810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:40:08.850810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a912fd9-2b53-4067-99a5-566ac2e1e0ad) Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'server_id': 'd238c56a-d3fb-4eaa-abb6-4f9155523e90', 'id': '0e1d33df-af4c-4066-b230-5e7f93c81a16'} Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:40:08.851608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a912fd9-2b53-4067-99a5-566ac2e1e0ad) Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:40:08.853097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a912fd9-2b53-4067-99a5-566ac2e1e0ad) Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:40:08.854592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a912fd9-2b53-4067-99a5-566ac2e1e0ad) Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:40:08.855989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a912fd9-2b53-4067-99a5-566ac2e1e0ad) Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a912fd9-2b53-4067-99a5-566ac2e1e0ad) Jul 25 19:40:08.857596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:40:08.859655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a912fd9-2b53-4067-99a5-566ac2e1e0ad) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:40:08.859655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c1445632-da62-4837-a5ad-c54bb3112d27 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16" status: 400 len: 269 microversion: 2.1 time: 120.265034 Jul 25 19:40:08.859655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 723/1573] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 19:38:08 2022] DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 => generated 269 bytes in 120267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:40:08.861868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3ab81cb8-dff0-497e-855b-b6bc89ff0bcb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:08.862744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3ab81cb8-dff0-497e-855b-b6bc89ff0bcb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:08.870145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ab81cb8-dff0-497e-855b-b6bc89ff0bcb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:08.870587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ab81cb8-dff0-497e-855b-b6bc89ff0bcb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:08.871361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ab81cb8-dff0-497e-855b-b6bc89ff0bcb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:08.871822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ab81cb8-dff0-497e-855b-b6bc89ff0bcb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:09.035448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3ab81cb8-dff0-497e-855b-b6bc89ff0bcb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:09.044216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3ab81cb8-dff0-497e-855b-b6bc89ff0bcb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.189851 Jul 25 19:40:09.045336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 724/1574] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:08 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:40:09.050612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1bb93267-50c6-42f4-bbed-8fdec593ed08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:09.051222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1bb93267-50c6-42f4-bbed-8fdec593ed08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:09.057744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bb93267-50c6-42f4-bbed-8fdec593ed08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:09.058276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bb93267-50c6-42f4-bbed-8fdec593ed08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:09.059252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bb93267-50c6-42f4-bbed-8fdec593ed08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:09.059736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bb93267-50c6-42f4-bbed-8fdec593ed08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:09.215543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lazy-loading 'services' on Instance uuid d238c56a-d3fb-4eaa-abb6-4f9155523e90 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:40:09.231351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1bb93267-50c6-42f4-bbed-8fdec593ed08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:09.242378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1bb93267-50c6-42f4-bbed-8fdec593ed08 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.196503 Jul 25 19:40:09.243131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 725/1575] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:09 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:40:09.248016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1bbfde9b-5ae7-4942-8b65-e084b471d2f9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:09.251034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1bbfde9b-5ae7-4942-8b65-e084b471d2f9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:09.272685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bbfde9b-5ae7-4942-8b65-e084b471d2f9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:09.273423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bbfde9b-5ae7-4942-8b65-e084b471d2f9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:09.274787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bbfde9b-5ae7-4942-8b65-e084b471d2f9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:09.275590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bbfde9b-5ae7-4942-8b65-e084b471d2f9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:09.322509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1bbfde9b-5ae7-4942-8b65-e084b471d2f9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077799 Jul 25 19:40:09.323547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 726/1576] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:40:09 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:40:09.334771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:09.336171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:09.347665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:09.348395 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:09.349415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:09.349923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:19.223238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:40:19.342284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=8 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:40:19.372633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=22 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:40:34.566913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:40:34.567743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:40:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 (ip 10.222.0.18) !!! Jul 25 19:40:50.434730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ff5098-747a-4d5a-9380-7ee7dc333b3c) Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Request method failure captured: Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 HTTP/1.1 Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u6T5C8He6CStrqmlyDl-YP4QcYi_cXPhJz0ErQMWUPS7hCSJSFY9Xp2dBtodhQd2YBTHGfKJxGlXeJS6IBLiM7lcKMx0z-ZlYjVJhQL6o6V0Y3ivXn35tPel-t7PaYn45tlD_1Z_FUt9RfSTUzPcCAAtuyfA_vbAGRgre8t11bdSyc Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 19:40:50.438156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 19:40:50.441112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_43cfdd0ba7de4e46a17d4c0d698159cf", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:40:50.441112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:40:50.441112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:40:50.441112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:40:50.441112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:40:50.441112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 19:40:50.441112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 19:40:50.441112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 324738dd872e445ba845a101f45fa595 Jul 25 19:40:50.441112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:40:50.441112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ff5098-747a-4d5a-9380-7ee7dc333b3c) Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'server_id': 'd238c56a-d3fb-4eaa-abb6-4f9155523e90', 'id': '0e1d33df-af4c-4066-b230-5e7f93c81a16'} Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:40:50.443241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ff5098-747a-4d5a-9380-7ee7dc333b3c) Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:40:50.446342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ff5098-747a-4d5a-9380-7ee7dc333b3c) Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:40:50.452137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ff5098-747a-4d5a-9380-7ee7dc333b3c) Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:40:50.455501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ff5098-747a-4d5a-9380-7ee7dc333b3c) Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ff5098-747a-4d5a-9380-7ee7dc333b3c) Jul 25 19:40:50.457928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:40:50.460387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ff5098-747a-4d5a-9380-7ee7dc333b3c) {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:40:50.460387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e4bcdb09-6aca-49b8-80a2-3df5d7b2a916 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16" status: 400 len: 269 microversion: 2.1 time: 102.521740 Jul 25 19:40:50.460387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 851/1577] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 19:39:07 2022] DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 => generated 269 bytes in 102523 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 19:40:50.460387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9a260210-6ba5-4f90-a6de-5b5eb0a0a9f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:50.461054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9a260210-6ba5-4f90-a6de-5b5eb0a0a9f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:50.461054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a260210-6ba5-4f90-a6de-5b5eb0a0a9f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:50.461054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a260210-6ba5-4f90-a6de-5b5eb0a0a9f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:50.461054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a260210-6ba5-4f90-a6de-5b5eb0a0a9f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:50.461634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a260210-6ba5-4f90-a6de-5b5eb0a0a9f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:50.508050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lazy-loading 'services' on Instance uuid d238c56a-d3fb-4eaa-abb6-4f9155523e90 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:40:50.678972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9a260210-6ba5-4f90-a6de-5b5eb0a0a9f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:50.688060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9a260210-6ba5-4f90-a6de-5b5eb0a0a9f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.246032 Jul 25 19:40:50.688765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 852/1578] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:50 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:40:50.693607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fee809ba-3ad3-4272-b97e-45b5ca00ab35 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:50.694228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fee809ba-3ad3-4272-b97e-45b5ca00ab35 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:50.701182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fee809ba-3ad3-4272-b97e-45b5ca00ab35 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:50.701679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fee809ba-3ad3-4272-b97e-45b5ca00ab35 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:50.702728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fee809ba-3ad3-4272-b97e-45b5ca00ab35 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:50.703178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fee809ba-3ad3-4272-b97e-45b5ca00ab35 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:50.872662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fee809ba-3ad3-4272-b97e-45b5ca00ab35 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:50.882418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fee809ba-3ad3-4272-b97e-45b5ca00ab35 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.192558 Jul 25 19:40:50.883015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 853/1579] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:50 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:40:50.888419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-08502f6e-2c2b-4fbb-bff4-4d75954e5111 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:50.892044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-08502f6e-2c2b-4fbb-bff4-4d75954e5111 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:50.899088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08502f6e-2c2b-4fbb-bff4-4d75954e5111 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:50.899560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08502f6e-2c2b-4fbb-bff4-4d75954e5111 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:50.900387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08502f6e-2c2b-4fbb-bff4-4d75954e5111 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:50.900836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-08502f6e-2c2b-4fbb-bff4-4d75954e5111 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:50.937554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-08502f6e-2c2b-4fbb-bff4-4d75954e5111 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053088 Jul 25 19:40:50.938072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 854/1580] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:40:50 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:40:51.727660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e88b6087-997f-4aef-b158-bfea175a74e9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:51.728768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e88b6087-997f-4aef-b158-bfea175a74e9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:51.739670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e88b6087-997f-4aef-b158-bfea175a74e9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:51.740126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e88b6087-997f-4aef-b158-bfea175a74e9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:51.740964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e88b6087-997f-4aef-b158-bfea175a74e9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:51.741377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e88b6087-997f-4aef-b158-bfea175a74e9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:51.927202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e88b6087-997f-4aef-b158-bfea175a74e9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:51.934959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e88b6087-997f-4aef-b158-bfea175a74e9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.215621 Jul 25 19:40:51.935796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 855/1581] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:51 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:40:51.944786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-82e18a88-28a9-4fdd-a50a-d2709c11fc48 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:51.945971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-82e18a88-28a9-4fdd-a50a-d2709c11fc48 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:51.957317 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82e18a88-28a9-4fdd-a50a-d2709c11fc48 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:51.957974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82e18a88-28a9-4fdd-a50a-d2709c11fc48 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:51.959126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82e18a88-28a9-4fdd-a50a-d2709c11fc48 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:51.959801 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82e18a88-28a9-4fdd-a50a-d2709c11fc48 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:52.130145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-82e18a88-28a9-4fdd-a50a-d2709c11fc48 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:52.147262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-82e18a88-28a9-4fdd-a50a-d2709c11fc48 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.209561 Jul 25 19:40:52.148324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 856/1582] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:51 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:40:52.156754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d1c12b9a-3840-45b3-b88a-8cb1882dc87e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:52.160678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d1c12b9a-3840-45b3-b88a-8cb1882dc87e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:52.171392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d1c12b9a-3840-45b3-b88a-8cb1882dc87e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:52.171954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d1c12b9a-3840-45b3-b88a-8cb1882dc87e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:52.173428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d1c12b9a-3840-45b3-b88a-8cb1882dc87e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:52.174163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d1c12b9a-3840-45b3-b88a-8cb1882dc87e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:52.210820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d1c12b9a-3840-45b3-b88a-8cb1882dc87e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061124 Jul 25 19:40:52.211402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 857/1583] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:40:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:40:52.957751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f5c23b4d-29ee-4b46-82ea-201042631283 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:52.958562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f5c23b4d-29ee-4b46-82ea-201042631283 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:52.965314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5c23b4d-29ee-4b46-82ea-201042631283 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:52.965759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5c23b4d-29ee-4b46-82ea-201042631283 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:52.966538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5c23b4d-29ee-4b46-82ea-201042631283 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:52.967614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5c23b4d-29ee-4b46-82ea-201042631283 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:53.148999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f5c23b4d-29ee-4b46-82ea-201042631283 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:53.158130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f5c23b4d-29ee-4b46-82ea-201042631283 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.204249 Jul 25 19:40:53.158740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 858/1584] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:52 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:40:53.175830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5866fe84-025e-4afd-941f-ff771cdbc362 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:53.177021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5866fe84-025e-4afd-941f-ff771cdbc362 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:53.185208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5866fe84-025e-4afd-941f-ff771cdbc362 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:53.186149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5866fe84-025e-4afd-941f-ff771cdbc362 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:53.186969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5866fe84-025e-4afd-941f-ff771cdbc362 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:53.187411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5866fe84-025e-4afd-941f-ff771cdbc362 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:53.341574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5866fe84-025e-4afd-941f-ff771cdbc362 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:53.351787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5866fe84-025e-4afd-941f-ff771cdbc362 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.184653 Jul 25 19:40:53.352390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 859/1585] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:53 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:40:53.357373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cb70455b-3544-4bde-9318-c77647977975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:53.361230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cb70455b-3544-4bde-9318-c77647977975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:53.368718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb70455b-3544-4bde-9318-c77647977975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:53.369172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb70455b-3544-4bde-9318-c77647977975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:53.369965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb70455b-3544-4bde-9318-c77647977975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:53.370404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb70455b-3544-4bde-9318-c77647977975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:53.409122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cb70455b-3544-4bde-9318-c77647977975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055623 Jul 25 19:40:53.409714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 860/1586] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:40:53 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:40:54.188495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-27b23f21-5bf3-44f4-b01b-31715dcff8fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:54.189202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-27b23f21-5bf3-44f4-b01b-31715dcff8fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:54.196865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27b23f21-5bf3-44f4-b01b-31715dcff8fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:54.197439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27b23f21-5bf3-44f4-b01b-31715dcff8fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:54.198293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27b23f21-5bf3-44f4-b01b-31715dcff8fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:54.198722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27b23f21-5bf3-44f4-b01b-31715dcff8fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:54.356322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-27b23f21-5bf3-44f4-b01b-31715dcff8fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:54.367571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-27b23f21-5bf3-44f4-b01b-31715dcff8fd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.183486 Jul 25 19:40:54.368181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 861/1587] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:54 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:40:54.378454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-92335845-7903-49ac-8bdb-765ed2607a3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:54.379080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-92335845-7903-49ac-8bdb-765ed2607a3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:54.386389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92335845-7903-49ac-8bdb-765ed2607a3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:54.387031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92335845-7903-49ac-8bdb-765ed2607a3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:54.388201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92335845-7903-49ac-8bdb-765ed2607a3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:54.389403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92335845-7903-49ac-8bdb-765ed2607a3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:54.553509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-92335845-7903-49ac-8bdb-765ed2607a3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:54.563918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-92335845-7903-49ac-8bdb-765ed2607a3b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.190347 Jul 25 19:40:54.564523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 862/1588] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:54 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:40:54.569450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5edbaea1-1a84-4236-a0b2-ae134c3b03f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:54.571671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5edbaea1-1a84-4236-a0b2-ae134c3b03f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:54.579234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5edbaea1-1a84-4236-a0b2-ae134c3b03f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:54.579715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5edbaea1-1a84-4236-a0b2-ae134c3b03f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:54.580503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5edbaea1-1a84-4236-a0b2-ae134c3b03f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:54.580949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5edbaea1-1a84-4236-a0b2-ae134c3b03f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:54.615706 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5edbaea1-1a84-4236-a0b2-ae134c3b03f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050080 Jul 25 19:40:54.616596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 863/1589] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:40:54 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:40:55.391460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b634edcf-86a3-4c98-934f-957bb7be47a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:55.392209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b634edcf-86a3-4c98-934f-957bb7be47a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:55.398960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b634edcf-86a3-4c98-934f-957bb7be47a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:55.399399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b634edcf-86a3-4c98-934f-957bb7be47a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:55.400323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b634edcf-86a3-4c98-934f-957bb7be47a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:55.400775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b634edcf-86a3-4c98-934f-957bb7be47a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:55.568194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b634edcf-86a3-4c98-934f-957bb7be47a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:55.582042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b634edcf-86a3-4c98-934f-957bb7be47a5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.195472 Jul 25 19:40:55.583035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 864/1590] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:55 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:40:55.598849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-882c680e-da04-4c3a-8d83-0a75b7178f57 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:55.599505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-882c680e-da04-4c3a-8d83-0a75b7178f57 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:55.606730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-882c680e-da04-4c3a-8d83-0a75b7178f57 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:55.607172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-882c680e-da04-4c3a-8d83-0a75b7178f57 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:55.608327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-882c680e-da04-4c3a-8d83-0a75b7178f57 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:55.608780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-882c680e-da04-4c3a-8d83-0a75b7178f57 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:55.772136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-882c680e-da04-4c3a-8d83-0a75b7178f57 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:55.782451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-882c680e-da04-4c3a-8d83-0a75b7178f57 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.188442 Jul 25 19:40:55.783051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 865/1591] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:55 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:40:55.787805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ffe44ecd-2a77-47c0-ab9e-d9af39a80b7a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:55.790047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ffe44ecd-2a77-47c0-ab9e-d9af39a80b7a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:55.798069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffe44ecd-2a77-47c0-ab9e-d9af39a80b7a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:55.798567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffe44ecd-2a77-47c0-ab9e-d9af39a80b7a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:55.799279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffe44ecd-2a77-47c0-ab9e-d9af39a80b7a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:55.799815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffe44ecd-2a77-47c0-ab9e-d9af39a80b7a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:55.834872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ffe44ecd-2a77-47c0-ab9e-d9af39a80b7a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050312 Jul 25 19:40:55.836010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 866/1592] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:40:55 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:40:56.606212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-409c7a40-5624-475a-a218-61056e69e71a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:56.606943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-409c7a40-5624-475a-a218-61056e69e71a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:56.614090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-409c7a40-5624-475a-a218-61056e69e71a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:56.614544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-409c7a40-5624-475a-a218-61056e69e71a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:56.615570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-409c7a40-5624-475a-a218-61056e69e71a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:56.616019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-409c7a40-5624-475a-a218-61056e69e71a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:56.779083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-409c7a40-5624-475a-a218-61056e69e71a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:56.788480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-409c7a40-5624-475a-a218-61056e69e71a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.186104 Jul 25 19:40:56.789096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 867/1593] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:56 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:40:56.812957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-98a75b14-e4ba-4e0f-a2d0-f7328994b41d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:56.813566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-98a75b14-e4ba-4e0f-a2d0-f7328994b41d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:56.820721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98a75b14-e4ba-4e0f-a2d0-f7328994b41d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:56.821173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98a75b14-e4ba-4e0f-a2d0-f7328994b41d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:56.822008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98a75b14-e4ba-4e0f-a2d0-f7328994b41d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:56.822484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-98a75b14-e4ba-4e0f-a2d0-f7328994b41d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:56.844849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:40:56.973816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-98a75b14-e4ba-4e0f-a2d0-f7328994b41d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:56.988591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-98a75b14-e4ba-4e0f-a2d0-f7328994b41d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.179201 Jul 25 19:40:56.989632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 868/1594] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:56 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:40:56.998749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-05a272d5-1e97-433c-8026-b8d307cea47e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:57.002494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-05a272d5-1e97-433c-8026-b8d307cea47e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:57.013133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05a272d5-1e97-433c-8026-b8d307cea47e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:57.014553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05a272d5-1e97-433c-8026-b8d307cea47e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:57.015948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05a272d5-1e97-433c-8026-b8d307cea47e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:57.016725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05a272d5-1e97-433c-8026-b8d307cea47e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:57.054624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-05a272d5-1e97-433c-8026-b8d307cea47e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063497 Jul 25 19:40:57.055225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 869/1595] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:40:56 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:40:57.810967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-66fabad9-e0dd-4421-a3b7-618ae81320c2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:57.812013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-66fabad9-e0dd-4421-a3b7-618ae81320c2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:57.819184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66fabad9-e0dd-4421-a3b7-618ae81320c2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:57.819726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66fabad9-e0dd-4421-a3b7-618ae81320c2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:57.820521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66fabad9-e0dd-4421-a3b7-618ae81320c2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:57.820995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66fabad9-e0dd-4421-a3b7-618ae81320c2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:58.017196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-66fabad9-e0dd-4421-a3b7-618ae81320c2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:58.025248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-66fabad9-e0dd-4421-a3b7-618ae81320c2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.218506 Jul 25 19:40:58.025836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 870/1596] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:57 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:40:58.031262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-81dc1fed-5404-49ca-9947-597ea95e0cab tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:58.031990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-81dc1fed-5404-49ca-9947-597ea95e0cab tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:58.038486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-81dc1fed-5404-49ca-9947-597ea95e0cab tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:58.038947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-81dc1fed-5404-49ca-9947-597ea95e0cab tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:58.039773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-81dc1fed-5404-49ca-9947-597ea95e0cab tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:58.040221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-81dc1fed-5404-49ca-9947-597ea95e0cab tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:58.193747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-81dc1fed-5404-49ca-9947-597ea95e0cab tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:58.203365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-81dc1fed-5404-49ca-9947-597ea95e0cab tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.176445 Jul 25 19:40:58.204087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 871/1597] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:58 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:40:58.209652 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fca4be0c-e54b-4ff3-90e0-e0c726c2d5a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:58.212168 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fca4be0c-e54b-4ff3-90e0-e0c726c2d5a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:58.220420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fca4be0c-e54b-4ff3-90e0-e0c726c2d5a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:58.220867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fca4be0c-e54b-4ff3-90e0-e0c726c2d5a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:58.221661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fca4be0c-e54b-4ff3-90e0-e0c726c2d5a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:58.222104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fca4be0c-e54b-4ff3-90e0-e0c726c2d5a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:58.260529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fca4be0c-e54b-4ff3-90e0-e0c726c2d5a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054991 Jul 25 19:40:58.261131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 872/1598] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:40:58 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:40:59.051076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9fea1c90-d5d9-4ca4-854c-392cf925af76 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:59.051920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9fea1c90-d5d9-4ca4-854c-392cf925af76 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:59.058771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9fea1c90-d5d9-4ca4-854c-392cf925af76 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:59.059279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9fea1c90-d5d9-4ca4-854c-392cf925af76 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:59.060178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9fea1c90-d5d9-4ca4-854c-392cf925af76 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:59.060901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9fea1c90-d5d9-4ca4-854c-392cf925af76 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:59.244082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9fea1c90-d5d9-4ca4-854c-392cf925af76 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:59.254506 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9fea1c90-d5d9-4ca4-854c-392cf925af76 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.207559 Jul 25 19:40:59.255284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 873/1599] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:59 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:40:59.260808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-29f8eb07-b5a9-413f-82cd-c7173cb0300d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:59.261967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-29f8eb07-b5a9-413f-82cd-c7173cb0300d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:59.272352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29f8eb07-b5a9-413f-82cd-c7173cb0300d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:59.272983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29f8eb07-b5a9-413f-82cd-c7173cb0300d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:59.274000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29f8eb07-b5a9-413f-82cd-c7173cb0300d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:59.274599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29f8eb07-b5a9-413f-82cd-c7173cb0300d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:59.431496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-29f8eb07-b5a9-413f-82cd-c7173cb0300d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:40:59.446358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-29f8eb07-b5a9-413f-82cd-c7173cb0300d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.189691 Jul 25 19:40:59.446952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 874/1600] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:40:59 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:40:59.452755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5b364fa7-66d7-47fe-a209-9ad79aebf21f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:40:59.455445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5b364fa7-66d7-47fe-a209-9ad79aebf21f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:40:59.461774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b364fa7-66d7-47fe-a209-9ad79aebf21f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:59.462217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b364fa7-66d7-47fe-a209-9ad79aebf21f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:59.462991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b364fa7-66d7-47fe-a209-9ad79aebf21f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:40:59.463422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b364fa7-66d7-47fe-a209-9ad79aebf21f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:40:59.499873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5b364fa7-66d7-47fe-a209-9ad79aebf21f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051511 Jul 25 19:40:59.500472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 875/1601] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:40:59 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:00.290952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b407b10f-2290-42e1-af58-2fb8df7b4f55 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:00.291783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b407b10f-2290-42e1-af58-2fb8df7b4f55 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:00.301135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b407b10f-2290-42e1-af58-2fb8df7b4f55 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:00.301587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b407b10f-2290-42e1-af58-2fb8df7b4f55 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:00.302395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b407b10f-2290-42e1-af58-2fb8df7b4f55 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:00.302836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b407b10f-2290-42e1-af58-2fb8df7b4f55 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:00.502463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b407b10f-2290-42e1-af58-2fb8df7b4f55 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:00.514368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b407b10f-2290-42e1-af58-2fb8df7b4f55 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.226672 Jul 25 19:41:00.516536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 876/1602] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:00 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:00.516702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:41:00.522617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f9482876-61e9-44dd-a885-193ddf80decb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:00.523231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f9482876-61e9-44dd-a885-193ddf80decb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:00.531721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9482876-61e9-44dd-a885-193ddf80decb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:00.532172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9482876-61e9-44dd-a885-193ddf80decb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:00.533183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9482876-61e9-44dd-a885-193ddf80decb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:00.534140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9482876-61e9-44dd-a885-193ddf80decb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:00.732827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f9482876-61e9-44dd-a885-193ddf80decb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:00.744460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f9482876-61e9-44dd-a885-193ddf80decb tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.227669 Jul 25 19:41:00.745119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 877/1603] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:00 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:41:00.750747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fb603783-33b6-4942-8348-b86e6afde69e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:00.753579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fb603783-33b6-4942-8348-b86e6afde69e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:00.760480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fb603783-33b6-4942-8348-b86e6afde69e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:00.760944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fb603783-33b6-4942-8348-b86e6afde69e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:00.761867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fb603783-33b6-4942-8348-b86e6afde69e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:00.762238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fb603783-33b6-4942-8348-b86e6afde69e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:00.802907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fb603783-33b6-4942-8348-b86e6afde69e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056692 Jul 25 19:41:00.803533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 878/1604] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:41:00 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:01.546277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0933d59c-25ba-426b-b0db-a4f26121ba9c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:01.547338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0933d59c-25ba-426b-b0db-a4f26121ba9c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:01.554727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0933d59c-25ba-426b-b0db-a4f26121ba9c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:01.555172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0933d59c-25ba-426b-b0db-a4f26121ba9c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:01.556008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0933d59c-25ba-426b-b0db-a4f26121ba9c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:01.556448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0933d59c-25ba-426b-b0db-a4f26121ba9c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:01.712426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0933d59c-25ba-426b-b0db-a4f26121ba9c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:01.723352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0933d59c-25ba-426b-b0db-a4f26121ba9c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.182127 Jul 25 19:41:01.724119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 879/1605] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:01 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:01.770932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bad40fee-6968-48e2-9969-802a6f32f37e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:01.771586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bad40fee-6968-48e2-9969-802a6f32f37e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:01.778957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bad40fee-6968-48e2-9969-802a6f32f37e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:01.780406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bad40fee-6968-48e2-9969-802a6f32f37e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:01.781333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bad40fee-6968-48e2-9969-802a6f32f37e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:01.782039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bad40fee-6968-48e2-9969-802a6f32f37e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:01.962252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bad40fee-6968-48e2-9969-802a6f32f37e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:01.972224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bad40fee-6968-48e2-9969-802a6f32f37e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.206454 Jul 25 19:41:01.972826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 880/1606] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:01 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:01.977878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e5ba4384-b48f-445e-b2de-9ad17361bcde tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:01.980281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e5ba4384-b48f-445e-b2de-9ad17361bcde tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:01.988024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5ba4384-b48f-445e-b2de-9ad17361bcde tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:01.988483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5ba4384-b48f-445e-b2de-9ad17361bcde tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:01.989315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5ba4384-b48f-445e-b2de-9ad17361bcde tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:01.989757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5ba4384-b48f-445e-b2de-9ad17361bcde tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:02.026685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e5ba4384-b48f-445e-b2de-9ad17361bcde tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052754 Jul 25 19:41:02.027285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 881/1607] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:41:01 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:02.746367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7c484ba9-b4d5-47f8-9295-6672e3a4d5a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:02.747107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7c484ba9-b4d5-47f8-9295-6672e3a4d5a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:02.755224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c484ba9-b4d5-47f8-9295-6672e3a4d5a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:02.755705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c484ba9-b4d5-47f8-9295-6672e3a4d5a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:02.756626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c484ba9-b4d5-47f8-9295-6672e3a4d5a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:02.757096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c484ba9-b4d5-47f8-9295-6672e3a4d5a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:02.921945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7c484ba9-b4d5-47f8-9295-6672e3a4d5a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:02.930882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7c484ba9-b4d5-47f8-9295-6672e3a4d5a3 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.188504 Jul 25 19:41:02.931799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 882/1608] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:02 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:41:02.997847 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cd087f0a-2d81-4963-92c8-6930a86f1c9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:02.999077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cd087f0a-2d81-4963-92c8-6930a86f1c9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:03.006111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd087f0a-2d81-4963-92c8-6930a86f1c9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:03.006689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd087f0a-2d81-4963-92c8-6930a86f1c9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:03.007549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd087f0a-2d81-4963-92c8-6930a86f1c9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:03.008028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd087f0a-2d81-4963-92c8-6930a86f1c9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:03.177766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cd087f0a-2d81-4963-92c8-6930a86f1c9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:03.187902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cd087f0a-2d81-4963-92c8-6930a86f1c9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.194138 Jul 25 19:41:03.188679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 883/1609] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:02 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:03.199189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-65d5bdd3-65c7-42bd-a739-bfa6b0275cf8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:03.203188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-65d5bdd3-65c7-42bd-a739-bfa6b0275cf8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:03.214708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65d5bdd3-65c7-42bd-a739-bfa6b0275cf8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:03.215757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65d5bdd3-65c7-42bd-a739-bfa6b0275cf8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:03.217460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65d5bdd3-65c7-42bd-a739-bfa6b0275cf8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:03.218387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65d5bdd3-65c7-42bd-a739-bfa6b0275cf8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:03.282093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-65d5bdd3-65c7-42bd-a739-bfa6b0275cf8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090585 Jul 25 19:41:03.283110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 884/1610] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:41:03 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:03.955163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cef38dbb-8aaa-4c21-a25b-a532a5dd7dc9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:03.955930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cef38dbb-8aaa-4c21-a25b-a532a5dd7dc9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:03.963361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cef38dbb-8aaa-4c21-a25b-a532a5dd7dc9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:03.963896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cef38dbb-8aaa-4c21-a25b-a532a5dd7dc9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:03.964740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cef38dbb-8aaa-4c21-a25b-a532a5dd7dc9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:03.965221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cef38dbb-8aaa-4c21-a25b-a532a5dd7dc9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:03.971225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:41:04.132565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cef38dbb-8aaa-4c21-a25b-a532a5dd7dc9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:04.140905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cef38dbb-8aaa-4c21-a25b-a532a5dd7dc9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.190423 Jul 25 19:41:04.141499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 885/1611] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:03 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:04.222984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4987bd94-7158-45e1-81f4-e69662619181 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:04.223588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4987bd94-7158-45e1-81f4-e69662619181 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:04.230024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4987bd94-7158-45e1-81f4-e69662619181 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:04.230566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4987bd94-7158-45e1-81f4-e69662619181 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:04.231346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4987bd94-7158-45e1-81f4-e69662619181 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:04.231805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4987bd94-7158-45e1-81f4-e69662619181 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:04.539194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4987bd94-7158-45e1-81f4-e69662619181 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:04.548634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4987bd94-7158-45e1-81f4-e69662619181 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.330666 Jul 25 19:41:04.549284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 886/1612] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:04 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:04.554271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c11d7844-0f18-40f6-8f69-a7b07a86cfcb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:04.556523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c11d7844-0f18-40f6-8f69-a7b07a86cfcb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:04.563441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c11d7844-0f18-40f6-8f69-a7b07a86cfcb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:04.563935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c11d7844-0f18-40f6-8f69-a7b07a86cfcb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:04.564729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c11d7844-0f18-40f6-8f69-a7b07a86cfcb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:04.565162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c11d7844-0f18-40f6-8f69-a7b07a86cfcb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:04.597953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c11d7844-0f18-40f6-8f69-a7b07a86cfcb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047582 Jul 25 19:41:04.598523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 887/1613] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:41:04 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:05.162792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a95645be-4444-4428-aebe-b6fa492e4a7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:05.163797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a95645be-4444-4428-aebe-b6fa492e4a7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:05.172019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a95645be-4444-4428-aebe-b6fa492e4a7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:05.172472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a95645be-4444-4428-aebe-b6fa492e4a7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:05.173268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a95645be-4444-4428-aebe-b6fa492e4a7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:05.173704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a95645be-4444-4428-aebe-b6fa492e4a7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:05.343867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a95645be-4444-4428-aebe-b6fa492e4a7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:05.352379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a95645be-4444-4428-aebe-b6fa492e4a7d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.193579 Jul 25 19:41:05.352972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 888/1614] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:05 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:05.573805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9f4de96f-e833-48e9-ab63-3dca99e43cf5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:05.574429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9f4de96f-e833-48e9-ab63-3dca99e43cf5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:05.581572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f4de96f-e833-48e9-ab63-3dca99e43cf5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:05.582019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f4de96f-e833-48e9-ab63-3dca99e43cf5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:05.582805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f4de96f-e833-48e9-ab63-3dca99e43cf5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:05.583244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f4de96f-e833-48e9-ab63-3dca99e43cf5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:05.741425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9f4de96f-e833-48e9-ab63-3dca99e43cf5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:05.751397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9f4de96f-e833-48e9-ab63-3dca99e43cf5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.181410 Jul 25 19:41:05.752036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 889/1615] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:05 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:05.757006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-09d6fae8-f62e-4368-9e2c-1c7514c1334c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:05.759266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-09d6fae8-f62e-4368-9e2c-1c7514c1334c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:05.766811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-09d6fae8-f62e-4368-9e2c-1c7514c1334c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:05.767280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-09d6fae8-f62e-4368-9e2c-1c7514c1334c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:05.768113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-09d6fae8-f62e-4368-9e2c-1c7514c1334c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:05.768553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-09d6fae8-f62e-4368-9e2c-1c7514c1334c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:05.804983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-09d6fae8-f62e-4368-9e2c-1c7514c1334c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051818 Jul 25 19:41:05.805569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 890/1616] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:41:05 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:06.383108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d145a5d5-c625-455f-873b-6b2883f9d048 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:06.383966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d145a5d5-c625-455f-873b-6b2883f9d048 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:06.392229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d145a5d5-c625-455f-873b-6b2883f9d048 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:06.392809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d145a5d5-c625-455f-873b-6b2883f9d048 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:06.393816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d145a5d5-c625-455f-873b-6b2883f9d048 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:06.394310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d145a5d5-c625-455f-873b-6b2883f9d048 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:06.550627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d145a5d5-c625-455f-873b-6b2883f9d048 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:06.559529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d145a5d5-c625-455f-873b-6b2883f9d048 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.180812 Jul 25 19:41:06.560127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 891/1617] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:06 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:07.001977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9caf6ae3-eee9-4afa-a27e-372884007e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:07.003106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9caf6ae3-eee9-4afa-a27e-372884007e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:07.015276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9caf6ae3-eee9-4afa-a27e-372884007e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:07.016113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9caf6ae3-eee9-4afa-a27e-372884007e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:07.017512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9caf6ae3-eee9-4afa-a27e-372884007e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:07.018294 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9caf6ae3-eee9-4afa-a27e-372884007e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:07.193820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9caf6ae3-eee9-4afa-a27e-372884007e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:07.204090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9caf6ae3-eee9-4afa-a27e-372884007e6a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.423651 Jul 25 19:41:07.204705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 892/1618] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:06 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:07.209773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-752c4138-fbea-4f6c-a478-42441676c379 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:07.212100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-752c4138-fbea-4f6c-a478-42441676c379 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:07.220443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-752c4138-fbea-4f6c-a478-42441676c379 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:07.220894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-752c4138-fbea-4f6c-a478-42441676c379 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:07.221690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-752c4138-fbea-4f6c-a478-42441676c379 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:07.222132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-752c4138-fbea-4f6c-a478-42441676c379 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:07.256661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-752c4138-fbea-4f6c-a478-42441676c379 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050846 Jul 25 19:41:07.257252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 893/1619] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:41:07 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:07.583979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bc0b3644-725e-4e3f-893a-1aa918cc5511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:07.584761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bc0b3644-725e-4e3f-893a-1aa918cc5511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:07.593769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc0b3644-725e-4e3f-893a-1aa918cc5511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:07.594284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc0b3644-725e-4e3f-893a-1aa918cc5511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:07.595340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc0b3644-725e-4e3f-893a-1aa918cc5511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:07.595900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc0b3644-725e-4e3f-893a-1aa918cc5511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:07.746555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bc0b3644-725e-4e3f-893a-1aa918cc5511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:07.755261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bc0b3644-725e-4e3f-893a-1aa918cc5511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.175333 Jul 25 19:41:07.755889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 894/1620] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:07 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:41:08.042298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:08.042680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:08.049953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:08.050403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:08.051240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:08.051735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:18.047152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=88 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:41:18.073145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=62 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:41:38.903317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:41:38.904288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:41:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 (ip 10.222.0.18) !!! Jul 25 19:41:58.998692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:41:58.999454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 (ip 10.222.0.18) !!! Jul 25 19:42:05.155177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:42:05.156128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:42:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 (ip 10.222.0.18) !!! Jul 25 19:42:09.437405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf907c78-82ec-47d0-be23-08581c3e968e) Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Request method failure captured: Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 HTTP/1.1 Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u6T5C8He6CStrqmlyDl-YP4QcYi_cXPhJz0ErQMWUPS7hCSJSFY9Xp2dBtodhQd2YBTHGfKJxGlXeJS6IBLiM7lcKMx0z-ZlYjVJhQL6o6V0Y3ivXn35tPel-t7PaYn45tlD_1Z_FUt9RfSTUzPcCAAtuyfA_vbAGRgre8t11bdSyc Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:42:09.440295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:42:09.443317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_43cfdd0ba7de4e46a17d4c0d698159cf", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:42:09.443317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:42:09.443317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:42:09.443317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:42:09.443317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:42:09.443317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:42:09.443317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:42:09.443317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 324738dd872e445ba845a101f45fa595 Jul 25 19:42:09.443317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:42:09.443317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf907c78-82ec-47d0-be23-08581c3e968e) Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'server_id': 'd238c56a-d3fb-4eaa-abb6-4f9155523e90', 'id': '0e1d33df-af4c-4066-b230-5e7f93c81a16'} Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:42:09.448294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf907c78-82ec-47d0-be23-08581c3e968e) Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:42:09.453401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf907c78-82ec-47d0-be23-08581c3e968e) Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:09.457334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf907c78-82ec-47d0-be23-08581c3e968e) Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:42:09.460773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf907c78-82ec-47d0-be23-08581c3e968e) Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf907c78-82ec-47d0-be23-08581c3e968e) Jul 25 19:42:09.465240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.470840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf907c78-82ec-47d0-be23-08581c3e968e) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:42:09.470840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-faf867dc-0c3b-40a8-9f99-47ed4eee8983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16" status: 400 len: 269 microversion: 2.1 time: 120.117015 Jul 25 19:42:09.470840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 727/1621] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 19:40:09 2022] DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 => generated 269 bytes in 120119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:42:09.470840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-301dea3b-b35e-429b-a75d-0f76703761d0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:09.472208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-301dea3b-b35e-429b-a75d-0f76703761d0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:09.472208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-301dea3b-b35e-429b-a75d-0f76703761d0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:09.472208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-301dea3b-b35e-429b-a75d-0f76703761d0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:09.472208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-301dea3b-b35e-429b-a75d-0f76703761d0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:09.473378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-301dea3b-b35e-429b-a75d-0f76703761d0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:09.627245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-301dea3b-b35e-429b-a75d-0f76703761d0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:09.637418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-301dea3b-b35e-429b-a75d-0f76703761d0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1735 microversion: 2.1 time: 0.193264 Jul 25 19:42:09.638119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 728/1622] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:09 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:09.644628 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a083d1db-0010-4c1b-bc14-1df077cdc257 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:09.647351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a083d1db-0010-4c1b-bc14-1df077cdc257 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:09.656060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a083d1db-0010-4c1b-bc14-1df077cdc257 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:09.656665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a083d1db-0010-4c1b-bc14-1df077cdc257 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:09.657646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a083d1db-0010-4c1b-bc14-1df077cdc257 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:09.658188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a083d1db-0010-4c1b-bc14-1df077cdc257 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:09.708617 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a083d1db-0010-4c1b-bc14-1df077cdc257 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069059 Jul 25 19:42:09.709511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 729/1623] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:09 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:09.715041 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-10676235-724c-49c1-ada4-d98702126d28 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:09.716139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-10676235-724c-49c1-ada4-d98702126d28 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:09.723783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10676235-724c-49c1-ada4-d98702126d28 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:09.724478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10676235-724c-49c1-ada4-d98702126d28 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:09.725483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10676235-724c-49c1-ada4-d98702126d28 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:09.726043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10676235-724c-49c1-ada4-d98702126d28 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:09.795433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lazy-loading 'services' on Instance uuid d238c56a-d3fb-4eaa-abb6-4f9155523e90 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:42:09.920756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10676235-724c-49c1-ada4-d98702126d28 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:09.925042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-10676235-724c-49c1-ada4-d98702126d28 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.214177 Jul 25 19:42:09.926325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 730/1624] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:09 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:09.931500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:09.932028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:09.939013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:09.939464 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:09.940268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:09.940713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:09.981687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-026d2137-fa3d-40e9-8435-3b3f8e912fea) Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Request method failure captured: Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 HTTP/1.1 Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u6T5C8He6CStrqmlyDl-YP4QcYi_cXPhJz0ErQMWUPS7hCSJSFY9Xp2dBtodhQd2YBTHGfKJxGlXeJS6IBLiM7lcKMx0z-ZlYjVJhQL6o6V0Y3ivXn35tPel-t7PaYn45tlD_1Z_FUt9RfSTUzPcCAAtuyfA_vbAGRgre8t11bdSyc Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 19:42:09.985139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 19:42:09.986519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_43cfdd0ba7de4e46a17d4c0d698159cf", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:42:09.986519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:42:09.986519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:42:09.986519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:42:09.986519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:42:09.986519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 19:42:09.986519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 19:42:09.986519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 324738dd872e445ba845a101f45fa595 Jul 25 19:42:09.986519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:42:09.986519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-026d2137-fa3d-40e9-8435-3b3f8e912fea) Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'server_id': 'd238c56a-d3fb-4eaa-abb6-4f9155523e90', 'id': '0e1d33df-af4c-4066-b230-5e7f93c81a16'} Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:42:09.987201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-026d2137-fa3d-40e9-8435-3b3f8e912fea) Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:42:09.988298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-026d2137-fa3d-40e9-8435-3b3f8e912fea) Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:09.989450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-026d2137-fa3d-40e9-8435-3b3f8e912fea) Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:42:09.990586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-026d2137-fa3d-40e9-8435-3b3f8e912fea) Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-026d2137-fa3d-40e9-8435-3b3f8e912fea) Jul 25 19:42:09.993093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:42:09.996580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-026d2137-fa3d-40e9-8435-3b3f8e912fea) {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:42:09.996580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6971f087-59d7-4ac7-8798-2fc487ebf629 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16" status: 400 len: 269 microversion: 2.1 time: 61.949150 Jul 25 19:42:09.996580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 895/1625] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 19:41:08 2022] DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 => generated 269 bytes in 61951 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 19:42:09.996580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d0df15c7-4471-4462-84c2-c63dcbf6f3df tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:09.997726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d0df15c7-4471-4462-84c2-c63dcbf6f3df tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:10.005395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0df15c7-4471-4462-84c2-c63dcbf6f3df tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:10.007167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0df15c7-4471-4462-84c2-c63dcbf6f3df tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:10.008702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0df15c7-4471-4462-84c2-c63dcbf6f3df tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:10.009179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0df15c7-4471-4462-84c2-c63dcbf6f3df tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:10.165982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lazy-loading 'services' on Instance uuid d238c56a-d3fb-4eaa-abb6-4f9155523e90 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:42:10.228242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d0df15c7-4471-4462-84c2-c63dcbf6f3df tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:10.238933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6119c942-1606-4332-a5b3-a1933d8d1707) Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Request method failure captured: Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 HTTP/1.1 Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u6T5C8He6CStrqmlyDl-YP4QcYi_cXPhJz0ErQMWUPS7hCSJSFY9Xp2dBtodhQd2YBTHGfKJxGlXeJS6IBLiM7lcKMx0z-ZlYjVJhQL6o6V0Y3ivXn35tPel-t7PaYn45tlD_1Z_FUt9RfSTUzPcCAAtuyfA_vbAGRgre8t11bdSyc Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:42:10.241301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:42:10.243126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/43cfdd0ba7de4e46a17d4c0d698159cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_43cfdd0ba7de4e46a17d4c0d698159cf", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:42:10.243126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:42:10.243126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 43cfdd0ba7de4e46a17d4c0d698159cf Jul 25 19:42:10.243126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1012759034 Jul 25 19:42:10.243126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:42:10.243126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:42:10.243126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:42:10.243126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 324738dd872e445ba845a101f45fa595 Jul 25 19:42:10.243126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesSnapshotTestJSON-1012759034-project Jul 25 19:42:10.243126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6119c942-1606-4332-a5b3-a1933d8d1707) Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'server_id': 'd238c56a-d3fb-4eaa-abb6-4f9155523e90', 'id': '0e1d33df-af4c-4066-b230-5e7f93c81a16'} Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:42:10.243873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6119c942-1606-4332-a5b3-a1933d8d1707) Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:42:10.245079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6119c942-1606-4332-a5b3-a1933d8d1707) Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:10.246674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6119c942-1606-4332-a5b3-a1933d8d1707) Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:42:10.248323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6119c942-1606-4332-a5b3-a1933d8d1707) Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6119c942-1606-4332-a5b3-a1933d8d1707) Jul 25 19:42:10.249925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:42:10.251329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6119c942-1606-4332-a5b3-a1933d8d1707) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:42:10.251329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81d77c23-69eb-4fb5-9ff4-83a19514df4c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16" status: 400 len: 269 microversion: 2.1 time: 0.315367 Jul 25 19:42:10.251329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 731/1626] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 19:42:09 2022] DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90/os-volume_attachments/0e1d33df-af4c-4066-b230-5e7f93c81a16 => generated 269 bytes in 316 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:42:10.251329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-30151822-9782-4679-9764-8b3f94240db4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:10.253776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-30151822-9782-4679-9764-8b3f94240db4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:10.259128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30151822-9782-4679-9764-8b3f94240db4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:10.259931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30151822-9782-4679-9764-8b3f94240db4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:10.260971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30151822-9782-4679-9764-8b3f94240db4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:10.262339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30151822-9782-4679-9764-8b3f94240db4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:10.264548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d0df15c7-4471-4462-84c2-c63dcbf6f3df tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1689 microversion: 2.1 time: 0.275143 Jul 25 19:42:10.264895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 896/1627] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:09 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1689 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:10.273906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6476b455-07cd-4230-aa14-ad427717dc89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:10.274539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6476b455-07cd-4230-aa14-ad427717dc89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:10.290851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6476b455-07cd-4230-aa14-ad427717dc89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:10.291396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6476b455-07cd-4230-aa14-ad427717dc89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:10.292518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6476b455-07cd-4230-aa14-ad427717dc89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:10.292992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6476b455-07cd-4230-aa14-ad427717dc89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:10.303549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-30151822-9782-4679-9764-8b3f94240db4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058691 Jul 25 19:42:10.304806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 732/1628] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:10 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:10.310069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b5680ff5-b33c-49d7-b01d-abbdd54c0ea7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:10.310877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b5680ff5-b33c-49d7-b01d-abbdd54c0ea7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:10.317915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5680ff5-b33c-49d7-b01d-abbdd54c0ea7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:10.318526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5680ff5-b33c-49d7-b01d-abbdd54c0ea7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:10.319673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5680ff5-b33c-49d7-b01d-abbdd54c0ea7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:10.320347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5680ff5-b33c-49d7-b01d-abbdd54c0ea7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:10.351988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b5680ff5-b33c-49d7-b01d-abbdd54c0ea7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:42:10.451687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b5680ff5-b33c-49d7-b01d-abbdd54c0ea7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 204 len: 0 microversion: 2.1 time: 0.144080 Jul 25 19:42:10.452426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 733/1629] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:42:10 2022] DELETE /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:42:10.461482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-394414c7-ecc0-40a1-8ed0-9d6ee8830459 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:10.462183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-394414c7-ecc0-40a1-8ed0-9d6ee8830459 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:10.469303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394414c7-ecc0-40a1-8ed0-9d6ee8830459 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:10.469786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394414c7-ecc0-40a1-8ed0-9d6ee8830459 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:10.470552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394414c7-ecc0-40a1-8ed0-9d6ee8830459 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:10.470997 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394414c7-ecc0-40a1-8ed0-9d6ee8830459 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:10.532170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6476b455-07cd-4230-aa14-ad427717dc89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:10.543349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6476b455-07cd-4230-aa14-ad427717dc89 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.277198 Jul 25 19:42:10.545093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 897/1630] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:10 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:10.638490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-394414c7-ecc0-40a1-8ed0-9d6ee8830459 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:10.647233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-394414c7-ecc0-40a1-8ed0-9d6ee8830459 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1726 microversion: 2.1 time: 0.189979 Jul 25 19:42:10.647869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 734/1631] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:11.288858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-26d0adf3-c157-4c62-9342-209540ca57dd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:11.289719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-26d0adf3-c157-4c62-9342-209540ca57dd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:11.297766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26d0adf3-c157-4c62-9342-209540ca57dd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:11.298265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26d0adf3-c157-4c62-9342-209540ca57dd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:11.299065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26d0adf3-c157-4c62-9342-209540ca57dd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:11.299552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-26d0adf3-c157-4c62-9342-209540ca57dd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:11.317925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b339c9dd-0d43-4ec0-8b69-dc50067c4feb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:11.320665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b339c9dd-0d43-4ec0-8b69-dc50067c4feb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:11.331820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b339c9dd-0d43-4ec0-8b69-dc50067c4feb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:11.332561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b339c9dd-0d43-4ec0-8b69-dc50067c4feb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:11.333886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b339c9dd-0d43-4ec0-8b69-dc50067c4feb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:11.334610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b339c9dd-0d43-4ec0-8b69-dc50067c4feb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:11.397727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b339c9dd-0d43-4ec0-8b69-dc50067c4feb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083968 Jul 25 19:42:11.398976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 735/1632] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:11 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:11.527068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-26d0adf3-c157-4c62-9342-209540ca57dd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:11.537289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-26d0adf3-c157-4c62-9342-209540ca57dd tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1689 microversion: 2.1 time: 0.252615 Jul 25 19:42:11.537880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 898/1633] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:11 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1689 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:11.569293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b19ac5f-3a0a-467e-b8a7-db412e79d5c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:11.570467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b19ac5f-3a0a-467e-b8a7-db412e79d5c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:11.581268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b19ac5f-3a0a-467e-b8a7-db412e79d5c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:11.581864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b19ac5f-3a0a-467e-b8a7-db412e79d5c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:11.582787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b19ac5f-3a0a-467e-b8a7-db412e79d5c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:11.583337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b19ac5f-3a0a-467e-b8a7-db412e79d5c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:11.671467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-56137f1e-1b2d-4944-a2c8-0d51c7943d2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:11.672226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-56137f1e-1b2d-4944-a2c8-0d51c7943d2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:11.678941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-56137f1e-1b2d-4944-a2c8-0d51c7943d2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:11.679391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-56137f1e-1b2d-4944-a2c8-0d51c7943d2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:11.680219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-56137f1e-1b2d-4944-a2c8-0d51c7943d2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:11.680657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-56137f1e-1b2d-4944-a2c8-0d51c7943d2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:12.078685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b19ac5f-3a0a-467e-b8a7-db412e79d5c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:12.088415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b19ac5f-3a0a-467e-b8a7-db412e79d5c6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.523858 Jul 25 19:42:12.089173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 736/1634] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:11 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:12.144580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-56137f1e-1b2d-4944-a2c8-0d51c7943d2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:12.153279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-56137f1e-1b2d-4944-a2c8-0d51c7943d2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1726 microversion: 2.1 time: 0.486530 Jul 25 19:42:12.153896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 899/1635] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:11 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1726 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:12.412806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c6f5a8e4-4303-401c-9499-27900155784a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:12.415718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c6f5a8e4-4303-401c-9499-27900155784a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:12.425344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6f5a8e4-4303-401c-9499-27900155784a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:12.425870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6f5a8e4-4303-401c-9499-27900155784a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:12.427209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6f5a8e4-4303-401c-9499-27900155784a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:12.427878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6f5a8e4-4303-401c-9499-27900155784a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:12.467928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c6f5a8e4-4303-401c-9499-27900155784a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059059 Jul 25 19:42:12.468676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 737/1636] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:12 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:12.581572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4a255ac8-975d-4e57-8e8a-734f65943b4e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:12.582651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4a255ac8-975d-4e57-8e8a-734f65943b4e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:12.595824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a255ac8-975d-4e57-8e8a-734f65943b4e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:12.596647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a255ac8-975d-4e57-8e8a-734f65943b4e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:12.598663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a255ac8-975d-4e57-8e8a-734f65943b4e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:12.599449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a255ac8-975d-4e57-8e8a-734f65943b4e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:13.125686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a1ce19a9-bfd2-4d05-93df-55c5f8158c5f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:13.126552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a1ce19a9-bfd2-4d05-93df-55c5f8158c5f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:13.136659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1ce19a9-bfd2-4d05-93df-55c5f8158c5f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:13.137998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1ce19a9-bfd2-4d05-93df-55c5f8158c5f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:13.139549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1ce19a9-bfd2-4d05-93df-55c5f8158c5f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:13.140271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1ce19a9-bfd2-4d05-93df-55c5f8158c5f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:13.305840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4a255ac8-975d-4e57-8e8a-734f65943b4e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:13.326507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4a255ac8-975d-4e57-8e8a-734f65943b4e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1689 microversion: 2.1 time: 0.753085 Jul 25 19:42:13.327995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 900/1637] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:12 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1689 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:13.336761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d305a70a-f4d9-4022-b0db-0ab0d71bd676 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:13.338249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d305a70a-f4d9-4022-b0db-0ab0d71bd676 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:13.351144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d305a70a-f4d9-4022-b0db-0ab0d71bd676 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:13.352346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d305a70a-f4d9-4022-b0db-0ab0d71bd676 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:13.355951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d305a70a-f4d9-4022-b0db-0ab0d71bd676 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:13.358065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d305a70a-f4d9-4022-b0db-0ab0d71bd676 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:13.471748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d305a70a-f4d9-4022-b0db-0ab0d71bd676 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:13.481874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d305a70a-f4d9-4022-b0db-0ab0d71bd676 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1659 microversion: 2.1 time: 0.152173 Jul 25 19:42:13.482479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 901/1638] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1659 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:13.488393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9ca0bac9-6889-4375-9769-9e39dbe7c3c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:13.490687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9ca0bac9-6889-4375-9769-9e39dbe7c3c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:13.498468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ca0bac9-6889-4375-9769-9e39dbe7c3c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:13.499073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ca0bac9-6889-4375-9769-9e39dbe7c3c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:13.500053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ca0bac9-6889-4375-9769-9e39dbe7c3c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:13.500502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ca0bac9-6889-4375-9769-9e39dbe7c3c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:13.541009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9ca0bac9-6889-4375-9769-9e39dbe7c3c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056840 Jul 25 19:42:13.544056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 902/1639] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:13 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:13.614109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1ce19a9-bfd2-4d05-93df-55c5f8158c5f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:13.625202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a1ce19a9-bfd2-4d05-93df-55c5f8158c5f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.504431 Jul 25 19:42:13.625836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 738/1640] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:13 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:14.023101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-6dd9b1b6-553f-4727-8b10-66bba35f33f7 req-35ef9d68-7ad4-4013-9425-0809cd1b4e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2db0a6-d453-4feb-b067-466e50a5f44b", "name": "network-vif-deleted", "tag": "4aa6797e-a79e-4609-b7d0-c3826276bcc6"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:42:14.038822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-6dd9b1b6-553f-4727-8b10-66bba35f33f7 req-35ef9d68-7ad4-4013-9425-0809cd1b4e30 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:14.040556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-6dd9b1b6-553f-4727-8b10-66bba35f33f7 req-35ef9d68-7ad4-4013-9425-0809cd1b4e30 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:14.060472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-6dd9b1b6-553f-4727-8b10-66bba35f33f7 req-35ef9d68-7ad4-4013-9425-0809cd1b4e30 service nova] Creating event network-vif-deleted:4aa6797e-a79e-4609-b7d0-c3826276bcc6 for instance 6d2db0a6-d453-4feb-b067-466e50a5f44b on hv-cinder-85093 Jul 25 19:42:14.072163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-6dd9b1b6-553f-4727-8b10-66bba35f33f7 req-35ef9d68-7ad4-4013-9425-0809cd1b4e30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131124 Jul 25 19:42:14.073844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 903/1641] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:14.374097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ffe2782a-0682-4039-ac4e-7766e927837e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:14.376901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ffe2782a-0682-4039-ac4e-7766e927837e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:14.391972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe2782a-0682-4039-ac4e-7766e927837e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:14.393005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe2782a-0682-4039-ac4e-7766e927837e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:14.394569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe2782a-0682-4039-ac4e-7766e927837e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:14.395661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe2782a-0682-4039-ac4e-7766e927837e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:14.511395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3cb1c130-1350-4ba5-912c-0f2656351d5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:14.512774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3cb1c130-1350-4ba5-912c-0f2656351d5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:14.523177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ffe2782a-0682-4039-ac4e-7766e927837e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:14.532632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3cb1c130-1350-4ba5-912c-0f2656351d5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:14.533673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3cb1c130-1350-4ba5-912c-0f2656351d5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:14.534638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3cb1c130-1350-4ba5-912c-0f2656351d5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:14.536212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3cb1c130-1350-4ba5-912c-0f2656351d5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:14.542871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ffe2782a-0682-4039-ac4e-7766e927837e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.184095 Jul 25 19:42:14.558716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 739/1642] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:14 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:14.588138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-271a12b5-8998-40f5-a531-a6f48a24d867 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:14.592316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-271a12b5-8998-40f5-a531-a6f48a24d867 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:14.610120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-271a12b5-8998-40f5-a531-a6f48a24d867 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:14.610584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-271a12b5-8998-40f5-a531-a6f48a24d867 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:14.611671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-271a12b5-8998-40f5-a531-a6f48a24d867 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:14.612184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-271a12b5-8998-40f5-a531-a6f48a24d867 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:14.643149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3cb1c130-1350-4ba5-912c-0f2656351d5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:14.654502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3cb1c130-1350-4ba5-912c-0f2656351d5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.148409 Jul 25 19:42:14.659244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-271a12b5-8998-40f5-a531-a6f48a24d867 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097593 Jul 25 19:42:14.660272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 740/1643] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:14 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:14.670629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e9693944-57c0-4238-91a2-f280f7e2c794 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:14.671183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e9693944-57c0-4238-91a2-f280f7e2c794 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:14.671559 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 904/1644] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:14 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:14.679229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9693944-57c0-4238-91a2-f280f7e2c794 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:14.679819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9693944-57c0-4238-91a2-f280f7e2c794 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:14.680544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9693944-57c0-4238-91a2-f280f7e2c794 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:14.680990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9693944-57c0-4238-91a2-f280f7e2c794 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:14.863751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e9693944-57c0-4238-91a2-f280f7e2c794 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:14.879700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e9693944-57c0-4238-91a2-f280f7e2c794 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.213833 Jul 25 19:42:14.880914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 741/1645] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:14 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:15.589018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e533afdd-1e7c-4372-819a-9673dd7ca90f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:15.589616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e533afdd-1e7c-4372-819a-9673dd7ca90f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:15.597201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e533afdd-1e7c-4372-819a-9673dd7ca90f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:15.597653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e533afdd-1e7c-4372-819a-9673dd7ca90f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:15.598449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e533afdd-1e7c-4372-819a-9673dd7ca90f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:15.598892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e533afdd-1e7c-4372-819a-9673dd7ca90f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:15.675111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-30ffb0d9-9bd7-4310-b3e3-b4cad74d8593 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:15.677889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-30ffb0d9-9bd7-4310-b3e3-b4cad74d8593 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:15.686367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30ffb0d9-9bd7-4310-b3e3-b4cad74d8593 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:15.687018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30ffb0d9-9bd7-4310-b3e3-b4cad74d8593 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:15.688065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30ffb0d9-9bd7-4310-b3e3-b4cad74d8593 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:15.688622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30ffb0d9-9bd7-4310-b3e3-b4cad74d8593 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:15.695673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e533afdd-1e7c-4372-819a-9673dd7ca90f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:15.711974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e533afdd-1e7c-4372-819a-9673dd7ca90f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.126512 Jul 25 19:42:15.712298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:15.722512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 905/1646] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:15 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:15.723201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9cba0e29-896c-48db-bb4a-b70ee8762e44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:15.724445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9cba0e29-896c-48db-bb4a-b70ee8762e44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:15.729242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-30ffb0d9-9bd7-4310-b3e3-b4cad74d8593 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060637 Jul 25 19:42:15.730491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 742/1647] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:15 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:15.738020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cba0e29-896c-48db-bb4a-b70ee8762e44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:15.739100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cba0e29-896c-48db-bb4a-b70ee8762e44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:15.740506 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cba0e29-896c-48db-bb4a-b70ee8762e44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:15.741308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cba0e29-896c-48db-bb4a-b70ee8762e44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:15.845892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9cba0e29-896c-48db-bb4a-b70ee8762e44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:15.857094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9cba0e29-896c-48db-bb4a-b70ee8762e44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.141366 Jul 25 19:42:15.857804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 906/1648] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:15.914158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5940f5f0-6f0c-491d-a3f9-0b9375e44b4a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:15.914801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5940f5f0-6f0c-491d-a3f9-0b9375e44b4a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:15.923980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5940f5f0-6f0c-491d-a3f9-0b9375e44b4a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:15.924422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5940f5f0-6f0c-491d-a3f9-0b9375e44b4a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:15.925201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5940f5f0-6f0c-491d-a3f9-0b9375e44b4a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:15.925637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5940f5f0-6f0c-491d-a3f9-0b9375e44b4a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:16.102570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-2f44395d-560d-4e2d-a08a-8240580af1da req-8c4bd1ec-49dd-419d-a21a-17c857119bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcfc471-41be-4079-81d3-0cf334d03888", "name": "network-vif-deleted", "tag": "2eec74bc-2361-4fec-b124-95a6e3605926"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:42:16.107827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5940f5f0-6f0c-491d-a3f9-0b9375e44b4a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:16.119300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-2f44395d-560d-4e2d-a08a-8240580af1da req-8c4bd1ec-49dd-419d-a21a-17c857119bfe service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:16.120061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-2f44395d-560d-4e2d-a08a-8240580af1da req-8c4bd1ec-49dd-419d-a21a-17c857119bfe service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:16.121169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5940f5f0-6f0c-491d-a3f9-0b9375e44b4a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.210718 Jul 25 19:42:16.122945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 743/1649] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:15 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:16.143948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-2f44395d-560d-4e2d-a08a-8240580af1da req-8c4bd1ec-49dd-419d-a21a-17c857119bfe service nova] Creating event network-vif-deleted:2eec74bc-2361-4fec-b124-95a6e3605926 for instance 4bcfc471-41be-4079-81d3-0cf334d03888 on hv-cinder-85093 Jul 25 19:42:16.152576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-2f44395d-560d-4e2d-a08a-8240580af1da req-8c4bd1ec-49dd-419d-a21a-17c857119bfe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054368 Jul 25 19:42:16.154072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 907/1650] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:16.741422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-95e1d339-c383-4261-8bfe-ebd8d1e42bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:16.742217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-95e1d339-c383-4261-8bfe-ebd8d1e42bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:16.750604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95e1d339-c383-4261-8bfe-ebd8d1e42bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:16.751030 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95e1d339-c383-4261-8bfe-ebd8d1e42bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:16.751807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c5177ab2-8dfb-4744-8242-07fcab3e1038 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:16.752336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95e1d339-c383-4261-8bfe-ebd8d1e42bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:16.752336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95e1d339-c383-4261-8bfe-ebd8d1e42bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:16.756102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c5177ab2-8dfb-4744-8242-07fcab3e1038 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:16.768392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5177ab2-8dfb-4744-8242-07fcab3e1038 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:16.769992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5177ab2-8dfb-4744-8242-07fcab3e1038 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:16.770602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5177ab2-8dfb-4744-8242-07fcab3e1038 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:16.771406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c5177ab2-8dfb-4744-8242-07fcab3e1038 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:16.824214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-95e1d339-c383-4261-8bfe-ebd8d1e42bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:16.831071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c5177ab2-8dfb-4744-8242-07fcab3e1038 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090060 Jul 25 19:42:16.831699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 908/1651] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:16 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:16.835222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-95e1d339-c383-4261-8bfe-ebd8d1e42bd3 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.097845 Jul 25 19:42:16.836356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 744/1652] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:16 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:16.880038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3511e011-4aba-4d86-8093-7dd459a8ebbb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:16.880820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3511e011-4aba-4d86-8093-7dd459a8ebbb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:16.888303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3511e011-4aba-4d86-8093-7dd459a8ebbb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:16.888749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3511e011-4aba-4d86-8093-7dd459a8ebbb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:16.889531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3511e011-4aba-4d86-8093-7dd459a8ebbb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:16.889965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3511e011-4aba-4d86-8093-7dd459a8ebbb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:16.962768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3511e011-4aba-4d86-8093-7dd459a8ebbb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:16.977645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3511e011-4aba-4d86-8093-7dd459a8ebbb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.101734 Jul 25 19:42:16.978679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 909/1653] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:17.159962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1b26c3dd-d833-4806-9b1e-b0e4fe013327 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:17.160648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1b26c3dd-d833-4806-9b1e-b0e4fe013327 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:17.167686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b26c3dd-d833-4806-9b1e-b0e4fe013327 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:17.168244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b26c3dd-d833-4806-9b1e-b0e4fe013327 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:17.169619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b26c3dd-d833-4806-9b1e-b0e4fe013327 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:17.170309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b26c3dd-d833-4806-9b1e-b0e4fe013327 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:17.363236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1b26c3dd-d833-4806-9b1e-b0e4fe013327 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:17.375152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1b26c3dd-d833-4806-9b1e-b0e4fe013327 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.218801 Jul 25 19:42:17.376313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 745/1654] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:17 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:17.847916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-379dc130-4362-45bc-9d80-d403835451e9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:17.850164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-379dc130-4362-45bc-9d80-d403835451e9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:17.859755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-379dc130-4362-45bc-9d80-d403835451e9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:17.860074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bc729c6f-0280-48b0-ac1e-650f15893795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:17.860837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-379dc130-4362-45bc-9d80-d403835451e9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:17.861142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bc729c6f-0280-48b0-ac1e-650f15893795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:17.861343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-379dc130-4362-45bc-9d80-d403835451e9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:17.861815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-379dc130-4362-45bc-9d80-d403835451e9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:17.870420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc729c6f-0280-48b0-ac1e-650f15893795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:17.871082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc729c6f-0280-48b0-ac1e-650f15893795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:17.872700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc729c6f-0280-48b0-ac1e-650f15893795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:17.873366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc729c6f-0280-48b0-ac1e-650f15893795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:17.901314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-379dc130-4362-45bc-9d80-d403835451e9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057610 Jul 25 19:42:17.902097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 910/1655] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:17 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:17.960191 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bc729c6f-0280-48b0-ac1e-650f15893795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:17.969277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bc729c6f-0280-48b0-ac1e-650f15893795 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.114502 Jul 25 19:42:17.969910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 746/1656] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:17 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:18.000833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-45a99ec1-510f-4d22-8515-c6b30d71054f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:18.001536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-45a99ec1-510f-4d22-8515-c6b30d71054f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:18.008431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-45a99ec1-510f-4d22-8515-c6b30d71054f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:18.008872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-45a99ec1-510f-4d22-8515-c6b30d71054f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:18.009672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-45a99ec1-510f-4d22-8515-c6b30d71054f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:18.010146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-45a99ec1-510f-4d22-8515-c6b30d71054f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:18.082215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-45a99ec1-510f-4d22-8515-c6b30d71054f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:18.093289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-45a99ec1-510f-4d22-8515-c6b30d71054f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.097008 Jul 25 19:42:18.093950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 911/1657] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:18.398205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-65bfdd85-7434-4630-ba2a-0c98bfcfaf2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:18.398870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-65bfdd85-7434-4630-ba2a-0c98bfcfaf2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:18.406586 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65bfdd85-7434-4630-ba2a-0c98bfcfaf2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:18.407102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65bfdd85-7434-4630-ba2a-0c98bfcfaf2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:18.408105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65bfdd85-7434-4630-ba2a-0c98bfcfaf2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:18.408638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65bfdd85-7434-4630-ba2a-0c98bfcfaf2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:18.563278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-65bfdd85-7434-4630-ba2a-0c98bfcfaf2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:18.572364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-65bfdd85-7434-4630-ba2a-0c98bfcfaf2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.177986 Jul 25 19:42:18.573031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 747/1658] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:18 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:18.918253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-164286f0-3051-4d1d-9766-315c879d0a0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:18.921507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-164286f0-3051-4d1d-9766-315c879d0a0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:18.928890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-164286f0-3051-4d1d-9766-315c879d0a0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:18.929394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-164286f0-3051-4d1d-9766-315c879d0a0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:18.930277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-164286f0-3051-4d1d-9766-315c879d0a0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:18.930761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-164286f0-3051-4d1d-9766-315c879d0a0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:18.965799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-164286f0-3051-4d1d-9766-315c879d0a0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051653 Jul 25 19:42:18.966668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 912/1659] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:18 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:18.991049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-03dfc2fe-0370-4ec2-b725-c5b872d0c268 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:18.991774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-03dfc2fe-0370-4ec2-b725-c5b872d0c268 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:18.999995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03dfc2fe-0370-4ec2-b725-c5b872d0c268 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:19.000505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03dfc2fe-0370-4ec2-b725-c5b872d0c268 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:19.001343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03dfc2fe-0370-4ec2-b725-c5b872d0c268 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:19.001827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03dfc2fe-0370-4ec2-b725-c5b872d0c268 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:19.072707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-03dfc2fe-0370-4ec2-b725-c5b872d0c268 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:19.081384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-03dfc2fe-0370-4ec2-b725-c5b872d0c268 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.094485 Jul 25 19:42:19.081980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 748/1660] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:18 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:19.116813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-47c3d092-c5ae-46fb-b971-b179651c2904 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:19.117543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-47c3d092-c5ae-46fb-b971-b179651c2904 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:19.124610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47c3d092-c5ae-46fb-b971-b179651c2904 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:19.125080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47c3d092-c5ae-46fb-b971-b179651c2904 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:19.125866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47c3d092-c5ae-46fb-b971-b179651c2904 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:19.126298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47c3d092-c5ae-46fb-b971-b179651c2904 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:19.130972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:19.194219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-47c3d092-c5ae-46fb-b971-b179651c2904 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:19.203653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-47c3d092-c5ae-46fb-b971-b179651c2904 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090570 Jul 25 19:42:19.204358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 913/1661] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:19.596509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1436938b-9f9c-4349-8189-47245fc4e8f8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:19.597117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1436938b-9f9c-4349-8189-47245fc4e8f8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:19.604067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1436938b-9f9c-4349-8189-47245fc4e8f8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:19.604512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1436938b-9f9c-4349-8189-47245fc4e8f8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:19.605297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1436938b-9f9c-4349-8189-47245fc4e8f8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:19.605735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1436938b-9f9c-4349-8189-47245fc4e8f8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:19.757223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1436938b-9f9c-4349-8189-47245fc4e8f8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:19.766663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1436938b-9f9c-4349-8189-47245fc4e8f8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.173980 Jul 25 19:42:19.767327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 749/1662] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:19 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:19.981005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f3c57393-6fb6-4b2c-b502-038df747fbe4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:19.984834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f3c57393-6fb6-4b2c-b502-038df747fbe4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:19.992212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3c57393-6fb6-4b2c-b502-038df747fbe4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:19.992657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3c57393-6fb6-4b2c-b502-038df747fbe4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:19.993441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3c57393-6fb6-4b2c-b502-038df747fbe4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:19.993873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3c57393-6fb6-4b2c-b502-038df747fbe4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:20.030445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f3c57393-6fb6-4b2c-b502-038df747fbe4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055172 Jul 25 19:42:20.031046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 914/1663] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:19 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:20.103961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f17e671-e77d-45d0-b8d8-db9602146eb7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:20.104781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8f17e671-e77d-45d0-b8d8-db9602146eb7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:20.113245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f17e671-e77d-45d0-b8d8-db9602146eb7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:20.113745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f17e671-e77d-45d0-b8d8-db9602146eb7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:20.114656 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f17e671-e77d-45d0-b8d8-db9602146eb7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:20.115135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f17e671-e77d-45d0-b8d8-db9602146eb7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:20.197858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f17e671-e77d-45d0-b8d8-db9602146eb7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:20.207691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8f17e671-e77d-45d0-b8d8-db9602146eb7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.107573 Jul 25 19:42:20.208429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 750/1664] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:20 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:20.225784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6b534bcb-a68c-438d-a658-066bb7f43487 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:20.226719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6b534bcb-a68c-438d-a658-066bb7f43487 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:20.235240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b534bcb-a68c-438d-a658-066bb7f43487 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:20.235689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b534bcb-a68c-438d-a658-066bb7f43487 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:20.236537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b534bcb-a68c-438d-a658-066bb7f43487 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:20.237085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b534bcb-a68c-438d-a658-066bb7f43487 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:20.329940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6b534bcb-a68c-438d-a658-066bb7f43487 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:20.338789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6b534bcb-a68c-438d-a658-066bb7f43487 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.117407 Jul 25 19:42:20.339420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 915/1665] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:20.797994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-547af247-c824-4b96-a518-e1621afcc782 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:20.798612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-547af247-c824-4b96-a518-e1621afcc782 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:20.805313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-547af247-c824-4b96-a518-e1621afcc782 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:20.805755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-547af247-c824-4b96-a518-e1621afcc782 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:20.806539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-547af247-c824-4b96-a518-e1621afcc782 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:20.806979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-547af247-c824-4b96-a518-e1621afcc782 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:20.968561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-547af247-c824-4b96-a518-e1621afcc782 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:20.977405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-547af247-c824-4b96-a518-e1621afcc782 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.184955 Jul 25 19:42:20.978144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 751/1666] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:20 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:21.044493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-343037a9-3adc-42f8-8d1a-164db33bf009 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:21.046704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-343037a9-3adc-42f8-8d1a-164db33bf009 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:21.054270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-343037a9-3adc-42f8-8d1a-164db33bf009 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:21.054768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-343037a9-3adc-42f8-8d1a-164db33bf009 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:21.055757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-343037a9-3adc-42f8-8d1a-164db33bf009 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:21.056238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-343037a9-3adc-42f8-8d1a-164db33bf009 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:21.091599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-343037a9-3adc-42f8-8d1a-164db33bf009 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051866 Jul 25 19:42:21.092364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 916/1667] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:21 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:21.235994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0772df8-45d4-4cd9-ae39-d8238e24352a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:21.236622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d0772df8-45d4-4cd9-ae39-d8238e24352a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:21.244887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0772df8-45d4-4cd9-ae39-d8238e24352a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:21.245379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0772df8-45d4-4cd9-ae39-d8238e24352a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:21.247153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0772df8-45d4-4cd9-ae39-d8238e24352a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:21.247717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0772df8-45d4-4cd9-ae39-d8238e24352a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:21.346542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d0772df8-45d4-4cd9-ae39-d8238e24352a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:21.355584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d0772df8-45d4-4cd9-ae39-d8238e24352a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.124553 Jul 25 19:42:21.357178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 752/1668] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:21 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:21.373585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-48723373-8dd4-4d48-8aed-b892374999ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:21.374359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-48723373-8dd4-4d48-8aed-b892374999ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:21.382390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48723373-8dd4-4d48-8aed-b892374999ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:21.382989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48723373-8dd4-4d48-8aed-b892374999ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:21.383880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48723373-8dd4-4d48-8aed-b892374999ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:21.384356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48723373-8dd4-4d48-8aed-b892374999ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:21.459863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-48723373-8dd4-4d48-8aed-b892374999ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:21.469707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-48723373-8dd4-4d48-8aed-b892374999ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.101678 Jul 25 19:42:21.470304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 917/1669] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:22.001528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62754b29-6263-4792-82b3-382993fc63bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:22.002300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62754b29-6263-4792-82b3-382993fc63bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:22.009530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62754b29-6263-4792-82b3-382993fc63bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:22.009972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62754b29-6263-4792-82b3-382993fc63bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:22.010933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62754b29-6263-4792-82b3-382993fc63bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:22.011214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62754b29-6263-4792-82b3-382993fc63bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:22.106394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7c8e6632-9e22-4740-96ea-47973395b339 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:22.109406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7c8e6632-9e22-4740-96ea-47973395b339 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:22.116852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c8e6632-9e22-4740-96ea-47973395b339 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:22.117548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c8e6632-9e22-4740-96ea-47973395b339 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:22.118503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c8e6632-9e22-4740-96ea-47973395b339 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:22.119035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c8e6632-9e22-4740-96ea-47973395b339 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:22.159831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7c8e6632-9e22-4740-96ea-47973395b339 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058975 Jul 25 19:42:22.160634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 918/1670] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:22 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:22.175832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62754b29-6263-4792-82b3-382993fc63bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:22.185294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62754b29-6263-4792-82b3-382993fc63bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.188135 Jul 25 19:42:22.185876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 753/1671] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:21 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:22.391056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9cd702b7-181f-439d-8945-3766fb62e60b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:22.391708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9cd702b7-181f-439d-8945-3766fb62e60b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:22.397897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cd702b7-181f-439d-8945-3766fb62e60b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:22.398336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cd702b7-181f-439d-8945-3766fb62e60b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:22.399107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cd702b7-181f-439d-8945-3766fb62e60b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:22.399563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cd702b7-181f-439d-8945-3766fb62e60b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:22.473804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9cd702b7-181f-439d-8945-3766fb62e60b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:22.483018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9cd702b7-181f-439d-8945-3766fb62e60b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.096275 Jul 25 19:42:22.484088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 919/1672] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:22 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:22.498082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c736d2fe-e079-49f0-8d3f-624e78ce6f1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:22.499250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c736d2fe-e079-49f0-8d3f-624e78ce6f1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:22.510135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c736d2fe-e079-49f0-8d3f-624e78ce6f1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:22.510629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c736d2fe-e079-49f0-8d3f-624e78ce6f1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:22.511446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c736d2fe-e079-49f0-8d3f-624e78ce6f1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:22.511979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c736d2fe-e079-49f0-8d3f-624e78ce6f1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:22.587699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c736d2fe-e079-49f0-8d3f-624e78ce6f1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:22.597420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c736d2fe-e079-49f0-8d3f-624e78ce6f1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.107054 Jul 25 19:42:22.598019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 754/1673] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:23.172850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-244fa8d0-03b6-48a0-a079-d54c45b04c10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:23.175073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-244fa8d0-03b6-48a0-a079-d54c45b04c10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:23.182227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-244fa8d0-03b6-48a0-a079-d54c45b04c10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:23.182724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-244fa8d0-03b6-48a0-a079-d54c45b04c10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:23.184377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-244fa8d0-03b6-48a0-a079-d54c45b04c10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:23.184911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-244fa8d0-03b6-48a0-a079-d54c45b04c10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:23.209064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-28b35792-03ab-4212-ba4e-c80a925b3e4f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:23.209590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-28b35792-03ab-4212-ba4e-c80a925b3e4f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:23.217037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28b35792-03ab-4212-ba4e-c80a925b3e4f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:23.217483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28b35792-03ab-4212-ba4e-c80a925b3e4f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:23.218263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28b35792-03ab-4212-ba4e-c80a925b3e4f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:23.218744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-244fa8d0-03b6-48a0-a079-d54c45b04c10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050245 Jul 25 19:42:23.218953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28b35792-03ab-4212-ba4e-c80a925b3e4f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:23.219352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 920/1674] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:23 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:23.369643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-28b35792-03ab-4212-ba4e-c80a925b3e4f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:23.378613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-28b35792-03ab-4212-ba4e-c80a925b3e4f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.174712 Jul 25 19:42:23.379260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 755/1675] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:23 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:23.517311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-38b6a4b0-bcb2-4e7b-b644-666fb3c908b7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:23.517833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-38b6a4b0-bcb2-4e7b-b644-666fb3c908b7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:23.524899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38b6a4b0-bcb2-4e7b-b644-666fb3c908b7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:23.525343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38b6a4b0-bcb2-4e7b-b644-666fb3c908b7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:23.526115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38b6a4b0-bcb2-4e7b-b644-666fb3c908b7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:23.526639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38b6a4b0-bcb2-4e7b-b644-666fb3c908b7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:23.596254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-38b6a4b0-bcb2-4e7b-b644-666fb3c908b7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:23.604843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-38b6a4b0-bcb2-4e7b-b644-666fb3c908b7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.091516 Jul 25 19:42:23.605430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 921/1676] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:23 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:23.634287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ff4abe2e-9ddd-41a6-b36d-4e9e94ccd557 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:23.634924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ff4abe2e-9ddd-41a6-b36d-4e9e94ccd557 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:23.643167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4abe2e-9ddd-41a6-b36d-4e9e94ccd557 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:23.643651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4abe2e-9ddd-41a6-b36d-4e9e94ccd557 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:23.644437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4abe2e-9ddd-41a6-b36d-4e9e94ccd557 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:23.644878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4abe2e-9ddd-41a6-b36d-4e9e94ccd557 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:23.713160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ff4abe2e-9ddd-41a6-b36d-4e9e94ccd557 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:23.722550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ff4abe2e-9ddd-41a6-b36d-4e9e94ccd557 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092959 Jul 25 19:42:23.723182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 756/1677] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:24.231583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ee4eed9e-b055-453f-aa1a-b94c6ed6ef90 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:24.234215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ee4eed9e-b055-453f-aa1a-b94c6ed6ef90 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:24.241786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee4eed9e-b055-453f-aa1a-b94c6ed6ef90 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:24.242273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee4eed9e-b055-453f-aa1a-b94c6ed6ef90 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:24.243289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee4eed9e-b055-453f-aa1a-b94c6ed6ef90 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:24.243876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee4eed9e-b055-453f-aa1a-b94c6ed6ef90 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:24.283009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ee4eed9e-b055-453f-aa1a-b94c6ed6ef90 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055989 Jul 25 19:42:24.283501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 922/1678] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:24 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:24.400563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5f5692ec-4be0-455e-91e5-fb2bcbe44e0e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:24.401182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5f5692ec-4be0-455e-91e5-fb2bcbe44e0e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:24.408397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f5692ec-4be0-455e-91e5-fb2bcbe44e0e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:24.408848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f5692ec-4be0-455e-91e5-fb2bcbe44e0e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:24.409639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f5692ec-4be0-455e-91e5-fb2bcbe44e0e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:24.410075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f5692ec-4be0-455e-91e5-fb2bcbe44e0e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:24.598201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5f5692ec-4be0-455e-91e5-fb2bcbe44e0e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:24.608333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5f5692ec-4be0-455e-91e5-fb2bcbe44e0e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.211814 Jul 25 19:42:24.609417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 757/1679] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:24 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:24.627350 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d743a664-625c-472e-be32-7c9b08fe4140 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:24.628022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d743a664-625c-472e-be32-7c9b08fe4140 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:24.634630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d743a664-625c-472e-be32-7c9b08fe4140 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:24.635082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d743a664-625c-472e-be32-7c9b08fe4140 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:24.635922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d743a664-625c-472e-be32-7c9b08fe4140 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:24.636370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d743a664-625c-472e-be32-7c9b08fe4140 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:24.716864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d743a664-625c-472e-be32-7c9b08fe4140 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:24.725325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d743a664-625c-472e-be32-7c9b08fe4140 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.101951 Jul 25 19:42:24.726132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 923/1680] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:24 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:24.745998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1f136d7e-5afd-4534-bb9d-b3a790fc0020 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:24.746666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1f136d7e-5afd-4534-bb9d-b3a790fc0020 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:24.755631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f136d7e-5afd-4534-bb9d-b3a790fc0020 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:24.756077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f136d7e-5afd-4534-bb9d-b3a790fc0020 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:24.756856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f136d7e-5afd-4534-bb9d-b3a790fc0020 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:24.757286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f136d7e-5afd-4534-bb9d-b3a790fc0020 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:24.829878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1f136d7e-5afd-4534-bb9d-b3a790fc0020 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:24.841194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1f136d7e-5afd-4534-bb9d-b3a790fc0020 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.098761 Jul 25 19:42:24.841841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 758/1681] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:25.299550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9eb4cf64-06a3-4c99-9121-ac9da55654a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:25.301831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9eb4cf64-06a3-4c99-9121-ac9da55654a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:25.309530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9eb4cf64-06a3-4c99-9121-ac9da55654a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:25.310217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9eb4cf64-06a3-4c99-9121-ac9da55654a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:25.311108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9eb4cf64-06a3-4c99-9121-ac9da55654a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:25.311754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9eb4cf64-06a3-4c99-9121-ac9da55654a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:25.348238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9eb4cf64-06a3-4c99-9121-ac9da55654a7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052845 Jul 25 19:42:25.348853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 924/1682] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:25 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:25.636866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d7c21ac4-bdd5-45d2-9874-bea6b23ab7ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:25.638727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d7c21ac4-bdd5-45d2-9874-bea6b23ab7ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:25.650148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7c21ac4-bdd5-45d2-9874-bea6b23ab7ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:25.650992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7c21ac4-bdd5-45d2-9874-bea6b23ab7ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:25.652424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7c21ac4-bdd5-45d2-9874-bea6b23ab7ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:25.653864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7c21ac4-bdd5-45d2-9874-bea6b23ab7ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:25.661984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:25.753186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-be94eeaa-054f-4240-a2a1-320ec2309d9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:25.754321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-be94eeaa-054f-4240-a2a1-320ec2309d9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:25.764947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be94eeaa-054f-4240-a2a1-320ec2309d9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:25.765706 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be94eeaa-054f-4240-a2a1-320ec2309d9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:25.767097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be94eeaa-054f-4240-a2a1-320ec2309d9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:25.767935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be94eeaa-054f-4240-a2a1-320ec2309d9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:25.864086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-be94eeaa-054f-4240-a2a1-320ec2309d9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:25.878069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-be94eeaa-054f-4240-a2a1-320ec2309d9a tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.132673 Jul 25 19:42:25.879166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 925/1683] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:25 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:25.885286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7c21ac4-bdd5-45d2-9874-bea6b23ab7ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:25.888768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-24a786ff-47af-4372-b4d1-d1a1d152b5f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:25.889918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-24a786ff-47af-4372-b4d1-d1a1d152b5f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:25.900020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24a786ff-47af-4372-b4d1-d1a1d152b5f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:25.900766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24a786ff-47af-4372-b4d1-d1a1d152b5f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:25.901355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d7c21ac4-bdd5-45d2-9874-bea6b23ab7ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.272424 Jul 25 19:42:25.902172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24a786ff-47af-4372-b4d1-d1a1d152b5f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:25.902453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 759/1684] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:25 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:25.903484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24a786ff-47af-4372-b4d1-d1a1d152b5f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:26.009943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-24a786ff-47af-4372-b4d1-d1a1d152b5f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:26.027055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-24a786ff-47af-4372-b4d1-d1a1d152b5f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.146002 Jul 25 19:42:26.028241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 926/1685] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:26.364211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-435ae3f1-47d6-4bff-bd1d-bd5c39ca3efa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:26.368216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-435ae3f1-47d6-4bff-bd1d-bd5c39ca3efa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:26.380338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-435ae3f1-47d6-4bff-bd1d-bd5c39ca3efa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:26.381010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-435ae3f1-47d6-4bff-bd1d-bd5c39ca3efa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:26.382142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-435ae3f1-47d6-4bff-bd1d-bd5c39ca3efa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:26.382824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-435ae3f1-47d6-4bff-bd1d-bd5c39ca3efa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:26.426576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-435ae3f1-47d6-4bff-bd1d-bd5c39ca3efa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068892 Jul 25 19:42:26.427180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 760/1686] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:26 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:26.904362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ff9e2275-d091-4640-849e-b07957cf9ac1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:26.905136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ff9e2275-d091-4640-849e-b07957cf9ac1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:26.912481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff9e2275-d091-4640-849e-b07957cf9ac1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:26.912977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff9e2275-d091-4640-849e-b07957cf9ac1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:26.913816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff9e2275-d091-4640-849e-b07957cf9ac1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:26.914379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff9e2275-d091-4640-849e-b07957cf9ac1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:26.926259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f2a3fc9-7b33-4dd3-a009-aec70b96b85d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:26.927142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2f2a3fc9-7b33-4dd3-a009-aec70b96b85d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:26.935640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f2a3fc9-7b33-4dd3-a009-aec70b96b85d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:26.936353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f2a3fc9-7b33-4dd3-a009-aec70b96b85d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:26.937673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f2a3fc9-7b33-4dd3-a009-aec70b96b85d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:26.938318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f2a3fc9-7b33-4dd3-a009-aec70b96b85d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:27.031046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ff9e2275-d091-4640-849e-b07957cf9ac1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:27.039773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ff9e2275-d091-4640-849e-b07957cf9ac1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.139492 Jul 25 19:42:27.040362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 927/1687] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:26 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:27.063721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fee02359-bda5-45d9-b220-495318715d66 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:27.064455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fee02359-bda5-45d9-b220-495318715d66 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:27.071091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fee02359-bda5-45d9-b220-495318715d66 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:27.071574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fee02359-bda5-45d9-b220-495318715d66 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:27.072379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fee02359-bda5-45d9-b220-495318715d66 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:27.072817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fee02359-bda5-45d9-b220-495318715d66 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:27.130198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2f2a3fc9-7b33-4dd3-a009-aec70b96b85d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:27.138941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2f2a3fc9-7b33-4dd3-a009-aec70b96b85d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.216694 Jul 25 19:42:27.139583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 761/1688] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:26 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:27.147293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fee02359-bda5-45d9-b220-495318715d66 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:27.156723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fee02359-bda5-45d9-b220-495318715d66 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.098462 Jul 25 19:42:27.157321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 928/1689] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:27.446232 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62a15351-325d-4d79-834a-91384ab12654 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:27.450533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62a15351-325d-4d79-834a-91384ab12654 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:27.459381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a15351-325d-4d79-834a-91384ab12654 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:27.459876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a15351-325d-4d79-834a-91384ab12654 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:27.460980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a15351-325d-4d79-834a-91384ab12654 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:27.461850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a15351-325d-4d79-834a-91384ab12654 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:27.494302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62a15351-325d-4d79-834a-91384ab12654 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055221 Jul 25 19:42:27.494897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 762/1690] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:27 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:28.062753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-78daa576-e248-45d2-a887-0c06f38d3992 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:28.063809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-78daa576-e248-45d2-a887-0c06f38d3992 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:28.071245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78daa576-e248-45d2-a887-0c06f38d3992 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:28.071775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78daa576-e248-45d2-a887-0c06f38d3992 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:28.072747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78daa576-e248-45d2-a887-0c06f38d3992 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:28.073227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78daa576-e248-45d2-a887-0c06f38d3992 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:28.151225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78daa576-e248-45d2-a887-0c06f38d3992 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:28.155964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:28.162633 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-78daa576-e248-45d2-a887-0c06f38d3992 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.104498 Jul 25 19:42:28.171575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 929/1691] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:28 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:28.171914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ed4005ff-80a5-443d-b5bc-9512068e2d47 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:28.171914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ed4005ff-80a5-443d-b5bc-9512068e2d47 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:28.182634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-470b5469-0fa6-470a-9795-9ebadc63fd09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:28.183261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-470b5469-0fa6-470a-9795-9ebadc63fd09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:28.183494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed4005ff-80a5-443d-b5bc-9512068e2d47 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:28.185915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed4005ff-80a5-443d-b5bc-9512068e2d47 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:28.187207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed4005ff-80a5-443d-b5bc-9512068e2d47 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:28.188017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed4005ff-80a5-443d-b5bc-9512068e2d47 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:28.191314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-470b5469-0fa6-470a-9795-9ebadc63fd09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:28.191979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-470b5469-0fa6-470a-9795-9ebadc63fd09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:28.192789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-470b5469-0fa6-470a-9795-9ebadc63fd09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:28.193206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-470b5469-0fa6-470a-9795-9ebadc63fd09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:28.274802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-470b5469-0fa6-470a-9795-9ebadc63fd09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:28.284954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-470b5469-0fa6-470a-9795-9ebadc63fd09 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.106196 Jul 25 19:42:28.285548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 930/1692] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:28.376000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ed4005ff-80a5-443d-b5bc-9512068e2d47 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:28.385216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ed4005ff-80a5-443d-b5bc-9512068e2d47 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.226023 Jul 25 19:42:28.385813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 763/1693] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:28 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:28.508235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6872b5d4-b6ed-4a52-9dcc-ffbbc65a6978 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:28.510477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6872b5d4-b6ed-4a52-9dcc-ffbbc65a6978 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:28.518163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6872b5d4-b6ed-4a52-9dcc-ffbbc65a6978 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:28.518620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6872b5d4-b6ed-4a52-9dcc-ffbbc65a6978 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:28.519879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6872b5d4-b6ed-4a52-9dcc-ffbbc65a6978 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:28.520735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6872b5d4-b6ed-4a52-9dcc-ffbbc65a6978 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:28.556041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6872b5d4-b6ed-4a52-9dcc-ffbbc65a6978 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052131 Jul 25 19:42:28.556701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 931/1694] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:28 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:29.187362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-824278ed-e889-46a4-9e50-d8e55a9091f7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:29.188016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-824278ed-e889-46a4-9e50-d8e55a9091f7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:29.195300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-824278ed-e889-46a4-9e50-d8e55a9091f7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:29.195774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-824278ed-e889-46a4-9e50-d8e55a9091f7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:29.196559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-824278ed-e889-46a4-9e50-d8e55a9091f7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:29.197126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-824278ed-e889-46a4-9e50-d8e55a9091f7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:29.280933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-824278ed-e889-46a4-9e50-d8e55a9091f7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:29.297857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-824278ed-e889-46a4-9e50-d8e55a9091f7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.114814 Jul 25 19:42:29.299107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 764/1695] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:29 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:29.307095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7382003f-2f0c-4054-9ed2-4f8cd57aed16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:29.307996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7382003f-2f0c-4054-9ed2-4f8cd57aed16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:29.315719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7382003f-2f0c-4054-9ed2-4f8cd57aed16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:29.316175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7382003f-2f0c-4054-9ed2-4f8cd57aed16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:29.316973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7382003f-2f0c-4054-9ed2-4f8cd57aed16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:29.317420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7382003f-2f0c-4054-9ed2-4f8cd57aed16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:29.397632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7382003f-2f0c-4054-9ed2-4f8cd57aed16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:29.409731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7382003f-2f0c-4054-9ed2-4f8cd57aed16 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.106317 Jul 25 19:42:29.410977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-102912ae-27ed-4806-845a-1318f2071fae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:29.411782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-102912ae-27ed-4806-845a-1318f2071fae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:29.411996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 932/1696] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:29 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:29.420923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-102912ae-27ed-4806-845a-1318f2071fae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:29.421606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-102912ae-27ed-4806-845a-1318f2071fae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:29.422520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-102912ae-27ed-4806-845a-1318f2071fae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:29.423217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-102912ae-27ed-4806-845a-1318f2071fae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:29.574155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-74484065-3b35-44f2-b5c6-594bfb696537 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:29.578930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-74484065-3b35-44f2-b5c6-594bfb696537 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:29.589715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74484065-3b35-44f2-b5c6-594bfb696537 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:29.591115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74484065-3b35-44f2-b5c6-594bfb696537 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:29.592558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74484065-3b35-44f2-b5c6-594bfb696537 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:29.593331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74484065-3b35-44f2-b5c6-594bfb696537 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:29.596267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-102912ae-27ed-4806-845a-1318f2071fae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:29.604895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-102912ae-27ed-4806-845a-1318f2071fae tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.199594 Jul 25 19:42:29.606323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 765/1697] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:29 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:29.656323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-74484065-3b35-44f2-b5c6-594bfb696537 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089232 Jul 25 19:42:29.657380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 933/1698] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:29 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:30.332798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51084bce-cfb6-4dcb-928e-5e732de740c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:30.333534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51084bce-cfb6-4dcb-928e-5e732de740c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:30.341873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51084bce-cfb6-4dcb-928e-5e732de740c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:30.342367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51084bce-cfb6-4dcb-928e-5e732de740c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:30.343290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51084bce-cfb6-4dcb-928e-5e732de740c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:30.343766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51084bce-cfb6-4dcb-928e-5e732de740c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:30.420253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51084bce-cfb6-4dcb-928e-5e732de740c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:30.432557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51084bce-cfb6-4dcb-928e-5e732de740c7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.103934 Jul 25 19:42:30.436946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 766/1699] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:30 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:30.438658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e1e826b4-d06c-41ad-97b2-5a73e4196699 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:30.439663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e1e826b4-d06c-41ad-97b2-5a73e4196699 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:30.447812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1e826b4-d06c-41ad-97b2-5a73e4196699 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:30.448411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1e826b4-d06c-41ad-97b2-5a73e4196699 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:30.450217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1e826b4-d06c-41ad-97b2-5a73e4196699 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:30.450715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1e826b4-d06c-41ad-97b2-5a73e4196699 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:30.532445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e1e826b4-d06c-41ad-97b2-5a73e4196699 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:30.542129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e1e826b4-d06c-41ad-97b2-5a73e4196699 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.110138 Jul 25 19:42:30.542723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 934/1700] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:30.630893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-edf559fa-b338-42ee-9d69-47ddc5703253 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:30.631543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-edf559fa-b338-42ee-9d69-47ddc5703253 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:30.639223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edf559fa-b338-42ee-9d69-47ddc5703253 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:30.639985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edf559fa-b338-42ee-9d69-47ddc5703253 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:30.640906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edf559fa-b338-42ee-9d69-47ddc5703253 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:30.641388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edf559fa-b338-42ee-9d69-47ddc5703253 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:30.670616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-da682a95-641b-48ae-b301-f0674def5298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:30.673724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-da682a95-641b-48ae-b301-f0674def5298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:30.680805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da682a95-641b-48ae-b301-f0674def5298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:30.681343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da682a95-641b-48ae-b301-f0674def5298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:30.682382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da682a95-641b-48ae-b301-f0674def5298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:30.682926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da682a95-641b-48ae-b301-f0674def5298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:30.721830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-da682a95-641b-48ae-b301-f0674def5298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056289 Jul 25 19:42:30.722436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 935/1701] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:30 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:30.870953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-edf559fa-b338-42ee-9d69-47ddc5703253 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:30.881894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-edf559fa-b338-42ee-9d69-47ddc5703253 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.255249 Jul 25 19:42:30.883279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 767/1702] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:30 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:31.459093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e57c30c1-1684-44ec-b103-6ae460be90f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:31.459880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e57c30c1-1684-44ec-b103-6ae460be90f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:31.468136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e57c30c1-1684-44ec-b103-6ae460be90f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:31.468587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e57c30c1-1684-44ec-b103-6ae460be90f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:31.469401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e57c30c1-1684-44ec-b103-6ae460be90f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:31.469841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e57c30c1-1684-44ec-b103-6ae460be90f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:31.543094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e57c30c1-1684-44ec-b103-6ae460be90f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:31.552983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e57c30c1-1684-44ec-b103-6ae460be90f0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.097862 Jul 25 19:42:31.553594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 936/1703] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:31 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:31.567538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c048208-12d7-45ac-82c3-67c8488e29d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:31.568601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c048208-12d7-45ac-82c3-67c8488e29d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:31.580111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c048208-12d7-45ac-82c3-67c8488e29d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:31.580808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c048208-12d7-45ac-82c3-67c8488e29d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:31.581992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c048208-12d7-45ac-82c3-67c8488e29d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:31.582530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c048208-12d7-45ac-82c3-67c8488e29d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:31.660065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c048208-12d7-45ac-82c3-67c8488e29d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:31.672221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c048208-12d7-45ac-82c3-67c8488e29d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.111259 Jul 25 19:42:31.672850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 768/1704] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:31.736287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6d4ddd20-eb13-416e-b94d-30490d1137a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:31.738581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6d4ddd20-eb13-416e-b94d-30490d1137a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:31.745684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6d4ddd20-eb13-416e-b94d-30490d1137a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:31.746695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6d4ddd20-eb13-416e-b94d-30490d1137a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:31.747793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6d4ddd20-eb13-416e-b94d-30490d1137a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:31.748321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6d4ddd20-eb13-416e-b94d-30490d1137a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:31.796136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6d4ddd20-eb13-416e-b94d-30490d1137a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064763 Jul 25 19:42:31.797171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 937/1705] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:31 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:31.907377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ea662acd-0895-467d-b23a-1c363e1fc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:31.908029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ea662acd-0895-467d-b23a-1c363e1fc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:31.914842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea662acd-0895-467d-b23a-1c363e1fc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:31.915288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea662acd-0895-467d-b23a-1c363e1fc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:31.916108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea662acd-0895-467d-b23a-1c363e1fc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:31.916560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea662acd-0895-467d-b23a-1c363e1fc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:32.089724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ea662acd-0895-467d-b23a-1c363e1fc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:32.099136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ea662acd-0895-467d-b23a-1c363e1fc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.197599 Jul 25 19:42:32.099762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 769/1706] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:31 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:32.578970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8ec2a7dc-b888-4737-a85d-af8357f9d143 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:32.579654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8ec2a7dc-b888-4737-a85d-af8357f9d143 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:32.586931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ec2a7dc-b888-4737-a85d-af8357f9d143 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:32.587389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ec2a7dc-b888-4737-a85d-af8357f9d143 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:32.588223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ec2a7dc-b888-4737-a85d-af8357f9d143 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:32.588667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ec2a7dc-b888-4737-a85d-af8357f9d143 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:32.660111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8ec2a7dc-b888-4737-a85d-af8357f9d143 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:32.668832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8ec2a7dc-b888-4737-a85d-af8357f9d143 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.094013 Jul 25 19:42:32.669443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 938/1707] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:32 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:32.701191 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e7b8b3d0-032b-44f1-8f37-1eef8149bcc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:32.701983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e7b8b3d0-032b-44f1-8f37-1eef8149bcc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:32.710860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7b8b3d0-032b-44f1-8f37-1eef8149bcc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:32.711641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7b8b3d0-032b-44f1-8f37-1eef8149bcc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:32.713000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7b8b3d0-032b-44f1-8f37-1eef8149bcc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:32.713774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7b8b3d0-032b-44f1-8f37-1eef8149bcc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:32.785575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e7b8b3d0-032b-44f1-8f37-1eef8149bcc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:32.795850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e7b8b3d0-032b-44f1-8f37-1eef8149bcc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.100777 Jul 25 19:42:32.796571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 770/1708] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:32.814873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3f920db1-d331-4395-af0e-414d23bcafb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:32.817943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3f920db1-d331-4395-af0e-414d23bcafb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:32.825042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f920db1-d331-4395-af0e-414d23bcafb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:32.825661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f920db1-d331-4395-af0e-414d23bcafb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:32.826505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f920db1-d331-4395-af0e-414d23bcafb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:32.827043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f920db1-d331-4395-af0e-414d23bcafb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:32.862062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3f920db1-d331-4395-af0e-414d23bcafb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055518 Jul 25 19:42:32.862855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 939/1709] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:32 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:33.131964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b332185-e37d-4b78-84c5-7e6125ec520f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:33.132581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b332185-e37d-4b78-84c5-7e6125ec520f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:33.140022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b332185-e37d-4b78-84c5-7e6125ec520f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:33.140491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b332185-e37d-4b78-84c5-7e6125ec520f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:33.141731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b332185-e37d-4b78-84c5-7e6125ec520f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:33.142284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b332185-e37d-4b78-84c5-7e6125ec520f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:33.334029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b332185-e37d-4b78-84c5-7e6125ec520f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:33.344515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b332185-e37d-4b78-84c5-7e6125ec520f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.216775 Jul 25 19:42:33.345116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 771/1710] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:33 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:33.690606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d4806e33-31d7-42f2-aa46-f4acd8c02dfc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:33.691280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d4806e33-31d7-42f2-aa46-f4acd8c02dfc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:33.698118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4806e33-31d7-42f2-aa46-f4acd8c02dfc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:33.698563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4806e33-31d7-42f2-aa46-f4acd8c02dfc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:33.699986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4806e33-31d7-42f2-aa46-f4acd8c02dfc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:33.700859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4806e33-31d7-42f2-aa46-f4acd8c02dfc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:33.797254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d4806e33-31d7-42f2-aa46-f4acd8c02dfc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:33.807845 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d4806e33-31d7-42f2-aa46-f4acd8c02dfc tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.121047 Jul 25 19:42:33.808442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 940/1711] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:33 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:33.823187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-84a27a82-9ebe-473d-9a7c-57f323b81613 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:33.824199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-84a27a82-9ebe-473d-9a7c-57f323b81613 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:33.831251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84a27a82-9ebe-473d-9a7c-57f323b81613 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:33.831793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84a27a82-9ebe-473d-9a7c-57f323b81613 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:33.832709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84a27a82-9ebe-473d-9a7c-57f323b81613 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:33.833190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84a27a82-9ebe-473d-9a7c-57f323b81613 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:33.878459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8402429d-c261-4ba6-9829-e39a8ba046eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:33.880640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8402429d-c261-4ba6-9829-e39a8ba046eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:33.887622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8402429d-c261-4ba6-9829-e39a8ba046eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:33.888266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8402429d-c261-4ba6-9829-e39a8ba046eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:33.889333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8402429d-c261-4ba6-9829-e39a8ba046eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:33.889855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8402429d-c261-4ba6-9829-e39a8ba046eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:33.912248 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84a27a82-9ebe-473d-9a7c-57f323b81613 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:33.926376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8402429d-c261-4ba6-9829-e39a8ba046eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054284 Jul 25 19:42:33.926966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 941/1712] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:33 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:33.928633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-84a27a82-9ebe-473d-9a7c-57f323b81613 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.109449 Jul 25 19:42:33.929665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 772/1713] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:34.378815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e3f7accd-5b21-4f8d-a4b5-13fbdacc3b7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:34.379430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e3f7accd-5b21-4f8d-a4b5-13fbdacc3b7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:34.386037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e3f7accd-5b21-4f8d-a4b5-13fbdacc3b7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:34.386487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e3f7accd-5b21-4f8d-a4b5-13fbdacc3b7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:34.388375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e3f7accd-5b21-4f8d-a4b5-13fbdacc3b7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:34.388828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e3f7accd-5b21-4f8d-a4b5-13fbdacc3b7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:34.553663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e3f7accd-5b21-4f8d-a4b5-13fbdacc3b7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:34.563410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e3f7accd-5b21-4f8d-a4b5-13fbdacc3b7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.188519 Jul 25 19:42:34.564147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 942/1714] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:34 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:34.832152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f565888-192c-49f2-8035-9d35dca51e9f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:34.832772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8f565888-192c-49f2-8035-9d35dca51e9f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:34.843280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f565888-192c-49f2-8035-9d35dca51e9f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:34.843764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f565888-192c-49f2-8035-9d35dca51e9f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:34.844568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f565888-192c-49f2-8035-9d35dca51e9f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:34.845015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f565888-192c-49f2-8035-9d35dca51e9f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:34.917570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f565888-192c-49f2-8035-9d35dca51e9f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:34.926763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8f565888-192c-49f2-8035-9d35dca51e9f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.098607 Jul 25 19:42:34.927446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 773/1715] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:34 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:34.945269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bf1f164e-c8c9-453f-8194-5c138fc63211 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:34.948614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bf1f164e-c8c9-453f-8194-5c138fc63211 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:34.961887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bdf3b0c9-8c26-4284-877f-e3cfebefc450 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:34.962148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf1f164e-c8c9-453f-8194-5c138fc63211 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:34.962497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bdf3b0c9-8c26-4284-877f-e3cfebefc450 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:34.962903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf1f164e-c8c9-453f-8194-5c138fc63211 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:34.964333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf1f164e-c8c9-453f-8194-5c138fc63211 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:34.965652 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bf1f164e-c8c9-453f-8194-5c138fc63211 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:34.968854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:34.971472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bdf3b0c9-8c26-4284-877f-e3cfebefc450 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:34.972029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bdf3b0c9-8c26-4284-877f-e3cfebefc450 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:34.972965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bdf3b0c9-8c26-4284-877f-e3cfebefc450 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:34.973491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bdf3b0c9-8c26-4284-877f-e3cfebefc450 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:35.024002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bf1f164e-c8c9-453f-8194-5c138fc63211 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085804 Jul 25 19:42:35.025069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 943/1716] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:34 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:35.050321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bdf3b0c9-8c26-4284-877f-e3cfebefc450 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:35.066020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bdf3b0c9-8c26-4284-877f-e3cfebefc450 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.107549 Jul 25 19:42:35.067084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 774/1717] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:35.588890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e21dfcfb-10af-4939-ba3a-1166034204bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:35.589596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e21dfcfb-10af-4939-ba3a-1166034204bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:35.597153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e21dfcfb-10af-4939-ba3a-1166034204bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:35.597596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e21dfcfb-10af-4939-ba3a-1166034204bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:35.598374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e21dfcfb-10af-4939-ba3a-1166034204bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:35.598808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e21dfcfb-10af-4939-ba3a-1166034204bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:35.784186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e21dfcfb-10af-4939-ba3a-1166034204bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:35.795727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e21dfcfb-10af-4939-ba3a-1166034204bc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.212240 Jul 25 19:42:35.796530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 944/1718] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:35 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:35.951590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a2ecf9af-f505-450c-8333-2ca635266783 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:35.952192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a2ecf9af-f505-450c-8333-2ca635266783 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:35.959067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2ecf9af-f505-450c-8333-2ca635266783 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:35.959529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2ecf9af-f505-450c-8333-2ca635266783 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:35.960309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2ecf9af-f505-450c-8333-2ca635266783 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:35.960743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2ecf9af-f505-450c-8333-2ca635266783 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:36.033873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a2ecf9af-f505-450c-8333-2ca635266783 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:36.037648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:36.042376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-712dcece-c177-4ea3-87e4-8884febb7610 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:36.044171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a2ecf9af-f505-450c-8333-2ca635266783 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.096972 Jul 25 19:42:36.044769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 775/1719] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:35 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:36.047496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-712dcece-c177-4ea3-87e4-8884febb7610 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:36.053653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:36.060821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-712dcece-c177-4ea3-87e4-8884febb7610 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:36.061492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-712dcece-c177-4ea3-87e4-8884febb7610 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:36.062511 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-712dcece-c177-4ea3-87e4-8884febb7610 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:36.063094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-712dcece-c177-4ea3-87e4-8884febb7610 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:36.099480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-712dcece-c177-4ea3-87e4-8884febb7610 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062104 Jul 25 19:42:36.100292 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 945/1720] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:36 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:36.107151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-882c7b7b-9a5e-41de-aeeb-7077334cbaa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:36.108279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-882c7b7b-9a5e-41de-aeeb-7077334cbaa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:36.120044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-882c7b7b-9a5e-41de-aeeb-7077334cbaa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:36.120853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-882c7b7b-9a5e-41de-aeeb-7077334cbaa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:36.122809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-882c7b7b-9a5e-41de-aeeb-7077334cbaa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:36.123564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-882c7b7b-9a5e-41de-aeeb-7077334cbaa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:36.196116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-882c7b7b-9a5e-41de-aeeb-7077334cbaa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:36.205546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-882c7b7b-9a5e-41de-aeeb-7077334cbaa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.107156 Jul 25 19:42:36.206048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 776/1721] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:36.820351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-34d7a377-10e2-4b2e-adf7-b065cd75e51f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:36.820968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-34d7a377-10e2-4b2e-adf7-b065cd75e51f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:36.829441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34d7a377-10e2-4b2e-adf7-b065cd75e51f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:36.829886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34d7a377-10e2-4b2e-adf7-b065cd75e51f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:36.830717 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34d7a377-10e2-4b2e-adf7-b065cd75e51f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:36.831252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34d7a377-10e2-4b2e-adf7-b065cd75e51f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:36.853507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:37.000274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-34d7a377-10e2-4b2e-adf7-b065cd75e51f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:37.009240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-34d7a377-10e2-4b2e-adf7-b065cd75e51f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.192745 Jul 25 19:42:37.009922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 946/1722] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:36 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:37.072981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13bdbe6c-4918-4cff-8045-503bbcd0c77b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:37.073580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-13bdbe6c-4918-4cff-8045-503bbcd0c77b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:37.082033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13bdbe6c-4918-4cff-8045-503bbcd0c77b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:37.082599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13bdbe6c-4918-4cff-8045-503bbcd0c77b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:37.083685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13bdbe6c-4918-4cff-8045-503bbcd0c77b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:37.084271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13bdbe6c-4918-4cff-8045-503bbcd0c77b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:37.114629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d9f7396d-ebd1-45cd-84e7-8a3a1504dbf6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:37.117626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d9f7396d-ebd1-45cd-84e7-8a3a1504dbf6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:37.125742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9f7396d-ebd1-45cd-84e7-8a3a1504dbf6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:37.126191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9f7396d-ebd1-45cd-84e7-8a3a1504dbf6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:37.127031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9f7396d-ebd1-45cd-84e7-8a3a1504dbf6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:37.127477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9f7396d-ebd1-45cd-84e7-8a3a1504dbf6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:37.164051 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-13bdbe6c-4918-4cff-8045-503bbcd0c77b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:37.170489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d9f7396d-ebd1-45cd-84e7-8a3a1504dbf6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059981 Jul 25 19:42:37.171398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 947/1723] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:37 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:37.179377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13bdbe6c-4918-4cff-8045-503bbcd0c77b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.110631 Jul 25 19:42:37.180128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 777/1724] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:37 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:37.230259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ce1a430e-6749-4ed4-95ee-19bb77445935 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:37.232440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ce1a430e-6749-4ed4-95ee-19bb77445935 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:37.242969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce1a430e-6749-4ed4-95ee-19bb77445935 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:37.243794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce1a430e-6749-4ed4-95ee-19bb77445935 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:37.245162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce1a430e-6749-4ed4-95ee-19bb77445935 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:37.245944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce1a430e-6749-4ed4-95ee-19bb77445935 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:37.318821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ce1a430e-6749-4ed4-95ee-19bb77445935 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:37.329564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ce1a430e-6749-4ed4-95ee-19bb77445935 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.106250 Jul 25 19:42:37.330092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 948/1725] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:38.033258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-063e9ace-ab5c-4cf2-a123-6fc31d1908d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:38.033868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-063e9ace-ab5c-4cf2-a123-6fc31d1908d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:38.040294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-063e9ace-ab5c-4cf2-a123-6fc31d1908d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:38.040735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-063e9ace-ab5c-4cf2-a123-6fc31d1908d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:38.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-063e9ace-ab5c-4cf2-a123-6fc31d1908d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:38.041954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-063e9ace-ab5c-4cf2-a123-6fc31d1908d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:38.187782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0d4fbdef-cb1a-4bf1-8015-bb49a46fc43f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:38.190020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0d4fbdef-cb1a-4bf1-8015-bb49a46fc43f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:38.199024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4fbdef-cb1a-4bf1-8015-bb49a46fc43f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:38.201588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4fbdef-cb1a-4bf1-8015-bb49a46fc43f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:38.203105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4fbdef-cb1a-4bf1-8015-bb49a46fc43f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:38.203865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4fbdef-cb1a-4bf1-8015-bb49a46fc43f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:38.239058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-063e9ace-ab5c-4cf2-a123-6fc31d1908d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:38.248560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-063e9ace-ab5c-4cf2-a123-6fc31d1908d4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.219097 Jul 25 19:42:38.249154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 778/1726] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:38 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:38.254096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ff07ac82-308a-4703-b887-19d332a2bc27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:38.254705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ff07ac82-308a-4703-b887-19d332a2bc27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:38.261291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff07ac82-308a-4703-b887-19d332a2bc27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:38.262421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff07ac82-308a-4703-b887-19d332a2bc27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:38.263445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff07ac82-308a-4703-b887-19d332a2bc27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:38.264116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff07ac82-308a-4703-b887-19d332a2bc27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:38.273814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0d4fbdef-cb1a-4bf1-8015-bb49a46fc43f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091197 Jul 25 19:42:38.274869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 949/1727] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:38 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:38.355234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2287f5d7-3b79-4d8b-9553-076c40a036ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:38.357715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2287f5d7-3b79-4d8b-9553-076c40a036ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:38.366042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ff07ac82-308a-4703-b887-19d332a2bc27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:38.366719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2287f5d7-3b79-4d8b-9553-076c40a036ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:38.367222 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2287f5d7-3b79-4d8b-9553-076c40a036ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:38.368057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2287f5d7-3b79-4d8b-9553-076c40a036ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:38.368513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2287f5d7-3b79-4d8b-9553-076c40a036ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:38.381941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ff07ac82-308a-4703-b887-19d332a2bc27 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.131135 Jul 25 19:42:38.383163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 779/1728] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:38 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:38.438647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2287f5d7-3b79-4d8b-9553-076c40a036ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:38.447266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2287f5d7-3b79-4d8b-9553-076c40a036ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099327 Jul 25 19:42:38.448191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 950/1729] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:39.274594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62bc0755-5a24-4235-ba49-2e7d271975af tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:39.275196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62bc0755-5a24-4235-ba49-2e7d271975af tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:39.283170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62bc0755-5a24-4235-ba49-2e7d271975af tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:39.283666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62bc0755-5a24-4235-ba49-2e7d271975af tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:39.284508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62bc0755-5a24-4235-ba49-2e7d271975af tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:39.284954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62bc0755-5a24-4235-ba49-2e7d271975af tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:39.289203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e7c58c60-ad53-4e9a-a453-f16e48f18a3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:39.292527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e7c58c60-ad53-4e9a-a453-f16e48f18a3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:39.301063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7c58c60-ad53-4e9a-a453-f16e48f18a3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:39.301505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7c58c60-ad53-4e9a-a453-f16e48f18a3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:39.302294 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7c58c60-ad53-4e9a-a453-f16e48f18a3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:39.302729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e7c58c60-ad53-4e9a-a453-f16e48f18a3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:39.337174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e7c58c60-ad53-4e9a-a453-f16e48f18a3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052922 Jul 25 19:42:39.337738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 951/1730] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:39 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:39.418471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-719864c1-0b1c-4f78-8629-37560cee1088 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:39.419092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-719864c1-0b1c-4f78-8629-37560cee1088 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:39.426024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-719864c1-0b1c-4f78-8629-37560cee1088 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:39.426476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-719864c1-0b1c-4f78-8629-37560cee1088 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:39.427288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-719864c1-0b1c-4f78-8629-37560cee1088 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:39.427777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-719864c1-0b1c-4f78-8629-37560cee1088 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:39.470139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62bc0755-5a24-4235-ba49-2e7d271975af tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:39.481167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62bc0755-5a24-4235-ba49-2e7d271975af tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.210232 Jul 25 19:42:39.481886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 780/1731] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:39 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:39.487010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-edee4553-5e1e-4cfe-91c8-bb8498a4d3b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:39.487669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-edee4553-5e1e-4cfe-91c8-bb8498a4d3b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:39.495408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edee4553-5e1e-4cfe-91c8-bb8498a4d3b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:39.499641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edee4553-5e1e-4cfe-91c8-bb8498a4d3b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:39.499641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edee4553-5e1e-4cfe-91c8-bb8498a4d3b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:39.499641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edee4553-5e1e-4cfe-91c8-bb8498a4d3b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:39.537199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-719864c1-0b1c-4f78-8629-37560cee1088 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:39.546805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-719864c1-0b1c-4f78-8629-37560cee1088 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.132420 Jul 25 19:42:39.547426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 952/1732] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:39 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:39.597148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-edee4553-5e1e-4cfe-91c8-bb8498a4d3b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:39.606120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-edee4553-5e1e-4cfe-91c8-bb8498a4d3b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.123123 Jul 25 19:42:39.606740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 781/1733] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:40.351808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-18bd6865-e1f8-403c-9f9c-ac7f34d62256 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:40.354127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-18bd6865-e1f8-403c-9f9c-ac7f34d62256 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:40.363786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18bd6865-e1f8-403c-9f9c-ac7f34d62256 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:40.364292 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18bd6865-e1f8-403c-9f9c-ac7f34d62256 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:40.365274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18bd6865-e1f8-403c-9f9c-ac7f34d62256 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:40.365781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18bd6865-e1f8-403c-9f9c-ac7f34d62256 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:40.420099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-18bd6865-e1f8-403c-9f9c-ac7f34d62256 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072145 Jul 25 19:42:40.421211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 953/1734] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:40 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:40.508583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9de59e0f-be8a-479a-acaa-c90a4df4fbc4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:40.509228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9de59e0f-be8a-479a-acaa-c90a4df4fbc4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:40.518206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9de59e0f-be8a-479a-acaa-c90a4df4fbc4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:40.518747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9de59e0f-be8a-479a-acaa-c90a4df4fbc4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:40.519740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9de59e0f-be8a-479a-acaa-c90a4df4fbc4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:40.520230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9de59e0f-be8a-479a-acaa-c90a4df4fbc4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:40.571202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-abb9917e-fb01-4598-9de5-fd43c04dfb84 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:40.572334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-abb9917e-fb01-4598-9de5-fd43c04dfb84 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:40.584932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-abb9917e-fb01-4598-9de5-fd43c04dfb84 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:40.585961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-abb9917e-fb01-4598-9de5-fd43c04dfb84 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:40.587472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-abb9917e-fb01-4598-9de5-fd43c04dfb84 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:40.588324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-abb9917e-fb01-4598-9de5-fd43c04dfb84 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:40.685306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-abb9917e-fb01-4598-9de5-fd43c04dfb84 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:40.695204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-abb9917e-fb01-4598-9de5-fd43c04dfb84 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.129427 Jul 25 19:42:40.696042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 954/1735] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:40 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:40.702748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5732b184-6d61-4e61-8dc8-3c95308dd932 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:40.703394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5732b184-6d61-4e61-8dc8-3c95308dd932 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:40.710600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5732b184-6d61-4e61-8dc8-3c95308dd932 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:40.711054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5732b184-6d61-4e61-8dc8-3c95308dd932 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:40.711890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5732b184-6d61-4e61-8dc8-3c95308dd932 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:40.713180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5732b184-6d61-4e61-8dc8-3c95308dd932 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:40.734809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9de59e0f-be8a-479a-acaa-c90a4df4fbc4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:40.748352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9de59e0f-be8a-479a-acaa-c90a4df4fbc4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.243455 Jul 25 19:42:40.749412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 782/1736] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:40 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:40.809648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5732b184-6d61-4e61-8dc8-3c95308dd932 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:40.818417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5732b184-6d61-4e61-8dc8-3c95308dd932 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.121164 Jul 25 19:42:40.819011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 955/1737] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:41.437440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-623554f4-21c4-43fc-bcdb-428c630287eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:41.439878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-623554f4-21c4-43fc-bcdb-428c630287eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:41.447125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-623554f4-21c4-43fc-bcdb-428c630287eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:41.447665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-623554f4-21c4-43fc-bcdb-428c630287eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:41.448525 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-623554f4-21c4-43fc-bcdb-428c630287eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:41.449002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-623554f4-21c4-43fc-bcdb-428c630287eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:41.486496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-623554f4-21c4-43fc-bcdb-428c630287eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054564 Jul 25 19:42:41.487089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 783/1738] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:41 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:41.730062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4caf5f9e-c6c5-4002-8f54-7a6f5b7de54f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:41.731614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4caf5f9e-c6c5-4002-8f54-7a6f5b7de54f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:41.738981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4caf5f9e-c6c5-4002-8f54-7a6f5b7de54f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:41.739437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4caf5f9e-c6c5-4002-8f54-7a6f5b7de54f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:41.740284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4caf5f9e-c6c5-4002-8f54-7a6f5b7de54f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:41.740947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4caf5f9e-c6c5-4002-8f54-7a6f5b7de54f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:41.789221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee86ddd8-1d16-4d93-b1f4-47c14dc83af7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:41.790344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee86ddd8-1d16-4d93-b1f4-47c14dc83af7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:41.801865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee86ddd8-1d16-4d93-b1f4-47c14dc83af7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:41.802310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee86ddd8-1d16-4d93-b1f4-47c14dc83af7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:41.803207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee86ddd8-1d16-4d93-b1f4-47c14dc83af7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:41.803685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee86ddd8-1d16-4d93-b1f4-47c14dc83af7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:41.831326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4caf5f9e-c6c5-4002-8f54-7a6f5b7de54f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:41.840982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4caf5f9e-c6c5-4002-8f54-7a6f5b7de54f tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.114227 Jul 25 19:42:41.841751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 956/1739] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:41 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:41.847125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c0d152f1-d5d0-486a-bcdc-a6e1a7f166ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:41.847772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c0d152f1-d5d0-486a-bcdc-a6e1a7f166ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:41.856057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0d152f1-d5d0-486a-bcdc-a6e1a7f166ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:41.856749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0d152f1-d5d0-486a-bcdc-a6e1a7f166ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:41.857840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0d152f1-d5d0-486a-bcdc-a6e1a7f166ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:41.858283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0d152f1-d5d0-486a-bcdc-a6e1a7f166ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:41.985392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c0d152f1-d5d0-486a-bcdc-a6e1a7f166ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:41.994692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c0d152f1-d5d0-486a-bcdc-a6e1a7f166ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.151821 Jul 25 19:42:41.995305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 957/1740] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:42.033900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee86ddd8-1d16-4d93-b1f4-47c14dc83af7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:42.042097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee86ddd8-1d16-4d93-b1f4-47c14dc83af7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.260122 Jul 25 19:42:42.042701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 784/1741] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:41 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:42.499551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cb2d8fac-99f0-4931-8e3b-46276e04471a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:42.501775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cb2d8fac-99f0-4931-8e3b-46276e04471a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:42.508545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb2d8fac-99f0-4931-8e3b-46276e04471a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:42.509022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb2d8fac-99f0-4931-8e3b-46276e04471a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:42.509794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb2d8fac-99f0-4931-8e3b-46276e04471a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:42.510333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb2d8fac-99f0-4931-8e3b-46276e04471a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:42.545438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cb2d8fac-99f0-4931-8e3b-46276e04471a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050572 Jul 25 19:42:42.546038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 958/1742] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:42 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:42.868834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5b561c2f-c989-4cac-9495-9adc8c2845a8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:42.869444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5b561c2f-c989-4cac-9495-9adc8c2845a8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:42.877697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b561c2f-c989-4cac-9495-9adc8c2845a8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:42.878303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b561c2f-c989-4cac-9495-9adc8c2845a8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:42.879143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b561c2f-c989-4cac-9495-9adc8c2845a8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:42.879681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b561c2f-c989-4cac-9495-9adc8c2845a8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:42.913367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:42:42.915492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:42:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b (ip 10.222.0.18) !!! Jul 25 19:42:42.962505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5b561c2f-c989-4cac-9495-9adc8c2845a8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:42.971126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5b561c2f-c989-4cac-9495-9adc8c2845a8 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.106449 Jul 25 19:42:42.971740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 785/1743] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:42 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:43.029750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-897fceec-cfe7-4a38-b94c-12b1a58895ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:43.030478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-897fceec-cfe7-4a38-b94c-12b1a58895ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:43.037549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-897fceec-cfe7-4a38-b94c-12b1a58895ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:43.037991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-897fceec-cfe7-4a38-b94c-12b1a58895ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:43.038775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-897fceec-cfe7-4a38-b94c-12b1a58895ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:43.039207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-897fceec-cfe7-4a38-b94c-12b1a58895ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:43.070728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-27224758-ed4e-44ab-87bc-9631ce9d8700 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:43.071821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-27224758-ed4e-44ab-87bc-9631ce9d8700 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:43.083912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27224758-ed4e-44ab-87bc-9631ce9d8700 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:43.084696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27224758-ed4e-44ab-87bc-9631ce9d8700 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:43.086099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27224758-ed4e-44ab-87bc-9631ce9d8700 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:43.086876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27224758-ed4e-44ab-87bc-9631ce9d8700 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:43.110919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-897fceec-cfe7-4a38-b94c-12b1a58895ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:43.119845 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-897fceec-cfe7-4a38-b94c-12b1a58895ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095085 Jul 25 19:42:43.120363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 959/1744] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:43.274790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-27224758-ed4e-44ab-87bc-9631ce9d8700 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:43.284359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-27224758-ed4e-44ab-87bc-9631ce9d8700 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.220832 Jul 25 19:42:43.284950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 786/1745] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:43 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:43.560011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d11094a7-8e95-435f-94b4-354a97ab29ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:43.562345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d11094a7-8e95-435f-94b4-354a97ab29ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:43.569012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d11094a7-8e95-435f-94b4-354a97ab29ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:43.569452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d11094a7-8e95-435f-94b4-354a97ab29ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:43.570264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d11094a7-8e95-435f-94b4-354a97ab29ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:43.570709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d11094a7-8e95-435f-94b4-354a97ab29ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:43.619544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d11094a7-8e95-435f-94b4-354a97ab29ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064682 Jul 25 19:42:43.620526 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 960/1746] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:43 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:43.994231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-88f9ae5b-dc4c-4e6a-8a67-19658ca70533 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:43.995028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-88f9ae5b-dc4c-4e6a-8a67-19658ca70533 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:44.003544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88f9ae5b-dc4c-4e6a-8a67-19658ca70533 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:44.003996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88f9ae5b-dc4c-4e6a-8a67-19658ca70533 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:44.004770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88f9ae5b-dc4c-4e6a-8a67-19658ca70533 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:44.005199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88f9ae5b-dc4c-4e6a-8a67-19658ca70533 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:44.087798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-88f9ae5b-dc4c-4e6a-8a67-19658ca70533 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:44.100975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-88f9ae5b-dc4c-4e6a-8a67-19658ca70533 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.110645 Jul 25 19:42:44.101610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 787/1747] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:43 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:44.149176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-674f64ee-73c4-48eb-883c-06326fa9be0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:44.150462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-674f64ee-73c4-48eb-883c-06326fa9be0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:44.162602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-674f64ee-73c4-48eb-883c-06326fa9be0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:44.163268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-674f64ee-73c4-48eb-883c-06326fa9be0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:44.164605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-674f64ee-73c4-48eb-883c-06326fa9be0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:44.165357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-674f64ee-73c4-48eb-883c-06326fa9be0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:44.240726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-674f64ee-73c4-48eb-883c-06326fa9be0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:44.252309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-674f64ee-73c4-48eb-883c-06326fa9be0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.111938 Jul 25 19:42:44.252855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 961/1748] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:44.320593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-12eadbdf-c178-461a-baef-c1b8dac97426 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:44.321574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-12eadbdf-c178-461a-baef-c1b8dac97426 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:44.330215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12eadbdf-c178-461a-baef-c1b8dac97426 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:44.330846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12eadbdf-c178-461a-baef-c1b8dac97426 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:44.332180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12eadbdf-c178-461a-baef-c1b8dac97426 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:44.332900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12eadbdf-c178-461a-baef-c1b8dac97426 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:44.489937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-12eadbdf-c178-461a-baef-c1b8dac97426 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:44.500957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-12eadbdf-c178-461a-baef-c1b8dac97426 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.184328 Jul 25 19:42:44.501971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 788/1749] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:44 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:44.637903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-de21003b-4d81-4694-9809-7e24dca09f49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:44.642372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-de21003b-4d81-4694-9809-7e24dca09f49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:44.654450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de21003b-4d81-4694-9809-7e24dca09f49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:44.655186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de21003b-4d81-4694-9809-7e24dca09f49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:44.656661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de21003b-4d81-4694-9809-7e24dca09f49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:44.657640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de21003b-4d81-4694-9809-7e24dca09f49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:44.698913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-de21003b-4d81-4694-9809-7e24dca09f49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068798 Jul 25 19:42:44.701020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 962/1750] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:44 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:45.124839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f8a848e3-c3f9-4efe-aaa7-4958753f1e11 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:45.125480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f8a848e3-c3f9-4efe-aaa7-4958753f1e11 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:45.133407 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8a848e3-c3f9-4efe-aaa7-4958753f1e11 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:45.133893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8a848e3-c3f9-4efe-aaa7-4958753f1e11 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:45.134673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8a848e3-c3f9-4efe-aaa7-4958753f1e11 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:45.135145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8a848e3-c3f9-4efe-aaa7-4958753f1e11 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:45.209380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f8a848e3-c3f9-4efe-aaa7-4958753f1e11 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:45.218423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f8a848e3-c3f9-4efe-aaa7-4958753f1e11 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.098102 Jul 25 19:42:45.219015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 789/1751] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:45 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:45.278285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dacfc93a-972e-4edc-80a1-23e019e15225 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:45.279363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dacfc93a-972e-4edc-80a1-23e019e15225 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:45.291208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dacfc93a-972e-4edc-80a1-23e019e15225 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:45.292023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dacfc93a-972e-4edc-80a1-23e019e15225 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:45.293947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dacfc93a-972e-4edc-80a1-23e019e15225 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:45.294729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dacfc93a-972e-4edc-80a1-23e019e15225 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:45.302946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:45.394501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-dacfc93a-972e-4edc-80a1-23e019e15225 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:45.403841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dacfc93a-972e-4edc-80a1-23e019e15225 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.132742 Jul 25 19:42:45.404433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 963/1752] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:45.525420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-146106eb-01e5-4bf4-a20c-ac8809083aa6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:45.526180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-146106eb-01e5-4bf4-a20c-ac8809083aa6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:45.534414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-146106eb-01e5-4bf4-a20c-ac8809083aa6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:45.534912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-146106eb-01e5-4bf4-a20c-ac8809083aa6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:45.535770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-146106eb-01e5-4bf4-a20c-ac8809083aa6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:45.536244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-146106eb-01e5-4bf4-a20c-ac8809083aa6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:45.704257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-146106eb-01e5-4bf4-a20c-ac8809083aa6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:45.714106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-146106eb-01e5-4bf4-a20c-ac8809083aa6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.192457 Jul 25 19:42:45.714453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-46357f18-c417-433d-812e-bfec8c7e4808 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:45.714827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 790/1753] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:45 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:45.717260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-46357f18-c417-433d-812e-bfec8c7e4808 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:45.724506 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46357f18-c417-433d-812e-bfec8c7e4808 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:45.724957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46357f18-c417-433d-812e-bfec8c7e4808 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:45.725842 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46357f18-c417-433d-812e-bfec8c7e4808 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:45.726311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46357f18-c417-433d-812e-bfec8c7e4808 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:45.773135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-46357f18-c417-433d-812e-bfec8c7e4808 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063583 Jul 25 19:42:45.773793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 964/1754] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:45 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:46.252518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-863426c9-5be3-41d0-b1f8-64beea4439f4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:46.253337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-863426c9-5be3-41d0-b1f8-64beea4439f4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:46.260440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-863426c9-5be3-41d0-b1f8-64beea4439f4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:46.261383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-863426c9-5be3-41d0-b1f8-64beea4439f4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:46.262296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-863426c9-5be3-41d0-b1f8-64beea4439f4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:46.263033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-863426c9-5be3-41d0-b1f8-64beea4439f4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:46.336405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-863426c9-5be3-41d0-b1f8-64beea4439f4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:46.346657 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-863426c9-5be3-41d0-b1f8-64beea4439f4 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.098022 Jul 25 19:42:46.347483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 791/1755] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:46 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:46.424332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-78b74d3a-5a92-4461-9726-b60909582c96 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:46.425384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-78b74d3a-5a92-4461-9726-b60909582c96 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:46.432400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78b74d3a-5a92-4461-9726-b60909582c96 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:46.434391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78b74d3a-5a92-4461-9726-b60909582c96 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:46.435723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78b74d3a-5a92-4461-9726-b60909582c96 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:46.436273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78b74d3a-5a92-4461-9726-b60909582c96 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:46.508179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78b74d3a-5a92-4461-9726-b60909582c96 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:46.518509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-78b74d3a-5a92-4461-9726-b60909582c96 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.098143 Jul 25 19:42:46.519172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 965/1756] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:46.738199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc0f51ed-f939-48fa-a40f-49ea86241720 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:46.738917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc0f51ed-f939-48fa-a40f-49ea86241720 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:46.745567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc0f51ed-f939-48fa-a40f-49ea86241720 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:46.746280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc0f51ed-f939-48fa-a40f-49ea86241720 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:46.747431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc0f51ed-f939-48fa-a40f-49ea86241720 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:46.747917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc0f51ed-f939-48fa-a40f-49ea86241720 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:46.770677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:46.791228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-00ee4eed-e784-4d0f-894e-beea9f5bd552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:46.795915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-00ee4eed-e784-4d0f-894e-beea9f5bd552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:46.807051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00ee4eed-e784-4d0f-894e-beea9f5bd552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:46.808507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00ee4eed-e784-4d0f-894e-beea9f5bd552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:46.810436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00ee4eed-e784-4d0f-894e-beea9f5bd552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:46.811019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00ee4eed-e784-4d0f-894e-beea9f5bd552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:46.869388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-00ee4eed-e784-4d0f-894e-beea9f5bd552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085099 Jul 25 19:42:46.870436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 966/1757] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:46 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:46.910888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc0f51ed-f939-48fa-a40f-49ea86241720 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:46.919003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc0f51ed-f939-48fa-a40f-49ea86241720 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.185478 Jul 25 19:42:46.919622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 792/1758] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:46 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:47.370837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-54a288d5-b09b-4182-b248-32e29e8e9d8e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:47.371458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-54a288d5-b09b-4182-b248-32e29e8e9d8e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:47.378542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54a288d5-b09b-4182-b248-32e29e8e9d8e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:47.378991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54a288d5-b09b-4182-b248-32e29e8e9d8e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:47.379826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54a288d5-b09b-4182-b248-32e29e8e9d8e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:47.380270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54a288d5-b09b-4182-b248-32e29e8e9d8e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:47.453568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-54a288d5-b09b-4182-b248-32e29e8e9d8e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:47.462134 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-54a288d5-b09b-4182-b248-32e29e8e9d8e tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.095194 Jul 25 19:42:47.462882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 967/1759] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:47 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:47.541623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee22f74c-8e66-4b59-aa3c-83f712c51994 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:47.542258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee22f74c-8e66-4b59-aa3c-83f712c51994 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:47.550377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee22f74c-8e66-4b59-aa3c-83f712c51994 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:47.550830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee22f74c-8e66-4b59-aa3c-83f712c51994 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:47.551657 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee22f74c-8e66-4b59-aa3c-83f712c51994 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:47.552106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee22f74c-8e66-4b59-aa3c-83f712c51994 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:47.633903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee22f74c-8e66-4b59-aa3c-83f712c51994 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:47.648988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee22f74c-8e66-4b59-aa3c-83f712c51994 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.111056 Jul 25 19:42:47.649936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 793/1760] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:47.885938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-02ef6f29-366d-4410-b7dd-4af82a3f201d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:47.889229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-02ef6f29-366d-4410-b7dd-4af82a3f201d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:47.896928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02ef6f29-366d-4410-b7dd-4af82a3f201d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:47.897374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02ef6f29-366d-4410-b7dd-4af82a3f201d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:47.898169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02ef6f29-366d-4410-b7dd-4af82a3f201d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:47.898630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-02ef6f29-366d-4410-b7dd-4af82a3f201d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:47.932574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-02ef6f29-366d-4410-b7dd-4af82a3f201d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050627 Jul 25 19:42:47.933161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 968/1761] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:47 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:47.952640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50ef6379-679c-4a3a-84d5-56ac0dcf5344 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:47.953250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50ef6379-679c-4a3a-84d5-56ac0dcf5344 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:47.960097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50ef6379-679c-4a3a-84d5-56ac0dcf5344 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:47.960538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50ef6379-679c-4a3a-84d5-56ac0dcf5344 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:47.961329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50ef6379-679c-4a3a-84d5-56ac0dcf5344 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:47.961765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50ef6379-679c-4a3a-84d5-56ac0dcf5344 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:48.115960 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-50ef6379-679c-4a3a-84d5-56ac0dcf5344 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:48.125260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50ef6379-679c-4a3a-84d5-56ac0dcf5344 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.177298 Jul 25 19:42:48.125850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 794/1762] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:47 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:48.498409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bb4267c9-7c6c-4ade-955a-852039c48107 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:48.499088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bb4267c9-7c6c-4ade-955a-852039c48107 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:48.506145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb4267c9-7c6c-4ade-955a-852039c48107 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:48.506676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb4267c9-7c6c-4ade-955a-852039c48107 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:48.507573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb4267c9-7c6c-4ade-955a-852039c48107 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:48.508110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb4267c9-7c6c-4ade-955a-852039c48107 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:48.579135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bb4267c9-7c6c-4ade-955a-852039c48107 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:48.587803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bb4267c9-7c6c-4ade-955a-852039c48107 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.094347 Jul 25 19:42:48.588496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 969/1763] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:48 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:48.682880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48a6b85a-b14b-4eb3-86c7-199d33b8f055 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:48.684252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48a6b85a-b14b-4eb3-86c7-199d33b8f055 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:48.691401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48a6b85a-b14b-4eb3-86c7-199d33b8f055 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:48.692003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48a6b85a-b14b-4eb3-86c7-199d33b8f055 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:48.692835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48a6b85a-b14b-4eb3-86c7-199d33b8f055 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:48.693314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48a6b85a-b14b-4eb3-86c7-199d33b8f055 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:48.791480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48a6b85a-b14b-4eb3-86c7-199d33b8f055 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:48.807193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48a6b85a-b14b-4eb3-86c7-199d33b8f055 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.128303 Jul 25 19:42:48.808363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 795/1764] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:48.946445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-59d99138-2289-4540-80b3-807c7b89cf8c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:48.948714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-59d99138-2289-4540-80b3-807c7b89cf8c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:48.957507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59d99138-2289-4540-80b3-807c7b89cf8c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:48.957950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59d99138-2289-4540-80b3-807c7b89cf8c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:48.958740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59d99138-2289-4540-80b3-807c7b89cf8c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:48.959174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59d99138-2289-4540-80b3-807c7b89cf8c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:49.001748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-59d99138-2289-4540-80b3-807c7b89cf8c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059555 Jul 25 19:42:49.002345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 970/1765] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:48 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:49.148186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d659681b-cf9b-43a3-b1b8-df7e6937bbe7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:49.148857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d659681b-cf9b-43a3-b1b8-df7e6937bbe7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:49.158981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d659681b-cf9b-43a3-b1b8-df7e6937bbe7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:49.159827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d659681b-cf9b-43a3-b1b8-df7e6937bbe7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:49.161225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d659681b-cf9b-43a3-b1b8-df7e6937bbe7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:49.162026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d659681b-cf9b-43a3-b1b8-df7e6937bbe7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:49.338914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d659681b-cf9b-43a3-b1b8-df7e6937bbe7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:49.350447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d659681b-cf9b-43a3-b1b8-df7e6937bbe7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.206131 Jul 25 19:42:49.351048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 796/1766] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:49 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:49.611977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-48519b8f-af57-481e-a332-73b703511124 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:49.612856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-48519b8f-af57-481e-a332-73b703511124 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:49.619347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48519b8f-af57-481e-a332-73b703511124 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:49.619828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48519b8f-af57-481e-a332-73b703511124 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:49.620613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48519b8f-af57-481e-a332-73b703511124 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:49.621851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48519b8f-af57-481e-a332-73b703511124 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:49.690893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-48519b8f-af57-481e-a332-73b703511124 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:49.700116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-48519b8f-af57-481e-a332-73b703511124 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.092773 Jul 25 19:42:49.700682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 971/1767] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:49 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:49.830915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0dbacbf9-f2e7-4844-b897-5d4a7a95793b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:49.831605 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0dbacbf9-f2e7-4844-b897-5d4a7a95793b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:49.838778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0dbacbf9-f2e7-4844-b897-5d4a7a95793b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:49.839231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0dbacbf9-f2e7-4844-b897-5d4a7a95793b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:49.840851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0dbacbf9-f2e7-4844-b897-5d4a7a95793b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:49.841576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0dbacbf9-f2e7-4844-b897-5d4a7a95793b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:49.915494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0dbacbf9-f2e7-4844-b897-5d4a7a95793b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:49.925297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0dbacbf9-f2e7-4844-b897-5d4a7a95793b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.098408 Jul 25 19:42:49.925896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 797/1768] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:50.016510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9da7050e-6660-44b9-83db-661a0c75d572 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:50.018899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9da7050e-6660-44b9-83db-661a0c75d572 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:50.027569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9da7050e-6660-44b9-83db-661a0c75d572 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:50.028187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9da7050e-6660-44b9-83db-661a0c75d572 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:50.029040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9da7050e-6660-44b9-83db-661a0c75d572 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:50.029487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9da7050e-6660-44b9-83db-661a0c75d572 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:50.069083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9da7050e-6660-44b9-83db-661a0c75d572 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057472 Jul 25 19:42:50.069680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 972/1769] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:50 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:50.378265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c09a2bb4-c0b7-4a78-bcab-2bf2c1bcfdbf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:50.379056 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c09a2bb4-c0b7-4a78-bcab-2bf2c1bcfdbf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:50.385624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c09a2bb4-c0b7-4a78-bcab-2bf2c1bcfdbf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:50.386069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c09a2bb4-c0b7-4a78-bcab-2bf2c1bcfdbf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:50.387832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c09a2bb4-c0b7-4a78-bcab-2bf2c1bcfdbf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:50.388277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c09a2bb4-c0b7-4a78-bcab-2bf2c1bcfdbf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:50.553364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c09a2bb4-c0b7-4a78-bcab-2bf2c1bcfdbf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:50.563253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c09a2bb4-c0b7-4a78-bcab-2bf2c1bcfdbf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1450 microversion: 2.1 time: 0.188998 Jul 25 19:42:50.563888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 798/1770] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:50 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:50.727924 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b7821d3f-a12b-4546-bf9a-140d9378e773 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:50.728986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b7821d3f-a12b-4546-bf9a-140d9378e773 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:50.740576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7821d3f-a12b-4546-bf9a-140d9378e773 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:50.741715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7821d3f-a12b-4546-bf9a-140d9378e773 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:50.743121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7821d3f-a12b-4546-bf9a-140d9378e773 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:50.743903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7821d3f-a12b-4546-bf9a-140d9378e773 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:50.826108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b7821d3f-a12b-4546-bf9a-140d9378e773 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:50.834740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b7821d3f-a12b-4546-bf9a-140d9378e773 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1330 microversion: 2.1 time: 0.114414 Jul 25 19:42:50.835348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 973/1771] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:50 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:50.947971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-54f9b4d5-6ab5-43ef-93ea-761c227f3aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:50.948591 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-54f9b4d5-6ab5-43ef-93ea-761c227f3aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:50.957121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54f9b4d5-6ab5-43ef-93ea-761c227f3aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:50.957599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54f9b4d5-6ab5-43ef-93ea-761c227f3aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:50.958428 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54f9b4d5-6ab5-43ef-93ea-761c227f3aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:50.958865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54f9b4d5-6ab5-43ef-93ea-761c227f3aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:51.055939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-54f9b4d5-6ab5-43ef-93ea-761c227f3aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:51.064955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-54f9b4d5-6ab5-43ef-93ea-761c227f3aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.121262 Jul 25 19:42:51.065560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 799/1772] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:51.084221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bb04a392-2fe6-4b33-8ad3-a3baf2ec0cda tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:51.086739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bb04a392-2fe6-4b33-8ad3-a3baf2ec0cda tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:51.103478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb04a392-2fe6-4b33-8ad3-a3baf2ec0cda tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:51.104235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb04a392-2fe6-4b33-8ad3-a3baf2ec0cda tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:51.106365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb04a392-2fe6-4b33-8ad3-a3baf2ec0cda tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:51.107073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb04a392-2fe6-4b33-8ad3-a3baf2ec0cda tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:51.146871 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bb04a392-2fe6-4b33-8ad3-a3baf2ec0cda tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067599 Jul 25 19:42:51.148094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 974/1773] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:51 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:51.586002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3851c1b6-caad-414f-8d9e-d65be4a0b983 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:51.586713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3851c1b6-caad-414f-8d9e-d65be4a0b983 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:51.594904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3851c1b6-caad-414f-8d9e-d65be4a0b983 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:51.595363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3851c1b6-caad-414f-8d9e-d65be4a0b983 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:51.596234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3851c1b6-caad-414f-8d9e-d65be4a0b983 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:51.596689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3851c1b6-caad-414f-8d9e-d65be4a0b983 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:51.862490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:51.863427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 6d2db0a6-d453-4feb-b067-466e50a5f44b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:51.880744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:51.882916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:51.885162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:51.886194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:51.954550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:51.955390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:51.956989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lazy-loading 'fault' on Instance uuid 6d2db0a6-d453-4feb-b067-466e50a5f44b {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:42:52.040008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:52.048541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8f5177df-c2fe-4419-b48f-0a16d552232b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b" status: 200 len: 1424 microversion: 2.1 time: 0.195959 Jul 25 19:42:52.049616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 975/1774] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:51 2022] GET /compute/v2.1/servers/6d2db0a6-d453-4feb-b067-466e50a5f44b => generated 1424 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:52.077753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9953030a-201d-442b-80ff-06bf28b03203 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '.version_select at 0x7feb0c4c8a60>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:52.086492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9953030a-201d-442b-80ff-06bf28b03203 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [58f6d6f4-8897-45f9-9690-b5f67a6ccb75] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 19:42:52.091401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3851c1b6-caad-414f-8d9e-d65be4a0b983 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:52.103076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3851c1b6-caad-414f-8d9e-d65be4a0b983 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1444 microversion: 2.1 time: 0.521007 Jul 25 19:42:52.103926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 800/1775] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:51 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1444 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:52.109627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c78af49f-0398-4508-b0be-cb79c3568de5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:52.110240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c78af49f-0398-4508-b0be-cb79c3568de5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:52.117102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c78af49f-0398-4508-b0be-cb79c3568de5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:52.117550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c78af49f-0398-4508-b0be-cb79c3568de5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:52.119054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c78af49f-0398-4508-b0be-cb79c3568de5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:52.119542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c78af49f-0398-4508-b0be-cb79c3568de5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:52.218522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c78af49f-0398-4508-b0be-cb79c3568de5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:52.227611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c78af49f-0398-4508-b0be-cb79c3568de5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.122639 Jul 25 19:42:52.228207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 801/1776] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:52 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:52.234077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc13fa4e-5957-4545-8a49-04a7f3b19e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:52.236565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc13fa4e-5957-4545-8a49-04a7f3b19e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:52.243328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc13fa4e-5957-4545-8a49-04a7f3b19e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:52.244106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc13fa4e-5957-4545-8a49-04a7f3b19e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:52.245173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc13fa4e-5957-4545-8a49-04a7f3b19e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:52.245622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc13fa4e-5957-4545-8a49-04a7f3b19e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:52.282387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc13fa4e-5957-4545-8a49-04a7f3b19e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053075 Jul 25 19:42:52.283385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 802/1777] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:52.420942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-6e7d168d-74d3-49df-b175-591c97e82fec req-48ff7c37-870d-4f78-8ce3-6e270f28ff11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44f6c42-c9a6-4a85-8776-d2f694f0ac8e", "name": "network-vif-deleted", "tag": "7198e141-c0f4-476e-81a3-f0ece4990c63"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:42:52.439237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-6e7d168d-74d3-49df-b175-591c97e82fec req-48ff7c37-870d-4f78-8ce3-6e270f28ff11 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:52.440239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-6e7d168d-74d3-49df-b175-591c97e82fec req-48ff7c37-870d-4f78-8ce3-6e270f28ff11 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:52.469579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-6e7d168d-74d3-49df-b175-591c97e82fec req-48ff7c37-870d-4f78-8ce3-6e270f28ff11 service nova] Creating event network-vif-deleted:7198e141-c0f4-476e-81a3-f0ece4990c63 for instance a44f6c42-c9a6-4a85-8776-d2f694f0ac8e on hv-cinder-85093 Jul 25 19:42:52.477643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-6e7d168d-74d3-49df-b175-591c97e82fec req-48ff7c37-870d-4f78-8ce3-6e270f28ff11 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060695 Jul 25 19:42:52.478399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 803/1778] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:53.095398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [None req-9953030a-201d-442b-80ff-06bf28b03203 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [58f6d6f4-8897-45f9-9690-b5f67a6ccb75] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38770. Jul 25 19:42:53.119751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9953030a-201d-442b-80ff-06bf28b03203 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-616138224" status: 202 len: 0 microversion: 2.1 time: 1.051749 Jul 25 19:42:53.120459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 976/1779] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Jul 25 19:42:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-616138224 => generated 0 bytes in 1054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:42:53.140268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6299dd4d-d157-4658-bd53-e6d6b78ce1d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:53.141603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6299dd4d-d157-4658-bd53-e6d6b78ce1d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:53.155501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6299dd4d-d157-4658-bd53-e6d6b78ce1d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:53.156598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6299dd4d-d157-4658-bd53-e6d6b78ce1d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:53.157961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6299dd4d-d157-4658-bd53-e6d6b78ce1d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:53.158766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6299dd4d-d157-4658-bd53-e6d6b78ce1d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:53.254356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a291af42-7105-427a-988d-51efb254a13f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:53.255580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a291af42-7105-427a-988d-51efb254a13f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:53.255886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6299dd4d-d157-4658-bd53-e6d6b78ce1d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:53.274003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a291af42-7105-427a-988d-51efb254a13f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:53.275081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a291af42-7105-427a-988d-51efb254a13f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:53.277555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a291af42-7105-427a-988d-51efb254a13f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:53.278639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6299dd4d-d157-4658-bd53-e6d6b78ce1d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.146382 Jul 25 19:42:53.279982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 804/1780] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:53 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:53.280673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a291af42-7105-427a-988d-51efb254a13f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:53.302363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4f9f73b1-fd32-4a00-8f15-ec942acd81f7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:53.306200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4f9f73b1-fd32-4a00-8f15-ec942acd81f7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:53.317615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f9f73b1-fd32-4a00-8f15-ec942acd81f7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:53.318414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f9f73b1-fd32-4a00-8f15-ec942acd81f7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:53.319495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f9f73b1-fd32-4a00-8f15-ec942acd81f7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:53.320266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f9f73b1-fd32-4a00-8f15-ec942acd81f7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:53.374201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4f9f73b1-fd32-4a00-8f15-ec942acd81f7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080852 Jul 25 19:42:53.374802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 805/1781] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:53 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:53.382887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a291af42-7105-427a-988d-51efb254a13f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:53.393347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a291af42-7105-427a-988d-51efb254a13f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.144313 Jul 25 19:42:53.395592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 977/1782] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:54.312394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-30c2d9fa-4fc3-4150-84d6-9c3b97645f8a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:54.313161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-30c2d9fa-4fc3-4150-84d6-9c3b97645f8a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:54.320740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30c2d9fa-4fc3-4150-84d6-9c3b97645f8a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:54.321245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30c2d9fa-4fc3-4150-84d6-9c3b97645f8a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:54.322037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30c2d9fa-4fc3-4150-84d6-9c3b97645f8a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:54.322479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30c2d9fa-4fc3-4150-84d6-9c3b97645f8a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:54.390614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fb307d90-00a3-4112-bfa6-0493f5cb19fd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:54.394057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fb307d90-00a3-4112-bfa6-0493f5cb19fd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:54.396615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-30c2d9fa-4fc3-4150-84d6-9c3b97645f8a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:54.405151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fb307d90-00a3-4112-bfa6-0493f5cb19fd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:54.405928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fb307d90-00a3-4112-bfa6-0493f5cb19fd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:54.407245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fb307d90-00a3-4112-bfa6-0493f5cb19fd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:54.407978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fb307d90-00a3-4112-bfa6-0493f5cb19fd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:54.409677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-30c2d9fa-4fc3-4150-84d6-9c3b97645f8a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.101651 Jul 25 19:42:54.410774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 806/1783] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:54 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:54.418839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f36ddd81-0bb3-4bcc-b777-f9c3e1cc96f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:54.419537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f36ddd81-0bb3-4bcc-b777-f9c3e1cc96f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:54.432961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36ddd81-0bb3-4bcc-b777-f9c3e1cc96f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:54.434467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36ddd81-0bb3-4bcc-b777-f9c3e1cc96f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:54.435397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36ddd81-0bb3-4bcc-b777-f9c3e1cc96f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:54.436143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36ddd81-0bb3-4bcc-b777-f9c3e1cc96f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:54.472888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fb307d90-00a3-4112-bfa6-0493f5cb19fd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089425 Jul 25 19:42:54.474122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 978/1784] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:54 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:54.541703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f36ddd81-0bb3-4bcc-b777-f9c3e1cc96f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:54.551725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f36ddd81-0bb3-4bcc-b777-f9c3e1cc96f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.139715 Jul 25 19:42:54.552335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 807/1785] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:55.444507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-70170a7d-d20e-443a-8b6a-de01702fe140 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:55.445216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-70170a7d-d20e-443a-8b6a-de01702fe140 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:55.452053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70170a7d-d20e-443a-8b6a-de01702fe140 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:55.452510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70170a7d-d20e-443a-8b6a-de01702fe140 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:55.453300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70170a7d-d20e-443a-8b6a-de01702fe140 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:55.453744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70170a7d-d20e-443a-8b6a-de01702fe140 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:55.489737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8a379b19-57fd-4bf5-8de7-18e72f09451a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:55.492895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8a379b19-57fd-4bf5-8de7-18e72f09451a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:55.501010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a379b19-57fd-4bf5-8de7-18e72f09451a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:55.501580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a379b19-57fd-4bf5-8de7-18e72f09451a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:55.502478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a379b19-57fd-4bf5-8de7-18e72f09451a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:55.502988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a379b19-57fd-4bf5-8de7-18e72f09451a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:55.529981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-70170a7d-d20e-443a-8b6a-de01702fe140 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:55.538433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-70170a7d-d20e-443a-8b6a-de01702fe140 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.097869 Jul 25 19:42:55.539372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 979/1786] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:55 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:55.548327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8a379b19-57fd-4bf5-8de7-18e72f09451a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062141 Jul 25 19:42:55.549320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 808/1787] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:55 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:55.575271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-54d31f96-9a59-4b07-9fe2-e9db1a304562 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:55.576084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-54d31f96-9a59-4b07-9fe2-e9db1a304562 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:55.582888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54d31f96-9a59-4b07-9fe2-e9db1a304562 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:55.583380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54d31f96-9a59-4b07-9fe2-e9db1a304562 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:55.584268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54d31f96-9a59-4b07-9fe2-e9db1a304562 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:55.584742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54d31f96-9a59-4b07-9fe2-e9db1a304562 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:55.606938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:55.665997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-54d31f96-9a59-4b07-9fe2-e9db1a304562 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:55.675489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-54d31f96-9a59-4b07-9fe2-e9db1a304562 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.105223 Jul 25 19:42:55.676293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 980/1788] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:56.561978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-58f1c779-89f7-42e0-8da2-08685630eba2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:56.563173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-58f1c779-89f7-42e0-8da2-08685630eba2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:56.564518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f2a31d08-87fa-486d-acb4-8eae8b094cc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:56.567137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f2a31d08-87fa-486d-acb4-8eae8b094cc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:56.572582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58f1c779-89f7-42e0-8da2-08685630eba2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:56.573512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58f1c779-89f7-42e0-8da2-08685630eba2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:56.575458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58f1c779-89f7-42e0-8da2-08685630eba2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:56.576390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58f1c779-89f7-42e0-8da2-08685630eba2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:56.576638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2a31d08-87fa-486d-acb4-8eae8b094cc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:56.576903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2a31d08-87fa-486d-acb4-8eae8b094cc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:56.578431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2a31d08-87fa-486d-acb4-8eae8b094cc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:56.578876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2a31d08-87fa-486d-acb4-8eae8b094cc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:56.627276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f2a31d08-87fa-486d-acb4-8eae8b094cc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067647 Jul 25 19:42:56.627918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 981/1789] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:56 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:42:56.655492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-58f1c779-89f7-42e0-8da2-08685630eba2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:56.660000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:42:56.665977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-58f1c779-89f7-42e0-8da2-08685630eba2 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.109038 Jul 25 19:42:56.666580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 809/1790] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:56 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:56.702111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-30f34047-528d-475b-9deb-b1edacdc467f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:56.702805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-30f34047-528d-475b-9deb-b1edacdc467f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:56.709500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-30f34047-528d-475b-9deb-b1edacdc467f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:56.710636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-30f34047-528d-475b-9deb-b1edacdc467f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:56.711103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-30f34047-528d-475b-9deb-b1edacdc467f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:56.711428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-30f34047-528d-475b-9deb-b1edacdc467f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:56.780545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-30f34047-528d-475b-9deb-b1edacdc467f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:56.789219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-30f34047-528d-475b-9deb-b1edacdc467f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095043 Jul 25 19:42:56.789904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 982/1791] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:57.643084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b7fde52-5aae-424c-9f4a-2fe0497cbd41 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:57.645502 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2b7fde52-5aae-424c-9f4a-2fe0497cbd41 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:57.653787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b7fde52-5aae-424c-9f4a-2fe0497cbd41 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:57.654239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b7fde52-5aae-424c-9f4a-2fe0497cbd41 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:57.655036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b7fde52-5aae-424c-9f4a-2fe0497cbd41 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:57.655477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b7fde52-5aae-424c-9f4a-2fe0497cbd41 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:57.689289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-de9a09e8-f3f6-4100-95eb-a9b8dfff73b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:57.690173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-de9a09e8-f3f6-4100-95eb-a9b8dfff73b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:57.690399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2b7fde52-5aae-424c-9f4a-2fe0497cbd41 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051564 Jul 25 19:42:57.691026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 810/1792] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:57 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:57.698313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de9a09e8-f3f6-4100-95eb-a9b8dfff73b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:57.698987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de9a09e8-f3f6-4100-95eb-a9b8dfff73b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:57.700041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de9a09e8-f3f6-4100-95eb-a9b8dfff73b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:57.700519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de9a09e8-f3f6-4100-95eb-a9b8dfff73b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:57.773629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-de9a09e8-f3f6-4100-95eb-a9b8dfff73b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:57.783501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-de9a09e8-f3f6-4100-95eb-a9b8dfff73b1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.098799 Jul 25 19:42:57.784304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 983/1793] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:57 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:57.813386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-587999b0-bfc1-4d36-abc1-4812ea47e786 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:57.814064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-587999b0-bfc1-4d36-abc1-4812ea47e786 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:57.821242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-587999b0-bfc1-4d36-abc1-4812ea47e786 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:57.821733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-587999b0-bfc1-4d36-abc1-4812ea47e786 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:57.822586 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-587999b0-bfc1-4d36-abc1-4812ea47e786 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:57.823083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-587999b0-bfc1-4d36-abc1-4812ea47e786 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:57.894018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-587999b0-bfc1-4d36-abc1-4812ea47e786 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:57.903989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-587999b0-bfc1-4d36-abc1-4812ea47e786 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094709 Jul 25 19:42:57.904593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 811/1794] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:58.704843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-37aaede9-d616-40ce-a7bd-9366e8451e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:58.707062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-37aaede9-d616-40ce-a7bd-9366e8451e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:58.715458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37aaede9-d616-40ce-a7bd-9366e8451e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:58.716245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37aaede9-d616-40ce-a7bd-9366e8451e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:58.718300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37aaede9-d616-40ce-a7bd-9366e8451e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:58.719372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37aaede9-d616-40ce-a7bd-9366e8451e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:58.779298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-37aaede9-d616-40ce-a7bd-9366e8451e11 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078454 Jul 25 19:42:58.780326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 984/1795] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:58 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:58.807068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f36f68cd-9089-4329-8e9a-d732f5e1cd7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:58.808231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f36f68cd-9089-4329-8e9a-d732f5e1cd7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:58.816486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36f68cd-9089-4329-8e9a-d732f5e1cd7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:58.816967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36f68cd-9089-4329-8e9a-d732f5e1cd7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:58.817751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36f68cd-9089-4329-8e9a-d732f5e1cd7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:58.818186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36f68cd-9089-4329-8e9a-d732f5e1cd7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:58.893698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f36f68cd-9089-4329-8e9a-d732f5e1cd7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:58.903091 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f36f68cd-9089-4329-8e9a-d732f5e1cd7f tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.099287 Jul 25 19:42:58.903751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 812/1796] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:58 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:42:58.926824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ac62b414-b7bc-48fd-9edc-ef7429134c8f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:58.927770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ac62b414-b7bc-48fd-9edc-ef7429134c8f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:58.935441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac62b414-b7bc-48fd-9edc-ef7429134c8f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:58.936275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac62b414-b7bc-48fd-9edc-ef7429134c8f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:58.937135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac62b414-b7bc-48fd-9edc-ef7429134c8f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:58.937681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac62b414-b7bc-48fd-9edc-ef7429134c8f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:59.009614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ac62b414-b7bc-48fd-9edc-ef7429134c8f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:42:59.018816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ac62b414-b7bc-48fd-9edc-ef7429134c8f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.096098 Jul 25 19:42:59.019427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 985/1797] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:42:59.798936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2cdeb880-5bc4-4887-b3c6-befac1ee6a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:59.801691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2cdeb880-5bc4-4887-b3c6-befac1ee6a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:59.808973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cdeb880-5bc4-4887-b3c6-befac1ee6a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:59.810073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cdeb880-5bc4-4887-b3c6-befac1ee6a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:59.810413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cdeb880-5bc4-4887-b3c6-befac1ee6a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:59.810947 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cdeb880-5bc4-4887-b3c6-befac1ee6a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:59.854624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2cdeb880-5bc4-4887-b3c6-befac1ee6a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062984 Jul 25 19:42:59.855647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 813/1798] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:42:59 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:42:59.925181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dc47106f-609c-4183-a90e-b778efa08c66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:42:59.926053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dc47106f-609c-4183-a90e-b778efa08c66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:42:59.935645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc47106f-609c-4183-a90e-b778efa08c66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:59.936224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc47106f-609c-4183-a90e-b778efa08c66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:42:59.937170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc47106f-609c-4183-a90e-b778efa08c66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:42:59.937735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc47106f-609c-4183-a90e-b778efa08c66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:00.037773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-dc47106f-609c-4183-a90e-b778efa08c66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:00.046774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dc47106f-609c-4183-a90e-b778efa08c66 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.125538 Jul 25 19:43:00.047556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 986/1799] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:42:59 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:00.056624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0a3146fb-cf66-460e-90d7-12c520b5fd9e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:00.057673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0a3146fb-cf66-460e-90d7-12c520b5fd9e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:00.069840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a3146fb-cf66-460e-90d7-12c520b5fd9e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:00.070585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a3146fb-cf66-460e-90d7-12c520b5fd9e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:00.072041 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a3146fb-cf66-460e-90d7-12c520b5fd9e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:00.072541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a3146fb-cf66-460e-90d7-12c520b5fd9e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:00.145089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0a3146fb-cf66-460e-90d7-12c520b5fd9e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:00.154465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0a3146fb-cf66-460e-90d7-12c520b5fd9e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.104797 Jul 25 19:43:00.155125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 814/1800] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:00.871669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aaf785b6-15b6-443e-9ca9-8d13f2cf4ae4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:00.874595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aaf785b6-15b6-443e-9ca9-8d13f2cf4ae4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:00.881796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aaf785b6-15b6-443e-9ca9-8d13f2cf4ae4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:00.882286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aaf785b6-15b6-443e-9ca9-8d13f2cf4ae4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:00.883103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aaf785b6-15b6-443e-9ca9-8d13f2cf4ae4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:00.883698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aaf785b6-15b6-443e-9ca9-8d13f2cf4ae4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:00.920271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aaf785b6-15b6-443e-9ca9-8d13f2cf4ae4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053237 Jul 25 19:43:00.920886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 987/1801] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:00 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:01.096031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-482f48cc-2de0-438e-aa17-d0c45a52bdef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:01.097366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-482f48cc-2de0-438e-aa17-d0c45a52bdef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:01.105836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482f48cc-2de0-438e-aa17-d0c45a52bdef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:01.106289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482f48cc-2de0-438e-aa17-d0c45a52bdef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:01.107084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482f48cc-2de0-438e-aa17-d0c45a52bdef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:01.107575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482f48cc-2de0-438e-aa17-d0c45a52bdef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:01.180301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-482f48cc-2de0-438e-aa17-d0c45a52bdef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:01.191729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-482f48cc-2de0-438e-aa17-d0c45a52bdef tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.105348 Jul 25 19:43:01.192762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 815/1802] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:01 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:01.199348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-64cd4a20-8df2-46d7-a999-33022cb01f2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:01.200730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-64cd4a20-8df2-46d7-a999-33022cb01f2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:01.213742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64cd4a20-8df2-46d7-a999-33022cb01f2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:01.215051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64cd4a20-8df2-46d7-a999-33022cb01f2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:01.216533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64cd4a20-8df2-46d7-a999-33022cb01f2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:01.217311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64cd4a20-8df2-46d7-a999-33022cb01f2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:01.290185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-64cd4a20-8df2-46d7-a999-33022cb01f2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:01.299810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-64cd4a20-8df2-46d7-a999-33022cb01f2f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.108019 Jul 25 19:43:01.300408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 988/1803] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:01.935702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2eee422-ac15-4784-b97d-eca70bf6fc60 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:01.938777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c2eee422-ac15-4784-b97d-eca70bf6fc60 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:01.947052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2eee422-ac15-4784-b97d-eca70bf6fc60 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:01.947623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2eee422-ac15-4784-b97d-eca70bf6fc60 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:01.948570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2eee422-ac15-4784-b97d-eca70bf6fc60 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:01.949777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2eee422-ac15-4784-b97d-eca70bf6fc60 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:01.985725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2eee422-ac15-4784-b97d-eca70bf6fc60 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056054 Jul 25 19:43:01.986479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 816/1804] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:01 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:02.227875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9024aeb7-8a01-4553-8b22-d89cb1c349d0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:02.228891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9024aeb7-8a01-4553-8b22-d89cb1c349d0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:02.238003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9024aeb7-8a01-4553-8b22-d89cb1c349d0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:02.238593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9024aeb7-8a01-4553-8b22-d89cb1c349d0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:02.239486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9024aeb7-8a01-4553-8b22-d89cb1c349d0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:02.240062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9024aeb7-8a01-4553-8b22-d89cb1c349d0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:02.321895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9024aeb7-8a01-4553-8b22-d89cb1c349d0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:02.326550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-367044b8-e0a7-4fa1-8133-17772866c761 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:02.327599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-367044b8-e0a7-4fa1-8133-17772866c761 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:02.332424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9024aeb7-8a01-4553-8b22-d89cb1c349d0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.108871 Jul 25 19:43:02.333001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 989/1805] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:02 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:02.336853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-367044b8-e0a7-4fa1-8133-17772866c761 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:02.337647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-367044b8-e0a7-4fa1-8133-17772866c761 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:02.339155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-367044b8-e0a7-4fa1-8133-17772866c761 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:02.340897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-367044b8-e0a7-4fa1-8133-17772866c761 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:02.423841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-367044b8-e0a7-4fa1-8133-17772866c761 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:02.440724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-367044b8-e0a7-4fa1-8133-17772866c761 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.121015 Jul 25 19:43:02.441713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 817/1806] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:02.999935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6445f9dd-2a27-4ff9-a10e-d66cebc64e13 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:03.002551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6445f9dd-2a27-4ff9-a10e-d66cebc64e13 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:03.009477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6445f9dd-2a27-4ff9-a10e-d66cebc64e13 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:03.009920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6445f9dd-2a27-4ff9-a10e-d66cebc64e13 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:03.010697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6445f9dd-2a27-4ff9-a10e-d66cebc64e13 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:03.011159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6445f9dd-2a27-4ff9-a10e-d66cebc64e13 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:03.045864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6445f9dd-2a27-4ff9-a10e-d66cebc64e13 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050993 Jul 25 19:43:03.046461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 990/1807] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:02 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:03.367350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ca284d8-e0d2-4b54-9938-0717e23861ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:03.368094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ca284d8-e0d2-4b54-9938-0717e23861ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:03.378003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca284d8-e0d2-4b54-9938-0717e23861ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:03.378505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca284d8-e0d2-4b54-9938-0717e23861ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:03.379446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca284d8-e0d2-4b54-9938-0717e23861ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:03.379956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca284d8-e0d2-4b54-9938-0717e23861ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:03.469937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-134a6a49-1012-4222-b32e-a42703288ee9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:03.470962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-134a6a49-1012-4222-b32e-a42703288ee9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:03.478887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ca284d8-e0d2-4b54-9938-0717e23861ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:03.479332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-134a6a49-1012-4222-b32e-a42703288ee9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:03.479820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-134a6a49-1012-4222-b32e-a42703288ee9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:03.480635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-134a6a49-1012-4222-b32e-a42703288ee9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:03.481067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-134a6a49-1012-4222-b32e-a42703288ee9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:03.492646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ca284d8-e0d2-4b54-9938-0717e23861ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.129008 Jul 25 19:43:03.493681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 818/1808] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:03 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:03.563403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-134a6a49-1012-4222-b32e-a42703288ee9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:03.576345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-134a6a49-1012-4222-b32e-a42703288ee9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.111840 Jul 25 19:43:03.576951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 991/1809] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:03 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:04.060323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fe152674-09ec-4ab7-b142-a8c16cf54e6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:04.062767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fe152674-09ec-4ab7-b142-a8c16cf54e6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:04.069240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe152674-09ec-4ab7-b142-a8c16cf54e6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:04.069680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe152674-09ec-4ab7-b142-a8c16cf54e6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:04.070465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe152674-09ec-4ab7-b142-a8c16cf54e6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:04.070896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe152674-09ec-4ab7-b142-a8c16cf54e6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:04.110168 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fe152674-09ec-4ab7-b142-a8c16cf54e6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054888 Jul 25 19:43:04.111308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 819/1810] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:04 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:04.518048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2e3404ea-0b23-4294-9ba0-d930b86f93ce tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:04.518687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2e3404ea-0b23-4294-9ba0-d930b86f93ce tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:04.526306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e3404ea-0b23-4294-9ba0-d930b86f93ce tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:04.526916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e3404ea-0b23-4294-9ba0-d930b86f93ce tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:04.528051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e3404ea-0b23-4294-9ba0-d930b86f93ce tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:04.528515 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e3404ea-0b23-4294-9ba0-d930b86f93ce tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:04.598521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-861e93be-7ac4-4ebf-8594-52d1007b4022 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:04.599426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-861e93be-7ac4-4ebf-8594-52d1007b4022 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:04.604501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2e3404ea-0b23-4294-9ba0-d930b86f93ce tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:04.608348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-861e93be-7ac4-4ebf-8594-52d1007b4022 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:04.608799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-861e93be-7ac4-4ebf-8594-52d1007b4022 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:04.609852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-861e93be-7ac4-4ebf-8594-52d1007b4022 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:04.610581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-861e93be-7ac4-4ebf-8594-52d1007b4022 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:04.619718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2e3404ea-0b23-4294-9ba0-d930b86f93ce tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.105332 Jul 25 19:43:04.621499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 992/1811] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:04 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:04.682026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-861e93be-7ac4-4ebf-8594-52d1007b4022 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:04.697211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-861e93be-7ac4-4ebf-8594-52d1007b4022 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.103518 Jul 25 19:43:04.698220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 820/1812] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:05.124328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-32957ecd-8357-4390-9b79-6c9dfb246604 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:05.126563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-32957ecd-8357-4390-9b79-6c9dfb246604 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:05.131898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:05.134357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32957ecd-8357-4390-9b79-6c9dfb246604 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:05.134812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32957ecd-8357-4390-9b79-6c9dfb246604 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:05.135648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32957ecd-8357-4390-9b79-6c9dfb246604 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:05.136095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32957ecd-8357-4390-9b79-6c9dfb246604 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:05.185626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-32957ecd-8357-4390-9b79-6c9dfb246604 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066108 Jul 25 19:43:05.186268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 993/1813] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:05 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:05.655693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a78c47e3-9567-45fd-b1b3-313456a9b8bd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:05.656572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a78c47e3-9567-45fd-b1b3-313456a9b8bd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:05.659093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=93 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:05.665468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a78c47e3-9567-45fd-b1b3-313456a9b8bd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:05.665921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a78c47e3-9567-45fd-b1b3-313456a9b8bd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:05.666723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a78c47e3-9567-45fd-b1b3-313456a9b8bd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:05.667160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a78c47e3-9567-45fd-b1b3-313456a9b8bd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:05.733032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b66c3f66-b3ed-420f-8dfd-86686b5b723e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:05.734350 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b66c3f66-b3ed-420f-8dfd-86686b5b723e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:05.741762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a78c47e3-9567-45fd-b1b3-313456a9b8bd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:05.742922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b66c3f66-b3ed-420f-8dfd-86686b5b723e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:05.743551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b66c3f66-b3ed-420f-8dfd-86686b5b723e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:05.744501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b66c3f66-b3ed-420f-8dfd-86686b5b723e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:05.745373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b66c3f66-b3ed-420f-8dfd-86686b5b723e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:05.756780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a78c47e3-9567-45fd-b1b3-313456a9b8bd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.105736 Jul 25 19:43:05.757978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 821/1814] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:05 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:05.817235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b66c3f66-b3ed-420f-8dfd-86686b5b723e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:05.826406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b66c3f66-b3ed-420f-8dfd-86686b5b723e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.098114 Jul 25 19:43:05.827014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 994/1815] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:06.202374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb957ba9-13f4-4d9d-a86e-a76710a7e976 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:06.204688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb957ba9-13f4-4d9d-a86e-a76710a7e976 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:06.211604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb957ba9-13f4-4d9d-a86e-a76710a7e976 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:06.212215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb957ba9-13f4-4d9d-a86e-a76710a7e976 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:06.213012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb957ba9-13f4-4d9d-a86e-a76710a7e976 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:06.213465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb957ba9-13f4-4d9d-a86e-a76710a7e976 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:06.251951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb957ba9-13f4-4d9d-a86e-a76710a7e976 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054418 Jul 25 19:43:06.252565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 822/1816] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:06 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:06.791925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6cec4f25-af98-45fe-9690-d1634535dbb8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:06.793315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6cec4f25-af98-45fe-9690-d1634535dbb8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:06.801250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6cec4f25-af98-45fe-9690-d1634535dbb8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:06.801775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6cec4f25-af98-45fe-9690-d1634535dbb8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:06.802733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6cec4f25-af98-45fe-9690-d1634535dbb8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:06.803376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6cec4f25-af98-45fe-9690-d1634535dbb8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:06.848706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e81fbb97-7ff0-4715-8225-e885aea18f45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:06.849429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e81fbb97-7ff0-4715-8225-e885aea18f45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:06.857726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e81fbb97-7ff0-4715-8225-e885aea18f45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:06.858318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e81fbb97-7ff0-4715-8225-e885aea18f45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:06.859479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e81fbb97-7ff0-4715-8225-e885aea18f45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:06.860044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e81fbb97-7ff0-4715-8225-e885aea18f45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:06.881255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6cec4f25-af98-45fe-9690-d1634535dbb8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:06.895793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6cec4f25-af98-45fe-9690-d1634535dbb8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.107466 Jul 25 19:43:06.896795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 995/1817] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:06 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:06.934835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e81fbb97-7ff0-4715-8225-e885aea18f45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:06.943931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e81fbb97-7ff0-4715-8225-e885aea18f45 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099260 Jul 25 19:43:06.944551 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 823/1818] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:07.268007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-74078de5-6c8d-4b94-be86-4ace25b31525 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:07.270313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-74078de5-6c8d-4b94-be86-4ace25b31525 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:07.278887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74078de5-6c8d-4b94-be86-4ace25b31525 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:07.279387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74078de5-6c8d-4b94-be86-4ace25b31525 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:07.280426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74078de5-6c8d-4b94-be86-4ace25b31525 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:07.280909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74078de5-6c8d-4b94-be86-4ace25b31525 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:07.316344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-74078de5-6c8d-4b94-be86-4ace25b31525 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056282 Jul 25 19:43:07.316941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 996/1819] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:07 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:07.930571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a70034f0-5daf-4b1c-9184-bfed949dbc54 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:07.931217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a70034f0-5daf-4b1c-9184-bfed949dbc54 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:07.939356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a70034f0-5daf-4b1c-9184-bfed949dbc54 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:07.939837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a70034f0-5daf-4b1c-9184-bfed949dbc54 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:07.940615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a70034f0-5daf-4b1c-9184-bfed949dbc54 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:07.941045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a70034f0-5daf-4b1c-9184-bfed949dbc54 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:07.968915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-852b0fd0-c4f3-4a57-bc07-eb417fbc3928 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:07.969949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-852b0fd0-c4f3-4a57-bc07-eb417fbc3928 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:07.979437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-852b0fd0-c4f3-4a57-bc07-eb417fbc3928 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:07.980146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-852b0fd0-c4f3-4a57-bc07-eb417fbc3928 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:07.981543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-852b0fd0-c4f3-4a57-bc07-eb417fbc3928 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:07.982112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-852b0fd0-c4f3-4a57-bc07-eb417fbc3928 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:07.987869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:08.019684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a70034f0-5daf-4b1c-9184-bfed949dbc54 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:08.034001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a70034f0-5daf-4b1c-9184-bfed949dbc54 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.106771 Jul 25 19:43:08.035147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 824/1820] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:07 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:08.069472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-852b0fd0-c4f3-4a57-bc07-eb417fbc3928 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:08.079379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-852b0fd0-c4f3-4a57-bc07-eb417fbc3928 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.116810 Jul 25 19:43:08.080049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 997/1821] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:08.563085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-127a6d44-a0f5-4046-9bfd-78ebdc2fbc73 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:08.565818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-127a6d44-a0f5-4046-9bfd-78ebdc2fbc73 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:08.572801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-127a6d44-a0f5-4046-9bfd-78ebdc2fbc73 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:08.573244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-127a6d44-a0f5-4046-9bfd-78ebdc2fbc73 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:08.574117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-127a6d44-a0f5-4046-9bfd-78ebdc2fbc73 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:08.574553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-127a6d44-a0f5-4046-9bfd-78ebdc2fbc73 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:08.610990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-127a6d44-a0f5-4046-9bfd-78ebdc2fbc73 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.281964 Jul 25 19:43:08.611547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 825/1822] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:08 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:09.065354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-46ac7471-e723-4ad1-9f5f-b871b63727b4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:09.066088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-46ac7471-e723-4ad1-9f5f-b871b63727b4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:09.074012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46ac7471-e723-4ad1-9f5f-b871b63727b4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:09.074616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46ac7471-e723-4ad1-9f5f-b871b63727b4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:09.075809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46ac7471-e723-4ad1-9f5f-b871b63727b4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:09.076442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-46ac7471-e723-4ad1-9f5f-b871b63727b4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:09.102338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4898676e-5b00-4e57-af89-e381bcd4a619 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:09.103241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4898676e-5b00-4e57-af89-e381bcd4a619 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:09.114960 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4898676e-5b00-4e57-af89-e381bcd4a619 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:09.115405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4898676e-5b00-4e57-af89-e381bcd4a619 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:09.116256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4898676e-5b00-4e57-af89-e381bcd4a619 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:09.116726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4898676e-5b00-4e57-af89-e381bcd4a619 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:09.140351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:09.153479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-46ac7471-e723-4ad1-9f5f-b871b63727b4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:09.173703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-46ac7471-e723-4ad1-9f5f-b871b63727b4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.112007 Jul 25 19:43:09.175241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 998/1823] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:09 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:09.192059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4898676e-5b00-4e57-af89-e381bcd4a619 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:09.201435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4898676e-5b00-4e57-af89-e381bcd4a619 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.103225 Jul 25 19:43:09.202031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 826/1824] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:09.624568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c195bdaf-81ea-45c0-8d5e-d60532aedbc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:09.626878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c195bdaf-81ea-45c0-8d5e-d60532aedbc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:09.633702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c195bdaf-81ea-45c0-8d5e-d60532aedbc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:09.634146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c195bdaf-81ea-45c0-8d5e-d60532aedbc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:09.634943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c195bdaf-81ea-45c0-8d5e-d60532aedbc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:09.635387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c195bdaf-81ea-45c0-8d5e-d60532aedbc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:09.681723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c195bdaf-81ea-45c0-8d5e-d60532aedbc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061457 Jul 25 19:43:09.682657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 999/1825] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:09 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:10.211006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-194dba58-27d6-479b-85f9-2b40fc868604 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:10.211687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-194dba58-27d6-479b-85f9-2b40fc868604 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:10.221204 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-194dba58-27d6-479b-85f9-2b40fc868604 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:10.221658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-194dba58-27d6-479b-85f9-2b40fc868604 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:10.222767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-194dba58-27d6-479b-85f9-2b40fc868604 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:10.223247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-194dba58-27d6-479b-85f9-2b40fc868604 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:10.224135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c7e71ffc-8b49-4208-ba2d-9540b2ddc569 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:10.225211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c7e71ffc-8b49-4208-ba2d-9540b2ddc569 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:10.239348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c7e71ffc-8b49-4208-ba2d-9540b2ddc569 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:10.240171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c7e71ffc-8b49-4208-ba2d-9540b2ddc569 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:10.241516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c7e71ffc-8b49-4208-ba2d-9540b2ddc569 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:10.242250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c7e71ffc-8b49-4208-ba2d-9540b2ddc569 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:10.320023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-194dba58-27d6-479b-85f9-2b40fc868604 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:10.336922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-194dba58-27d6-479b-85f9-2b40fc868604 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.129762 Jul 25 19:43:10.338026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 827/1826] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:10 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:10.354479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c7e71ffc-8b49-4208-ba2d-9540b2ddc569 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:10.366128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c7e71ffc-8b49-4208-ba2d-9540b2ddc569 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.147104 Jul 25 19:43:10.366763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1000/1827] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:10.696539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0552d2b-e1e5-448f-b49a-2a922c2dada7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:10.698836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0552d2b-e1e5-448f-b49a-2a922c2dada7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:10.705558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0552d2b-e1e5-448f-b49a-2a922c2dada7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:10.706771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0552d2b-e1e5-448f-b49a-2a922c2dada7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:10.707738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0552d2b-e1e5-448f-b49a-2a922c2dada7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:10.708190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0552d2b-e1e5-448f-b49a-2a922c2dada7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:10.742015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0552d2b-e1e5-448f-b49a-2a922c2dada7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049695 Jul 25 19:43:10.742628 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 828/1828] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:10 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:11.368946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d8ee1417-35e5-4ecc-a946-d4b7034f79d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:11.369611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d8ee1417-35e5-4ecc-a946-d4b7034f79d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:11.377663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8ee1417-35e5-4ecc-a946-d4b7034f79d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:11.378106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8ee1417-35e5-4ecc-a946-d4b7034f79d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:11.378925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8ee1417-35e5-4ecc-a946-d4b7034f79d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:11.379363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8ee1417-35e5-4ecc-a946-d4b7034f79d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:11.392223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66d60efa-0d56-454e-87ef-e3a71bea991b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:11.393097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66d60efa-0d56-454e-87ef-e3a71bea991b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:11.406186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66d60efa-0d56-454e-87ef-e3a71bea991b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:11.406972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66d60efa-0d56-454e-87ef-e3a71bea991b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:11.408411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66d60efa-0d56-454e-87ef-e3a71bea991b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:11.409204 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66d60efa-0d56-454e-87ef-e3a71bea991b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:11.465548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d8ee1417-35e5-4ecc-a946-d4b7034f79d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:11.477946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d8ee1417-35e5-4ecc-a946-d4b7034f79d5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.113110 Jul 25 19:43:11.478830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1001/1829] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:11 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:11.497654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66d60efa-0d56-454e-87ef-e3a71bea991b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:11.506503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66d60efa-0d56-454e-87ef-e3a71bea991b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.118843 Jul 25 19:43:11.507163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 829/1830] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:11 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:11.755559 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a65b154f-2c74-47b1-a645-3b802221177e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:11.757698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a65b154f-2c74-47b1-a645-3b802221177e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:11.764602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a65b154f-2c74-47b1-a645-3b802221177e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:11.765060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a65b154f-2c74-47b1-a645-3b802221177e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:11.765841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a65b154f-2c74-47b1-a645-3b802221177e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:11.766290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a65b154f-2c74-47b1-a645-3b802221177e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:11.798972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a65b154f-2c74-47b1-a645-3b802221177e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047410 Jul 25 19:43:11.799579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1002/1831] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:11 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:12.508043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0cb45dd7-0eef-4364-8957-e3be2df90e6c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:12.508684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0cb45dd7-0eef-4364-8957-e3be2df90e6c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:12.518306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb45dd7-0eef-4364-8957-e3be2df90e6c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:12.519083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb45dd7-0eef-4364-8957-e3be2df90e6c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:12.520509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb45dd7-0eef-4364-8957-e3be2df90e6c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:12.521541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb45dd7-0eef-4364-8957-e3be2df90e6c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:12.528280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-47ca661d-2fdb-455c-911d-1db92a79b9a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:12.529147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-47ca661d-2fdb-455c-911d-1db92a79b9a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:12.535793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47ca661d-2fdb-455c-911d-1db92a79b9a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:12.536269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47ca661d-2fdb-455c-911d-1db92a79b9a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:12.537053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47ca661d-2fdb-455c-911d-1db92a79b9a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:12.537487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47ca661d-2fdb-455c-911d-1db92a79b9a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:12.662276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-47ca661d-2fdb-455c-911d-1db92a79b9a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:12.665440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cb45dd7-0eef-4364-8957-e3be2df90e6c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:12.672596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-47ca661d-2fdb-455c-911d-1db92a79b9a1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.149514 Jul 25 19:43:12.673083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1003/1832] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:12.678247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0cb45dd7-0eef-4364-8957-e3be2df90e6c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.173651 Jul 25 19:43:12.679275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 830/1833] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:12 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:12.814905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c0a06a9a-ae06-4313-9b3f-bbf320c02c9b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:12.817160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c0a06a9a-ae06-4313-9b3f-bbf320c02c9b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:12.824759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0a06a9a-ae06-4313-9b3f-bbf320c02c9b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:12.825295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0a06a9a-ae06-4313-9b3f-bbf320c02c9b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:12.826116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0a06a9a-ae06-4313-9b3f-bbf320c02c9b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:12.826793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0a06a9a-ae06-4313-9b3f-bbf320c02c9b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:12.864386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c0a06a9a-ae06-4313-9b3f-bbf320c02c9b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054940 Jul 25 19:43:12.864985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1004/1834] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:12 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:13.699379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9b6006ca-021b-4e81-8008-5da6ca366519 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:13.700449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9b6006ca-021b-4e81-8008-5da6ca366519 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:13.702644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1786b570-9667-4a88-9f3a-465d057d8511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:13.703297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1786b570-9667-4a88-9f3a-465d057d8511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:13.711355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b6006ca-021b-4e81-8008-5da6ca366519 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:13.712284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b6006ca-021b-4e81-8008-5da6ca366519 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:13.713579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b6006ca-021b-4e81-8008-5da6ca366519 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:13.713732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1786b570-9667-4a88-9f3a-465d057d8511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:13.714957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b6006ca-021b-4e81-8008-5da6ca366519 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:13.715224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1786b570-9667-4a88-9f3a-465d057d8511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:13.716656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1786b570-9667-4a88-9f3a-465d057d8511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:13.717427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1786b570-9667-4a88-9f3a-465d057d8511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:13.819629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9b6006ca-021b-4e81-8008-5da6ca366519 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:13.828890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9b6006ca-021b-4e81-8008-5da6ca366519 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.137016 Jul 25 19:43:13.829486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 831/1835] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:13.836459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1786b570-9667-4a88-9f3a-465d057d8511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:13.846712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1786b570-9667-4a88-9f3a-465d057d8511 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.149502 Jul 25 19:43:13.847309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1005/1836] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:13 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:13.878186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7a591b94-8e62-448d-befe-afbda2c927a5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:13.880491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7a591b94-8e62-448d-befe-afbda2c927a5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:13.888240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a591b94-8e62-448d-befe-afbda2c927a5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:13.888685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a591b94-8e62-448d-befe-afbda2c927a5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:13.889455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a591b94-8e62-448d-befe-afbda2c927a5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:13.889886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a591b94-8e62-448d-befe-afbda2c927a5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:13.923809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7a591b94-8e62-448d-befe-afbda2c927a5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049354 Jul 25 19:43:13.924365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 832/1837] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:13 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:14.852138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-49ca727b-36a0-42d4-89b5-0d9237a785df tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:14.852782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-49ca727b-36a0-42d4-89b5-0d9237a785df tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:14.861109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49ca727b-36a0-42d4-89b5-0d9237a785df tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:14.861691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49ca727b-36a0-42d4-89b5-0d9237a785df tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:14.862797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49ca727b-36a0-42d4-89b5-0d9237a785df tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:14.863374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49ca727b-36a0-42d4-89b5-0d9237a785df tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:14.870072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c5622faa-d201-4cee-8c9f-4d994662a735 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:14.871645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c5622faa-d201-4cee-8c9f-4d994662a735 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:14.879438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5622faa-d201-4cee-8c9f-4d994662a735 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:14.879991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5622faa-d201-4cee-8c9f-4d994662a735 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:14.880864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5622faa-d201-4cee-8c9f-4d994662a735 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:14.881554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5622faa-d201-4cee-8c9f-4d994662a735 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:14.968476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-49ca727b-36a0-42d4-89b5-0d9237a785df tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:14.977946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-49ca727b-36a0-42d4-89b5-0d9237a785df tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.129664 Jul 25 19:43:14.978772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1006/1838] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:14 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:14.986331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c9963844-a975-4cb5-81d7-b54b1125cc3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:14.987409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c5622faa-d201-4cee-8c9f-4d994662a735 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:14.988579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c9963844-a975-4cb5-81d7-b54b1125cc3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:14.995004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9963844-a975-4cb5-81d7-b54b1125cc3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:14.996383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9963844-a975-4cb5-81d7-b54b1125cc3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:14.997324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9963844-a975-4cb5-81d7-b54b1125cc3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:14.997721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9963844-a975-4cb5-81d7-b54b1125cc3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:14.999990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c5622faa-d201-4cee-8c9f-4d994662a735 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.134556 Jul 25 19:43:15.001044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 833/1839] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:14 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:15.039472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c9963844-a975-4cb5-81d7-b54b1125cc3e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059427 Jul 25 19:43:15.040087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1007/1840] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:14 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:16.013828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ed46293e-084f-463e-a7ca-44d402c7c193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:16.014435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ed46293e-084f-463e-a7ca-44d402c7c193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:16.021801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed46293e-084f-463e-a7ca-44d402c7c193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:16.022245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed46293e-084f-463e-a7ca-44d402c7c193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:16.023019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed46293e-084f-463e-a7ca-44d402c7c193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:16.023456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed46293e-084f-463e-a7ca-44d402c7c193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:16.031095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ccf68bdb-b49e-4b2d-9526-7d735a7c4781 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:16.032238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ccf68bdb-b49e-4b2d-9526-7d735a7c4781 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:16.045759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf68bdb-b49e-4b2d-9526-7d735a7c4781 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:16.046559 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf68bdb-b49e-4b2d-9526-7d735a7c4781 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:16.048120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf68bdb-b49e-4b2d-9526-7d735a7c4781 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:16.049018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf68bdb-b49e-4b2d-9526-7d735a7c4781 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:16.097852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ed46293e-084f-463e-a7ca-44d402c7c193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:16.110203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ed46293e-084f-463e-a7ca-44d402c7c193 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.100960 Jul 25 19:43:16.111093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 834/1841] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:16.121396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c86fec5b-13f2-4a57-94ab-492e64d613bb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:16.126715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c86fec5b-13f2-4a57-94ab-492e64d613bb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:16.131356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ccf68bdb-b49e-4b2d-9526-7d735a7c4781 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:16.138247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c86fec5b-13f2-4a57-94ab-492e64d613bb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:16.138735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c86fec5b-13f2-4a57-94ab-492e64d613bb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:16.139671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c86fec5b-13f2-4a57-94ab-492e64d613bb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:16.140259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c86fec5b-13f2-4a57-94ab-492e64d613bb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:16.146033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ccf68bdb-b49e-4b2d-9526-7d735a7c4781 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.123406 Jul 25 19:43:16.147117 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1008/1842] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:16 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:16.188222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c86fec5b-13f2-4a57-94ab-492e64d613bb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075656 Jul 25 19:43:16.188858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 835/1843] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:16 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:17.144537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a7f9adfe-bcb9-47d3-b0c0-2e64e6449fb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:17.145276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a7f9adfe-bcb9-47d3-b0c0-2e64e6449fb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:17.153948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7f9adfe-bcb9-47d3-b0c0-2e64e6449fb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:17.154662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7f9adfe-bcb9-47d3-b0c0-2e64e6449fb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:17.155193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7f9adfe-bcb9-47d3-b0c0-2e64e6449fb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:17.155660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7f9adfe-bcb9-47d3-b0c0-2e64e6449fb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:17.185255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ef48ae47-9b2c-4a21-b2dc-51133b2039d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:17.186297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ef48ae47-9b2c-4a21-b2dc-51133b2039d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:17.193951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef48ae47-9b2c-4a21-b2dc-51133b2039d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:17.194410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef48ae47-9b2c-4a21-b2dc-51133b2039d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:17.195198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef48ae47-9b2c-4a21-b2dc-51133b2039d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:17.195995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef48ae47-9b2c-4a21-b2dc-51133b2039d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:17.252191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a7f9adfe-bcb9-47d3-b0c0-2e64e6449fb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:17.268073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a7f9adfe-bcb9-47d3-b0c0-2e64e6449fb8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.127443 Jul 25 19:43:17.268910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1009/1844] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:17.275264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8fc2fe48-ccb2-4924-ae29-2c3f7ddd9b75 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:17.279870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8fc2fe48-ccb2-4924-ae29-2c3f7ddd9b75 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:17.288533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fc2fe48-ccb2-4924-ae29-2c3f7ddd9b75 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:17.289344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fc2fe48-ccb2-4924-ae29-2c3f7ddd9b75 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:17.290943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fc2fe48-ccb2-4924-ae29-2c3f7ddd9b75 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:17.291334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8fc2fe48-ccb2-4924-ae29-2c3f7ddd9b75 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:17.296215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ef48ae47-9b2c-4a21-b2dc-51133b2039d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:17.308088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ef48ae47-9b2c-4a21-b2dc-51133b2039d7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.129773 Jul 25 19:43:17.309160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 836/1845] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:17 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:17.334788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8fc2fe48-ccb2-4924-ae29-2c3f7ddd9b75 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064219 Jul 25 19:43:17.335402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1010/1846] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:17 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:18.302306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-07d245b9-a167-4123-8853-16b3911fbaf8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:18.303190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-07d245b9-a167-4123-8853-16b3911fbaf8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:18.310878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07d245b9-a167-4123-8853-16b3911fbaf8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:18.311322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07d245b9-a167-4123-8853-16b3911fbaf8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:18.312253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07d245b9-a167-4123-8853-16b3911fbaf8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:18.312686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07d245b9-a167-4123-8853-16b3911fbaf8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:18.332917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1e04c660-87fa-4895-8b9a-96a49d4806d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:18.334196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1e04c660-87fa-4895-8b9a-96a49d4806d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:18.344092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e04c660-87fa-4895-8b9a-96a49d4806d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:18.344870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e04c660-87fa-4895-8b9a-96a49d4806d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:18.345941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e04c660-87fa-4895-8b9a-96a49d4806d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:18.346568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e04c660-87fa-4895-8b9a-96a49d4806d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:18.410724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07d245b9-a167-4123-8853-16b3911fbaf8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:18.420183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-07d245b9-a167-4123-8853-16b3911fbaf8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.121819 Jul 25 19:43:18.420696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 837/1847] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:18.427165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d06a28b4-9dcd-4555-aea9-693ff4f425c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:18.427980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d06a28b4-9dcd-4555-aea9-693ff4f425c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:18.435275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d06a28b4-9dcd-4555-aea9-693ff4f425c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:18.435781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d06a28b4-9dcd-4555-aea9-693ff4f425c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:18.436579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d06a28b4-9dcd-4555-aea9-693ff4f425c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:18.437021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d06a28b4-9dcd-4555-aea9-693ff4f425c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:18.466325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1e04c660-87fa-4895-8b9a-96a49d4806d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:18.475392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1e04c660-87fa-4895-8b9a-96a49d4806d8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.146738 Jul 25 19:43:18.476012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1011/1848] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:18 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:18.476806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d06a28b4-9dcd-4555-aea9-693ff4f425c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054661 Jul 25 19:43:18.477827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 838/1849] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:18 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:19.446981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a7478772-b912-4ee3-8c94-3b3216ca23bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:19.447664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a7478772-b912-4ee3-8c94-3b3216ca23bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:19.456884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7478772-b912-4ee3-8c94-3b3216ca23bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:19.457333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7478772-b912-4ee3-8c94-3b3216ca23bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:19.458143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7478772-b912-4ee3-8c94-3b3216ca23bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:19.458574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7478772-b912-4ee3-8c94-3b3216ca23bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:19.491394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-090583ad-3b1f-4d8e-b512-600ecdc667d7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:19.494791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-090583ad-3b1f-4d8e-b512-600ecdc667d7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:19.502427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-090583ad-3b1f-4d8e-b512-600ecdc667d7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:19.502873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-090583ad-3b1f-4d8e-b512-600ecdc667d7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:19.503685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-090583ad-3b1f-4d8e-b512-600ecdc667d7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:19.504116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-090583ad-3b1f-4d8e-b512-600ecdc667d7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:19.525850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a7478772-b912-4ee3-8c94-3b3216ca23bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:19.535271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a7478772-b912-4ee3-8c94-3b3216ca23bf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092159 Jul 25 19:43:19.535880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1012/1850] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:19.538302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-090583ad-3b1f-4d8e-b512-600ecdc667d7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052459 Jul 25 19:43:19.539454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 839/1851] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:19 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:19.540923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-74ec1c83-1353-4973-8168-d4e5e9170477 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:19.541522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-74ec1c83-1353-4973-8168-d4e5e9170477 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:19.554770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74ec1c83-1353-4973-8168-d4e5e9170477 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:19.555373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74ec1c83-1353-4973-8168-d4e5e9170477 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:19.557090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74ec1c83-1353-4973-8168-d4e5e9170477 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:19.563988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74ec1c83-1353-4973-8168-d4e5e9170477 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:19.633148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-74ec1c83-1353-4973-8168-d4e5e9170477 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:19.637870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:19.642485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-74ec1c83-1353-4973-8168-d4e5e9170477 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.105505 Jul 25 19:43:19.643295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1013/1852] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:19 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:20.559244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0e1e7a0-dae5-4da1-8575-abb3edeeac95 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:20.561872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0e1e7a0-dae5-4da1-8575-abb3edeeac95 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:20.567797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f042497b-0bea-4a9a-9071-48fc51a0f4b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:20.569056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f042497b-0bea-4a9a-9071-48fc51a0f4b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:20.569247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0e1e7a0-dae5-4da1-8575-abb3edeeac95 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:20.569574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0e1e7a0-dae5-4da1-8575-abb3edeeac95 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:20.570376 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0e1e7a0-dae5-4da1-8575-abb3edeeac95 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:20.570818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0e1e7a0-dae5-4da1-8575-abb3edeeac95 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:20.578320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f042497b-0bea-4a9a-9071-48fc51a0f4b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:20.578764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f042497b-0bea-4a9a-9071-48fc51a0f4b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:20.579617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f042497b-0bea-4a9a-9071-48fc51a0f4b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:20.580067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f042497b-0bea-4a9a-9071-48fc51a0f4b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:20.607289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0e1e7a0-dae5-4da1-8575-abb3edeeac95 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052180 Jul 25 19:43:20.607937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 840/1853] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:20 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:20.653974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f042497b-0bea-4a9a-9071-48fc51a0f4b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:20.668486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f042497b-0bea-4a9a-9071-48fc51a0f4b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.104836 Jul 25 19:43:20.669549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1014/1854] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:20.676834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4372715f-12ee-4da6-a406-12bfb77370d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:20.677414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4372715f-12ee-4da6-a406-12bfb77370d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:20.685436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4372715f-12ee-4da6-a406-12bfb77370d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:20.685897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4372715f-12ee-4da6-a406-12bfb77370d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:20.686791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4372715f-12ee-4da6-a406-12bfb77370d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:20.687225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4372715f-12ee-4da6-a406-12bfb77370d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:20.760790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4372715f-12ee-4da6-a406-12bfb77370d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:20.771066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4372715f-12ee-4da6-a406-12bfb77370d6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.098677 Jul 25 19:43:20.771770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 841/1855] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:20 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:21.620850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b77b1494-24f0-4728-9416-1173177ad0bf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:21.623450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b77b1494-24f0-4728-9416-1173177ad0bf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:21.631491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b77b1494-24f0-4728-9416-1173177ad0bf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:21.631961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b77b1494-24f0-4728-9416-1173177ad0bf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:21.632753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b77b1494-24f0-4728-9416-1173177ad0bf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:21.633188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b77b1494-24f0-4728-9416-1173177ad0bf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:21.671981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b77b1494-24f0-4728-9416-1173177ad0bf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055603 Jul 25 19:43:21.672595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1015/1856] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:21 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:21.692065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-89afbede-ef53-496e-8234-db2a07b240aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:21.692948 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-89afbede-ef53-496e-8234-db2a07b240aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:21.700529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89afbede-ef53-496e-8234-db2a07b240aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:21.700985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89afbede-ef53-496e-8234-db2a07b240aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:21.702256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89afbede-ef53-496e-8234-db2a07b240aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:21.702893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89afbede-ef53-496e-8234-db2a07b240aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:21.778779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-89afbede-ef53-496e-8234-db2a07b240aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:21.787682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-89afbede-ef53-496e-8234-db2a07b240aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099487 Jul 25 19:43:21.788278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 842/1857] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:21.795464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-58b90dc9-15cf-468c-a306-e8a80ebb200d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:21.796128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-58b90dc9-15cf-468c-a306-e8a80ebb200d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:21.802695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58b90dc9-15cf-468c-a306-e8a80ebb200d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:21.803143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58b90dc9-15cf-468c-a306-e8a80ebb200d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:21.804013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58b90dc9-15cf-468c-a306-e8a80ebb200d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:21.804446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58b90dc9-15cf-468c-a306-e8a80ebb200d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:21.887612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-58b90dc9-15cf-468c-a306-e8a80ebb200d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:21.896148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-58b90dc9-15cf-468c-a306-e8a80ebb200d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.106257 Jul 25 19:43:21.896732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1016/1858] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:21 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:22.691127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6ddcaa44-46d5-453b-9994-d237c34b4bce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:22.694694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ddcaa44-46d5-453b-9994-d237c34b4bce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:22.706741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ddcaa44-46d5-453b-9994-d237c34b4bce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:22.707572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ddcaa44-46d5-453b-9994-d237c34b4bce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:22.708929 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ddcaa44-46d5-453b-9994-d237c34b4bce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:22.709706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ddcaa44-46d5-453b-9994-d237c34b4bce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:22.717018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:22.744088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6ddcaa44-46d5-453b-9994-d237c34b4bce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060356 Jul 25 19:43:22.744660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 843/1859] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:22 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:22.825405 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d3a9ff68-29a9-44e1-a1c8-9052aaba452b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:22.826025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d3a9ff68-29a9-44e1-a1c8-9052aaba452b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:22.832747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3a9ff68-29a9-44e1-a1c8-9052aaba452b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:22.833200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3a9ff68-29a9-44e1-a1c8-9052aaba452b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:22.833984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3a9ff68-29a9-44e1-a1c8-9052aaba452b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:22.834429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3a9ff68-29a9-44e1-a1c8-9052aaba452b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:22.899637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d3a9ff68-29a9-44e1-a1c8-9052aaba452b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:22.908689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d3a9ff68-29a9-44e1-a1c8-9052aaba452b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089227 Jul 25 19:43:22.909274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1017/1860] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:22.920153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-313dd9c7-b9ab-4fab-8c8a-dabed270bc78 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:22.920758 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-313dd9c7-b9ab-4fab-8c8a-dabed270bc78 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:22.926868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-313dd9c7-b9ab-4fab-8c8a-dabed270bc78 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:22.927310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-313dd9c7-b9ab-4fab-8c8a-dabed270bc78 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:22.928115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-313dd9c7-b9ab-4fab-8c8a-dabed270bc78 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:22.928528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-313dd9c7-b9ab-4fab-8c8a-dabed270bc78 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:22.993501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-313dd9c7-b9ab-4fab-8c8a-dabed270bc78 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:23.001242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-313dd9c7-b9ab-4fab-8c8a-dabed270bc78 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.085415 Jul 25 19:43:23.001823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 844/1861] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:22 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:23.757307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bb72ae1a-b64f-4bc2-a434-7a7c98d9a353 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:23.759486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bb72ae1a-b64f-4bc2-a434-7a7c98d9a353 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:23.767444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb72ae1a-b64f-4bc2-a434-7a7c98d9a353 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:23.767911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb72ae1a-b64f-4bc2-a434-7a7c98d9a353 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:23.768697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb72ae1a-b64f-4bc2-a434-7a7c98d9a353 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:23.769135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb72ae1a-b64f-4bc2-a434-7a7c98d9a353 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:23.802835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bb72ae1a-b64f-4bc2-a434-7a7c98d9a353 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049392 Jul 25 19:43:23.803499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1018/1862] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:23 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:23.931114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4583f5aa-0886-4e75-8d20-4b3e7a972d87 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:23.931861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4583f5aa-0886-4e75-8d20-4b3e7a972d87 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:23.939372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4583f5aa-0886-4e75-8d20-4b3e7a972d87 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:23.939859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4583f5aa-0886-4e75-8d20-4b3e7a972d87 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:23.940673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4583f5aa-0886-4e75-8d20-4b3e7a972d87 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:23.941112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4583f5aa-0886-4e75-8d20-4b3e7a972d87 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:24.009331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4583f5aa-0886-4e75-8d20-4b3e7a972d87 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:24.018349 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4583f5aa-0886-4e75-8d20-4b3e7a972d87 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090994 Jul 25 19:43:24.018972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 845/1863] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:24.023745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-be004e24-eb78-4303-b67e-892f012651e6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:24.024458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-be004e24-eb78-4303-b67e-892f012651e6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:24.033319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be004e24-eb78-4303-b67e-892f012651e6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:24.034520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be004e24-eb78-4303-b67e-892f012651e6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:24.035422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be004e24-eb78-4303-b67e-892f012651e6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:24.035957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be004e24-eb78-4303-b67e-892f012651e6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:24.108634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-be004e24-eb78-4303-b67e-892f012651e6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:24.116762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-be004e24-eb78-4303-b67e-892f012651e6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.097868 Jul 25 19:43:24.117347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1019/1864] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:24 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:24.817498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-289b5d19-117d-4dd8-a296-f21b84c30346 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:24.819825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-289b5d19-117d-4dd8-a296-f21b84c30346 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:24.827420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-289b5d19-117d-4dd8-a296-f21b84c30346 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:24.827893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-289b5d19-117d-4dd8-a296-f21b84c30346 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:24.828777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-289b5d19-117d-4dd8-a296-f21b84c30346 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:24.829216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-289b5d19-117d-4dd8-a296-f21b84c30346 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:24.862606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-289b5d19-117d-4dd8-a296-f21b84c30346 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049247 Jul 25 19:43:24.863206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 846/1865] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:24 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:25.053879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4bcc12e0-ca85-4e6d-8a18-bd9c7dcf329c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:25.054601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4bcc12e0-ca85-4e6d-8a18-bd9c7dcf329c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:25.062315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4bcc12e0-ca85-4e6d-8a18-bd9c7dcf329c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:25.062767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4bcc12e0-ca85-4e6d-8a18-bd9c7dcf329c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:25.063564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4bcc12e0-ca85-4e6d-8a18-bd9c7dcf329c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:25.064002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4bcc12e0-ca85-4e6d-8a18-bd9c7dcf329c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:25.139342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-09263d0d-9799-4ec8-9419-0ff2fb3e96f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:25.140008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-09263d0d-9799-4ec8-9419-0ff2fb3e96f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:25.147700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09263d0d-9799-4ec8-9419-0ff2fb3e96f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:25.148156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09263d0d-9799-4ec8-9419-0ff2fb3e96f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:25.148955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09263d0d-9799-4ec8-9419-0ff2fb3e96f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:25.149400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09263d0d-9799-4ec8-9419-0ff2fb3e96f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:25.159536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4bcc12e0-ca85-4e6d-8a18-bd9c7dcf329c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:25.175991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4bcc12e0-ca85-4e6d-8a18-bd9c7dcf329c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.125514 Jul 25 19:43:25.177105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1020/1866] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:25.230211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-09263d0d-9799-4ec8-9419-0ff2fb3e96f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:25.241129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-09263d0d-9799-4ec8-9419-0ff2fb3e96f1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.106307 Jul 25 19:43:25.241729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 847/1867] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:25 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:25.877310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2518ce86-8166-4ac4-9b5f-d602764f222d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:25.879780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2518ce86-8166-4ac4-9b5f-d602764f222d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:25.887052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2518ce86-8166-4ac4-9b5f-d602764f222d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:25.887535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2518ce86-8166-4ac4-9b5f-d602764f222d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:25.888328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2518ce86-8166-4ac4-9b5f-d602764f222d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:25.888770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2518ce86-8166-4ac4-9b5f-d602764f222d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:25.921807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2518ce86-8166-4ac4-9b5f-d602764f222d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048524 Jul 25 19:43:25.922400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1021/1868] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:25 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:26.198846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3039387c-954b-4dd9-8b06-5a378984ee2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:26.199951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3039387c-954b-4dd9-8b06-5a378984ee2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:26.207047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3039387c-954b-4dd9-8b06-5a378984ee2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:26.207488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3039387c-954b-4dd9-8b06-5a378984ee2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:26.208338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3039387c-954b-4dd9-8b06-5a378984ee2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:26.208765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3039387c-954b-4dd9-8b06-5a378984ee2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:26.268805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-24fb0236-fb0d-4e8a-bd61-b799c114b5e7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:26.269945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-24fb0236-fb0d-4e8a-bd61-b799c114b5e7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:26.280916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24fb0236-fb0d-4e8a-bd61-b799c114b5e7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:26.281520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24fb0236-fb0d-4e8a-bd61-b799c114b5e7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:26.282552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24fb0236-fb0d-4e8a-bd61-b799c114b5e7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:26.283257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24fb0236-fb0d-4e8a-bd61-b799c114b5e7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:26.287953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3039387c-954b-4dd9-8b06-5a378984ee2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:26.297460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3039387c-954b-4dd9-8b06-5a378984ee2c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.102775 Jul 25 19:43:26.298066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 848/1869] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:26.379256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-24fb0236-fb0d-4e8a-bd61-b799c114b5e7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:26.387351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-24fb0236-fb0d-4e8a-bd61-b799c114b5e7 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.126423 Jul 25 19:43:26.387977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1022/1870] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:26 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:26.935584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb336258-43cd-4657-aa06-e97ff2127f32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:26.937850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb336258-43cd-4657-aa06-e97ff2127f32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:26.944444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb336258-43cd-4657-aa06-e97ff2127f32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:26.944889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb336258-43cd-4657-aa06-e97ff2127f32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:26.945830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb336258-43cd-4657-aa06-e97ff2127f32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:26.946263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb336258-43cd-4657-aa06-e97ff2127f32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:26.978837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb336258-43cd-4657-aa06-e97ff2127f32 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048255 Jul 25 19:43:26.979547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 849/1871] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:26 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:27.320086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d4852ba1-4afc-40c1-9ab2-8e1ca0c0cef9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:27.320777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d4852ba1-4afc-40c1-9ab2-8e1ca0c0cef9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:27.327749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4852ba1-4afc-40c1-9ab2-8e1ca0c0cef9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:27.328237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4852ba1-4afc-40c1-9ab2-8e1ca0c0cef9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:27.328956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4852ba1-4afc-40c1-9ab2-8e1ca0c0cef9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:27.329383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d4852ba1-4afc-40c1-9ab2-8e1ca0c0cef9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:27.395842 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d4852ba1-4afc-40c1-9ab2-8e1ca0c0cef9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:27.405115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d4852ba1-4afc-40c1-9ab2-8e1ca0c0cef9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089006 Jul 25 19:43:27.406161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1023/1872] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:27.410020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4808005c-5dce-4b92-a168-1f97425e3cf8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:27.411368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4808005c-5dce-4b92-a168-1f97425e3cf8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:27.423684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4808005c-5dce-4b92-a168-1f97425e3cf8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:27.424251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4808005c-5dce-4b92-a168-1f97425e3cf8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:27.424911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4808005c-5dce-4b92-a168-1f97425e3cf8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:27.425344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4808005c-5dce-4b92-a168-1f97425e3cf8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:27.493976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4808005c-5dce-4b92-a168-1f97425e3cf8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:27.503781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4808005c-5dce-4b92-a168-1f97425e3cf8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.098844 Jul 25 19:43:27.504389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 850/1873] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:27 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:27.993864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b89c6cc1-2e15-455a-9ac3-91e0b2b746ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:27.997323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b89c6cc1-2e15-455a-9ac3-91e0b2b746ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:28.004119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b89c6cc1-2e15-455a-9ac3-91e0b2b746ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:28.004560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b89c6cc1-2e15-455a-9ac3-91e0b2b746ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:28.005349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b89c6cc1-2e15-455a-9ac3-91e0b2b746ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:28.005780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b89c6cc1-2e15-455a-9ac3-91e0b2b746ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:28.040869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b89c6cc1-2e15-455a-9ac3-91e0b2b746ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051609 Jul 25 19:43:28.041472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1024/1874] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:27 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:28.428299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6d1d41c0-0871-47ae-b0cc-db2771b3e393 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:28.428949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d1d41c0-0871-47ae-b0cc-db2771b3e393 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:28.437479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d1d41c0-0871-47ae-b0cc-db2771b3e393 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:28.437967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d1d41c0-0871-47ae-b0cc-db2771b3e393 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:28.438846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d1d41c0-0871-47ae-b0cc-db2771b3e393 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:28.439283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d1d41c0-0871-47ae-b0cc-db2771b3e393 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:28.526016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3b2bebdd-0a09-47da-9704-8d7bd3ca3e2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:28.527221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3b2bebdd-0a09-47da-9704-8d7bd3ca3e2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:28.535005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b2bebdd-0a09-47da-9704-8d7bd3ca3e2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:28.535447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b2bebdd-0a09-47da-9704-8d7bd3ca3e2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:28.536428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b2bebdd-0a09-47da-9704-8d7bd3ca3e2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:28.536872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b2bebdd-0a09-47da-9704-8d7bd3ca3e2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:28.546370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6d1d41c0-0871-47ae-b0cc-db2771b3e393 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:28.555674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6d1d41c0-0871-47ae-b0cc-db2771b3e393 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.131087 Jul 25 19:43:28.559813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 851/1875] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:28.635097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b2bebdd-0a09-47da-9704-8d7bd3ca3e2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:28.645120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3b2bebdd-0a09-47da-9704-8d7bd3ca3e2b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.123077 Jul 25 19:43:28.645695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1025/1876] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:28 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:29.054440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6d33ff58-f545-455b-94f6-4d6d96761f30 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:29.056695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d33ff58-f545-455b-94f6-4d6d96761f30 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:29.063049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d33ff58-f545-455b-94f6-4d6d96761f30 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:29.063493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d33ff58-f545-455b-94f6-4d6d96761f30 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:29.064299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d33ff58-f545-455b-94f6-4d6d96761f30 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:29.064740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d33ff58-f545-455b-94f6-4d6d96761f30 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:29.099411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6d33ff58-f545-455b-94f6-4d6d96761f30 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048949 Jul 25 19:43:29.100033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 852/1877] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:29 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:29.593109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d2bd7201-6f4b-4c12-b0e4-2d588f118401 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:29.594288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d2bd7201-6f4b-4c12-b0e4-2d588f118401 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:29.603262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2bd7201-6f4b-4c12-b0e4-2d588f118401 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:29.603810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2bd7201-6f4b-4c12-b0e4-2d588f118401 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:29.605152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2bd7201-6f4b-4c12-b0e4-2d588f118401 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:29.605728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2bd7201-6f4b-4c12-b0e4-2d588f118401 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:29.670654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9192dd44-be27-4930-8767-d5e19253e500 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:29.672092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9192dd44-be27-4930-8767-d5e19253e500 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:29.684250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9192dd44-be27-4930-8767-d5e19253e500 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:29.684740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9192dd44-be27-4930-8767-d5e19253e500 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:29.685562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9192dd44-be27-4930-8767-d5e19253e500 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:29.686102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9192dd44-be27-4930-8767-d5e19253e500 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:29.686306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d2bd7201-6f4b-4c12-b0e4-2d588f118401 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:29.694952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d2bd7201-6f4b-4c12-b0e4-2d588f118401 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.107101 Jul 25 19:43:29.695565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1026/1878] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:29 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:29.751386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9192dd44-be27-4930-8767-d5e19253e500 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:29.759458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9192dd44-be27-4930-8767-d5e19253e500 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.096226 Jul 25 19:43:29.760318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 853/1879] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:29 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:30.112604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3ab304f1-962a-403a-aa15-e42c83015c7d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:30.114781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3ab304f1-962a-403a-aa15-e42c83015c7d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:30.121997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3ab304f1-962a-403a-aa15-e42c83015c7d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:30.122446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3ab304f1-962a-403a-aa15-e42c83015c7d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:30.123231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3ab304f1-962a-403a-aa15-e42c83015c7d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:30.123709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3ab304f1-962a-403a-aa15-e42c83015c7d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:30.156893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3ab304f1-962a-403a-aa15-e42c83015c7d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048471 Jul 25 19:43:30.157490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1027/1880] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:30 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:30.722277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-375702a4-52ab-469a-90db-8f598f250334 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:30.723156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-375702a4-52ab-469a-90db-8f598f250334 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:30.730813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-375702a4-52ab-469a-90db-8f598f250334 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:30.731262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-375702a4-52ab-469a-90db-8f598f250334 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:30.732074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-375702a4-52ab-469a-90db-8f598f250334 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:30.732512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-375702a4-52ab-469a-90db-8f598f250334 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:30.782500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7c087e1b-6e11-4068-a119-e09b45e78449 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:30.783151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7c087e1b-6e11-4068-a119-e09b45e78449 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:30.789906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c087e1b-6e11-4068-a119-e09b45e78449 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:30.790360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c087e1b-6e11-4068-a119-e09b45e78449 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:30.791150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c087e1b-6e11-4068-a119-e09b45e78449 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:30.791619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7c087e1b-6e11-4068-a119-e09b45e78449 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:30.807152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-375702a4-52ab-469a-90db-8f598f250334 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:30.816333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-375702a4-52ab-469a-90db-8f598f250334 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099782 Jul 25 19:43:30.817027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 854/1881] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:30.868827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7c087e1b-6e11-4068-a119-e09b45e78449 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:30.877648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7c087e1b-6e11-4068-a119-e09b45e78449 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.099106 Jul 25 19:43:30.878252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1028/1882] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:30 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:31.173118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a82d4fb8-fba2-4f0f-84cc-164e4689e107 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:31.175768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a82d4fb8-fba2-4f0f-84cc-164e4689e107 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:31.182398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a82d4fb8-fba2-4f0f-84cc-164e4689e107 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:31.183403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a82d4fb8-fba2-4f0f-84cc-164e4689e107 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:31.184474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a82d4fb8-fba2-4f0f-84cc-164e4689e107 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:31.184918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a82d4fb8-fba2-4f0f-84cc-164e4689e107 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:31.218638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a82d4fb8-fba2-4f0f-84cc-164e4689e107 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049541 Jul 25 19:43:31.219232 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 855/1883] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:31 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:31.839403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-29db459b-fcc4-4c93-a3f9-1c00985b7972 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:31.840596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-29db459b-fcc4-4c93-a3f9-1c00985b7972 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:31.848106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29db459b-fcc4-4c93-a3f9-1c00985b7972 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:31.848555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29db459b-fcc4-4c93-a3f9-1c00985b7972 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:31.849350 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29db459b-fcc4-4c93-a3f9-1c00985b7972 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:31.849829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29db459b-fcc4-4c93-a3f9-1c00985b7972 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:31.903083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c93d34c3-c800-4954-b57b-5589bf34d2f5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:31.904164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c93d34c3-c800-4954-b57b-5589bf34d2f5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:31.911838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c93d34c3-c800-4954-b57b-5589bf34d2f5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:31.912290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c93d34c3-c800-4954-b57b-5589bf34d2f5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:31.913082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c93d34c3-c800-4954-b57b-5589bf34d2f5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:31.913515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c93d34c3-c800-4954-b57b-5589bf34d2f5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:31.940998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-29db459b-fcc4-4c93-a3f9-1c00985b7972 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:31.950771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-29db459b-fcc4-4c93-a3f9-1c00985b7972 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.115979 Jul 25 19:43:31.951406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1029/1884] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:31.991140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c93d34c3-c800-4954-b57b-5589bf34d2f5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:32.000179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c93d34c3-c800-4954-b57b-5589bf34d2f5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.102783 Jul 25 19:43:32.000773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 856/1885] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:31 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:32.232656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a176561e-ba27-48a5-994f-f46e31f37149 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:32.235075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a176561e-ba27-48a5-994f-f46e31f37149 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:32.241385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a176561e-ba27-48a5-994f-f46e31f37149 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:32.241823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a176561e-ba27-48a5-994f-f46e31f37149 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:32.242593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a176561e-ba27-48a5-994f-f46e31f37149 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:32.243027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a176561e-ba27-48a5-994f-f46e31f37149 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:32.261239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:32.278809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a176561e-ba27-48a5-994f-f46e31f37149 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051090 Jul 25 19:43:32.279432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1030/1886] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:32 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:32.972528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bbb7bfb7-2d2b-43f0-9f10-168a5ef36bf1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:32.973158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bbb7bfb7-2d2b-43f0-9f10-168a5ef36bf1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:32.979615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bbb7bfb7-2d2b-43f0-9f10-168a5ef36bf1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:32.980063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bbb7bfb7-2d2b-43f0-9f10-168a5ef36bf1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:32.980841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bbb7bfb7-2d2b-43f0-9f10-168a5ef36bf1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:32.981273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bbb7bfb7-2d2b-43f0-9f10-168a5ef36bf1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:33.026251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ec8606d7-8714-46a3-84cf-dbfae5a23823 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:33.027065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ec8606d7-8714-46a3-84cf-dbfae5a23823 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:33.037166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec8606d7-8714-46a3-84cf-dbfae5a23823 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:33.037829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec8606d7-8714-46a3-84cf-dbfae5a23823 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:33.038851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec8606d7-8714-46a3-84cf-dbfae5a23823 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:33.039375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ec8606d7-8714-46a3-84cf-dbfae5a23823 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:33.059064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bbb7bfb7-2d2b-43f0-9f10-168a5ef36bf1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:33.067904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bbb7bfb7-2d2b-43f0-9f10-168a5ef36bf1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099134 Jul 25 19:43:33.068595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 857/1887] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:33.108313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ec8606d7-8714-46a3-84cf-dbfae5a23823 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:33.117220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ec8606d7-8714-46a3-84cf-dbfae5a23823 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.098314 Jul 25 19:43:33.117821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1031/1888] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:33 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:33.290766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1f3e4459-ea7f-42f7-a7f5-3935b0153c81 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:33.293614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1f3e4459-ea7f-42f7-a7f5-3935b0153c81 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:33.300614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f3e4459-ea7f-42f7-a7f5-3935b0153c81 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:33.302679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f3e4459-ea7f-42f7-a7f5-3935b0153c81 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:33.303587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f3e4459-ea7f-42f7-a7f5-3935b0153c81 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:33.304027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f3e4459-ea7f-42f7-a7f5-3935b0153c81 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:33.341768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1f3e4459-ea7f-42f7-a7f5-3935b0153c81 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055039 Jul 25 19:43:33.342378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 858/1889] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:33 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:34.104933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7ac9e83d-07a1-485e-b850-8ceb824e2887 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:34.106066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7ac9e83d-07a1-485e-b850-8ceb824e2887 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:34.116337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ac9e83d-07a1-485e-b850-8ceb824e2887 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:34.116868 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ac9e83d-07a1-485e-b850-8ceb824e2887 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:34.117849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ac9e83d-07a1-485e-b850-8ceb824e2887 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:34.118275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ac9e83d-07a1-485e-b850-8ceb824e2887 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:34.144090 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2898e2bd-2d16-4274-b6cf-83f2e70bc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:34.145249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2898e2bd-2d16-4274-b6cf-83f2e70bc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:34.157990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2898e2bd-2d16-4274-b6cf-83f2e70bc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:34.158762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2898e2bd-2d16-4274-b6cf-83f2e70bc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:34.160126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2898e2bd-2d16-4274-b6cf-83f2e70bc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:34.160844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2898e2bd-2d16-4274-b6cf-83f2e70bc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:34.194920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7ac9e83d-07a1-485e-b850-8ceb824e2887 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:34.205165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7ac9e83d-07a1-485e-b850-8ceb824e2887 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.106161 Jul 25 19:43:34.205755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1032/1890] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:34.257170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2898e2bd-2d16-4274-b6cf-83f2e70bc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:34.264917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:34.275136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2898e2bd-2d16-4274-b6cf-83f2e70bc68e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.137475 Jul 25 19:43:34.276267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 859/1891] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:34 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:34.357953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-79f84a4f-6d7c-4683-ba1c-de9eef25642b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:34.360552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-79f84a4f-6d7c-4683-ba1c-de9eef25642b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:34.367021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79f84a4f-6d7c-4683-ba1c-de9eef25642b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:34.367465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79f84a4f-6d7c-4683-ba1c-de9eef25642b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:34.368281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79f84a4f-6d7c-4683-ba1c-de9eef25642b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:34.368704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79f84a4f-6d7c-4683-ba1c-de9eef25642b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:34.402945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-79f84a4f-6d7c-4683-ba1c-de9eef25642b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051987 Jul 25 19:43:34.403620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1033/1892] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:34 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:35.227410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b7e4468f-d6ab-4c80-b172-6c9a0aef7af7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:35.228311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b7e4468f-d6ab-4c80-b172-6c9a0aef7af7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:35.236681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7e4468f-d6ab-4c80-b172-6c9a0aef7af7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:35.237122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7e4468f-d6ab-4c80-b172-6c9a0aef7af7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:35.237915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7e4468f-d6ab-4c80-b172-6c9a0aef7af7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:35.238353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7e4468f-d6ab-4c80-b172-6c9a0aef7af7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:35.298475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cdb13be8-d7bd-4f8d-ab24-72c391fce869 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:35.299223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cdb13be8-d7bd-4f8d-ab24-72c391fce869 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:35.301734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=81 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:35.308684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdb13be8-d7bd-4f8d-ab24-72c391fce869 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:35.309138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdb13be8-d7bd-4f8d-ab24-72c391fce869 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:35.309777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b7e4468f-d6ab-4c80-b172-6c9a0aef7af7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:35.310030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdb13be8-d7bd-4f8d-ab24-72c391fce869 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:35.310367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdb13be8-d7bd-4f8d-ab24-72c391fce869 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:35.321247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b7e4468f-d6ab-4c80-b172-6c9a0aef7af7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.097955 Jul 25 19:43:35.321876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 860/1893] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:35 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:35.379409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cdb13be8-d7bd-4f8d-ab24-72c391fce869 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:35.389332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cdb13be8-d7bd-4f8d-ab24-72c391fce869 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.094773 Jul 25 19:43:35.389952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1034/1894] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:35 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:35.414932 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-488302d3-d5c0-4fa7-9c14-37ab5bd55d8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:35.417756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-488302d3-d5c0-4fa7-9c14-37ab5bd55d8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:35.424325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-488302d3-d5c0-4fa7-9c14-37ab5bd55d8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:35.424782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-488302d3-d5c0-4fa7-9c14-37ab5bd55d8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:35.425633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-488302d3-d5c0-4fa7-9c14-37ab5bd55d8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:35.426103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-488302d3-d5c0-4fa7-9c14-37ab5bd55d8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:35.461942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-488302d3-d5c0-4fa7-9c14-37ab5bd55d8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050946 Jul 25 19:43:35.462538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 861/1895] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:35 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:36.350043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3c2a6bb0-824c-469b-bc2b-36e86cd22e93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:36.350911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3c2a6bb0-824c-469b-bc2b-36e86cd22e93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:36.357739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c2a6bb0-824c-469b-bc2b-36e86cd22e93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:36.358189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c2a6bb0-824c-469b-bc2b-36e86cd22e93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:36.358983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c2a6bb0-824c-469b-bc2b-36e86cd22e93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:36.359757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c2a6bb0-824c-469b-bc2b-36e86cd22e93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:36.410635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c0ed6f18-f83f-40e8-b021-032c673e7d63 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:36.411287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c0ed6f18-f83f-40e8-b021-032c673e7d63 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:36.413875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=82 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:36.420804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0ed6f18-f83f-40e8-b021-032c673e7d63 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:36.421758 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0ed6f18-f83f-40e8-b021-032c673e7d63 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:36.422099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0ed6f18-f83f-40e8-b021-032c673e7d63 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:36.425117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0ed6f18-f83f-40e8-b021-032c673e7d63 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:36.445917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3c2a6bb0-824c-469b-bc2b-36e86cd22e93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:36.455787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3c2a6bb0-824c-469b-bc2b-36e86cd22e93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.109526 Jul 25 19:43:36.456626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1035/1896] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:36.478195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e4cd8b68-5e23-4cae-9260-bae220d6e05d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:36.482291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e4cd8b68-5e23-4cae-9260-bae220d6e05d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:36.492242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4cd8b68-5e23-4cae-9260-bae220d6e05d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:36.492931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4cd8b68-5e23-4cae-9260-bae220d6e05d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:36.494198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4cd8b68-5e23-4cae-9260-bae220d6e05d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:36.495891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4cd8b68-5e23-4cae-9260-bae220d6e05d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:36.532013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c0ed6f18-f83f-40e8-b021-032c673e7d63 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:36.543538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c0ed6f18-f83f-40e8-b021-032c673e7d63 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.136344 Jul 25 19:43:36.544648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 862/1897] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:36 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:36.545181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e4cd8b68-5e23-4cae-9260-bae220d6e05d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073752 Jul 25 19:43:36.545763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1036/1898] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:36 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:37.479093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a20b8717-1ecf-4af5-93c1-c1c42fc420c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:37.479950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a20b8717-1ecf-4af5-93c1-c1c42fc420c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:37.487647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a20b8717-1ecf-4af5-93c1-c1c42fc420c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:37.488311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a20b8717-1ecf-4af5-93c1-c1c42fc420c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:37.489201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a20b8717-1ecf-4af5-93c1-c1c42fc420c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:37.489744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a20b8717-1ecf-4af5-93c1-c1c42fc420c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:37.557842 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9193a5d4-e079-47cb-a48d-c6212459c5b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:37.561526 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9193a5d4-e079-47cb-a48d-c6212459c5b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:37.565049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a20b8717-1ecf-4af5-93c1-c1c42fc420c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:37.568685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9193a5d4-e079-47cb-a48d-c6212459c5b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:37.569219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9193a5d4-e079-47cb-a48d-c6212459c5b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:37.570009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9193a5d4-e079-47cb-a48d-c6212459c5b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:37.570442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9193a5d4-e079-47cb-a48d-c6212459c5b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:37.574745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a20b8717-1ecf-4af5-93c1-c1c42fc420c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099732 Jul 25 19:43:37.577020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 863/1899] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:37.581079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-11538ddb-ca26-42db-ac29-3b6cec99c40d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:37.581699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-11538ddb-ca26-42db-ac29-3b6cec99c40d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:37.588120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11538ddb-ca26-42db-ac29-3b6cec99c40d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:37.588707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11538ddb-ca26-42db-ac29-3b6cec99c40d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:37.590015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11538ddb-ca26-42db-ac29-3b6cec99c40d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:37.590455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11538ddb-ca26-42db-ac29-3b6cec99c40d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:37.618251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9193a5d4-e079-47cb-a48d-c6212459c5b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064491 Jul 25 19:43:37.619012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1037/1900] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:37 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:37.659126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-11538ddb-ca26-42db-ac29-3b6cec99c40d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:37.672745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-11538ddb-ca26-42db-ac29-3b6cec99c40d tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.095746 Jul 25 19:43:37.673737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 864/1901] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:37 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:38.609889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9beeffda-c399-4061-a1de-86fe727ea179 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:38.610603 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9beeffda-c399-4061-a1de-86fe727ea179 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:38.618150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9beeffda-c399-4061-a1de-86fe727ea179 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:38.618660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9beeffda-c399-4061-a1de-86fe727ea179 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:38.619494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9beeffda-c399-4061-a1de-86fe727ea179 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:38.620044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9beeffda-c399-4061-a1de-86fe727ea179 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:38.631664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-256ebac0-2c0c-437d-a44d-9311d694eb6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:38.634559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-256ebac0-2c0c-437d-a44d-9311d694eb6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:38.643795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-256ebac0-2c0c-437d-a44d-9311d694eb6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:38.644484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-256ebac0-2c0c-437d-a44d-9311d694eb6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:38.645392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-256ebac0-2c0c-437d-a44d-9311d694eb6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:38.645917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-256ebac0-2c0c-437d-a44d-9311d694eb6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:38.690087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-256ebac0-2c0c-437d-a44d-9311d694eb6d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062903 Jul 25 19:43:38.691029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 865/1902] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:38 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:38.702675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a2300eba-eaf7-451f-8d2a-7798101a4802 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:38.703872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a2300eba-eaf7-451f-8d2a-7798101a4802 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:38.708993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9beeffda-c399-4061-a1de-86fe727ea179 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:38.712085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2300eba-eaf7-451f-8d2a-7798101a4802 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:38.712693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2300eba-eaf7-451f-8d2a-7798101a4802 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:38.714452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2300eba-eaf7-451f-8d2a-7798101a4802 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:38.715077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2300eba-eaf7-451f-8d2a-7798101a4802 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:38.719430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9beeffda-c399-4061-a1de-86fe727ea179 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.115174 Jul 25 19:43:38.731620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1038/1903] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:38.787423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a2300eba-eaf7-451f-8d2a-7798101a4802 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:38.795735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a2300eba-eaf7-451f-8d2a-7798101a4802 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.101338 Jul 25 19:43:38.796336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 866/1904] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:38 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:39.705174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dffc6b7b-f3e0-4c6f-9667-a58cdee20fb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:39.707411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dffc6b7b-f3e0-4c6f-9667-a58cdee20fb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:39.715083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dffc6b7b-f3e0-4c6f-9667-a58cdee20fb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:39.715557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dffc6b7b-f3e0-4c6f-9667-a58cdee20fb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:39.716579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dffc6b7b-f3e0-4c6f-9667-a58cdee20fb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:39.717098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dffc6b7b-f3e0-4c6f-9667-a58cdee20fb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:39.750152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dffc6b7b-f3e0-4c6f-9667-a58cdee20fb4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048826 Jul 25 19:43:39.750948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1039/1905] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:39 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:39.755831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-598acc16-c867-4064-8e8d-a12c073cbab6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:39.756521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-598acc16-c867-4064-8e8d-a12c073cbab6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:39.763555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-598acc16-c867-4064-8e8d-a12c073cbab6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:39.763999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-598acc16-c867-4064-8e8d-a12c073cbab6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:39.764760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-598acc16-c867-4064-8e8d-a12c073cbab6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:39.765191 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-598acc16-c867-4064-8e8d-a12c073cbab6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:39.830388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-141520d4-b73f-4e16-bdd8-449f98eb2851 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:39.831001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-141520d4-b73f-4e16-bdd8-449f98eb2851 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:39.836698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-598acc16-c867-4064-8e8d-a12c073cbab6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:39.837769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-141520d4-b73f-4e16-bdd8-449f98eb2851 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:39.838281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-141520d4-b73f-4e16-bdd8-449f98eb2851 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:39.839750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-141520d4-b73f-4e16-bdd8-449f98eb2851 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:39.840190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-141520d4-b73f-4e16-bdd8-449f98eb2851 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:39.846333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-598acc16-c867-4064-8e8d-a12c073cbab6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094332 Jul 25 19:43:39.846852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 867/1906] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:39.909458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-141520d4-b73f-4e16-bdd8-449f98eb2851 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:39.919231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-141520d4-b73f-4e16-bdd8-449f98eb2851 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.092705 Jul 25 19:43:39.919857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1040/1907] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:39 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:40.764305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e940984-8f0e-4e49-94b4-b48954ce614a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:40.766427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6e940984-8f0e-4e49-94b4-b48954ce614a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:40.773301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e940984-8f0e-4e49-94b4-b48954ce614a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:40.773756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e940984-8f0e-4e49-94b4-b48954ce614a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:40.774580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e940984-8f0e-4e49-94b4-b48954ce614a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:40.775104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e940984-8f0e-4e49-94b4-b48954ce614a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:40.812771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6e940984-8f0e-4e49-94b4-b48954ce614a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054195 Jul 25 19:43:40.813371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 868/1908] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:40 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:40.868967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9f28185d-f9b3-4b13-8bd6-a8af653dc49a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:40.869566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9f28185d-f9b3-4b13-8bd6-a8af653dc49a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:40.877236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f28185d-f9b3-4b13-8bd6-a8af653dc49a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:40.877722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f28185d-f9b3-4b13-8bd6-a8af653dc49a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:40.878534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f28185d-f9b3-4b13-8bd6-a8af653dc49a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:40.879004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9f28185d-f9b3-4b13-8bd6-a8af653dc49a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:40.942027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0972665c-86ce-4a30-8074-c45ce94e5ed1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:40.942732 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0972665c-86ce-4a30-8074-c45ce94e5ed1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:40.950220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0972665c-86ce-4a30-8074-c45ce94e5ed1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:40.950739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0972665c-86ce-4a30-8074-c45ce94e5ed1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:40.951462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9f28185d-f9b3-4b13-8bd6-a8af653dc49a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:40.951676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0972665c-86ce-4a30-8074-c45ce94e5ed1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:40.952218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0972665c-86ce-4a30-8074-c45ce94e5ed1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:40.963018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9f28185d-f9b3-4b13-8bd6-a8af653dc49a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.097825 Jul 25 19:43:40.964481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1041/1909] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:41.023291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0972665c-86ce-4a30-8074-c45ce94e5ed1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:41.033028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0972665c-86ce-4a30-8074-c45ce94e5ed1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.094518 Jul 25 19:43:41.033779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 869/1910] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:40 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:41.826207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f0fc5e77-9087-4ca4-aac1-0bce96573c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:41.828608 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f0fc5e77-9087-4ca4-aac1-0bce96573c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:41.835560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0fc5e77-9087-4ca4-aac1-0bce96573c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:41.836229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0fc5e77-9087-4ca4-aac1-0bce96573c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:41.837206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0fc5e77-9087-4ca4-aac1-0bce96573c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:41.837650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0fc5e77-9087-4ca4-aac1-0bce96573c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:41.875046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f0fc5e77-9087-4ca4-aac1-0bce96573c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052826 Jul 25 19:43:41.876036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1042/1911] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:41 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:41.986433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e7c57f4a-39a0-4f93-899f-ff8f3c792349 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:41.987140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e7c57f4a-39a0-4f93-899f-ff8f3c792349 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:41.995572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7c57f4a-39a0-4f93-899f-ff8f3c792349 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:41.996043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7c57f4a-39a0-4f93-899f-ff8f3c792349 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:41.996836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7c57f4a-39a0-4f93-899f-ff8f3c792349 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:41.997272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7c57f4a-39a0-4f93-899f-ff8f3c792349 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:42.058763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-37d80232-d46f-47f5-a8d6-1c19056f7efb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:42.059387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-37d80232-d46f-47f5-a8d6-1c19056f7efb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:42.067659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37d80232-d46f-47f5-a8d6-1c19056f7efb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:42.068261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37d80232-d46f-47f5-a8d6-1c19056f7efb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:42.069196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37d80232-d46f-47f5-a8d6-1c19056f7efb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:42.069833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37d80232-d46f-47f5-a8d6-1c19056f7efb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:42.070932 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e7c57f4a-39a0-4f93-899f-ff8f3c792349 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:42.086185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e7c57f4a-39a0-4f93-899f-ff8f3c792349 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.103204 Jul 25 19:43:42.087071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 870/1912] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:42.145981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-37d80232-d46f-47f5-a8d6-1c19056f7efb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:42.155376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-37d80232-d46f-47f5-a8d6-1c19056f7efb tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.101145 Jul 25 19:43:42.156010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1043/1913] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:42 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:42.891580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d545504e-200a-4d4b-9ae7-1a2bdfd1f5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:42.893812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d545504e-200a-4d4b-9ae7-1a2bdfd1f5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:42.900561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d545504e-200a-4d4b-9ae7-1a2bdfd1f5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:42.901063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d545504e-200a-4d4b-9ae7-1a2bdfd1f5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:42.902661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d545504e-200a-4d4b-9ae7-1a2bdfd1f5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:42.903133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d545504e-200a-4d4b-9ae7-1a2bdfd1f5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:42.936797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d545504e-200a-4d4b-9ae7-1a2bdfd1f5eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049324 Jul 25 19:43:42.937400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 871/1914] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:42 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:43.111013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0ad9ffdd-87b9-474a-959b-61c8da55e662 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:43.111650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0ad9ffdd-87b9-474a-959b-61c8da55e662 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:43.118927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ad9ffdd-87b9-474a-959b-61c8da55e662 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:43.119437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ad9ffdd-87b9-474a-959b-61c8da55e662 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:43.121761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ad9ffdd-87b9-474a-959b-61c8da55e662 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:43.122226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0ad9ffdd-87b9-474a-959b-61c8da55e662 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:43.183832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-730ba4ea-d06b-4903-a5d9-ad6bf5aedfb4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:43.184922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-730ba4ea-d06b-4903-a5d9-ad6bf5aedfb4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:43.192632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-730ba4ea-d06b-4903-a5d9-ad6bf5aedfb4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:43.193079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-730ba4ea-d06b-4903-a5d9-ad6bf5aedfb4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:43.193859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-730ba4ea-d06b-4903-a5d9-ad6bf5aedfb4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:43.194297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-730ba4ea-d06b-4903-a5d9-ad6bf5aedfb4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:43.211890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0ad9ffdd-87b9-474a-959b-61c8da55e662 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:43.224919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0ad9ffdd-87b9-474a-959b-61c8da55e662 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.117828 Jul 25 19:43:43.243546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1044/1915] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:43.281747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-730ba4ea-d06b-4903-a5d9-ad6bf5aedfb4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:43.290848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-730ba4ea-d06b-4903-a5d9-ad6bf5aedfb4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.113873 Jul 25 19:43:43.291815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 872/1916] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:43 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:43.952388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0f25ea01-5279-401a-b73d-aab16302d4fb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:43.955884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0f25ea01-5279-401a-b73d-aab16302d4fb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:43.962649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f25ea01-5279-401a-b73d-aab16302d4fb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:43.963097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f25ea01-5279-401a-b73d-aab16302d4fb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:43.964085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f25ea01-5279-401a-b73d-aab16302d4fb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:43.964816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f25ea01-5279-401a-b73d-aab16302d4fb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:44.001205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0f25ea01-5279-401a-b73d-aab16302d4fb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053074 Jul 25 19:43:44.001803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1045/1917] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:43 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:44.256794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-29df8305-95e7-403a-b32a-2623294b15de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:44.257478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-29df8305-95e7-403a-b32a-2623294b15de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:44.267438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29df8305-95e7-403a-b32a-2623294b15de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:44.268277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29df8305-95e7-403a-b32a-2623294b15de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:44.269603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29df8305-95e7-403a-b32a-2623294b15de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:44.270312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29df8305-95e7-403a-b32a-2623294b15de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:44.316857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7f1e2a13-e3c1-4329-b9c7-2b5fb7fc3c71 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:44.317999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7f1e2a13-e3c1-4329-b9c7-2b5fb7fc3c71 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:44.328529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f1e2a13-e3c1-4329-b9c7-2b5fb7fc3c71 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:44.329075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f1e2a13-e3c1-4329-b9c7-2b5fb7fc3c71 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:44.329961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f1e2a13-e3c1-4329-b9c7-2b5fb7fc3c71 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:44.330472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f1e2a13-e3c1-4329-b9c7-2b5fb7fc3c71 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:44.357242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-29df8305-95e7-403a-b32a-2623294b15de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:44.371557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-29df8305-95e7-403a-b32a-2623294b15de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.118580 Jul 25 19:43:44.372559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 873/1918] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:44.404121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7f1e2a13-e3c1-4329-b9c7-2b5fb7fc3c71 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:44.412943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7f1e2a13-e3c1-4329-b9c7-2b5fb7fc3c71 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.102040 Jul 25 19:43:44.413541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1046/1919] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:44 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:45.018006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9a307f4e-98d0-4851-8fff-cbb956973642 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:45.020386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9a307f4e-98d0-4851-8fff-cbb956973642 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:45.027650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a307f4e-98d0-4851-8fff-cbb956973642 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:45.028095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a307f4e-98d0-4851-8fff-cbb956973642 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:45.028867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a307f4e-98d0-4851-8fff-cbb956973642 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:45.029295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a307f4e-98d0-4851-8fff-cbb956973642 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:45.065157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9a307f4e-98d0-4851-8fff-cbb956973642 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051157 Jul 25 19:43:45.065832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 874/1920] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:45 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:45.404480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-97d8bd4d-0f60-40ac-ab85-f8c7b263f138 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:45.405360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-97d8bd4d-0f60-40ac-ab85-f8c7b263f138 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:45.412576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97d8bd4d-0f60-40ac-ab85-f8c7b263f138 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:45.413016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97d8bd4d-0f60-40ac-ab85-f8c7b263f138 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:45.413823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97d8bd4d-0f60-40ac-ab85-f8c7b263f138 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:45.414257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97d8bd4d-0f60-40ac-ab85-f8c7b263f138 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:45.419871 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:45.441988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a5d7234e-ff82-4e1e-a145-d6e96e780fca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:45.442793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a5d7234e-ff82-4e1e-a145-d6e96e780fca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:45.450946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5d7234e-ff82-4e1e-a145-d6e96e780fca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:45.451393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5d7234e-ff82-4e1e-a145-d6e96e780fca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:45.452222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5d7234e-ff82-4e1e-a145-d6e96e780fca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:45.452666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5d7234e-ff82-4e1e-a145-d6e96e780fca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:45.515146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-97d8bd4d-0f60-40ac-ab85-f8c7b263f138 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:45.524115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-97d8bd4d-0f60-40ac-ab85-f8c7b263f138 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.124189 Jul 25 19:43:45.524987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1047/1921] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:45.554954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a5d7234e-ff82-4e1e-a145-d6e96e780fca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:45.564528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a5d7234e-ff82-4e1e-a145-d6e96e780fca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.132653 Jul 25 19:43:45.565129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 875/1922] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:45 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:46.079601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9ba35f0d-8de3-44b1-961d-ce762722047a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:46.082061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9ba35f0d-8de3-44b1-961d-ce762722047a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:46.089067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ba35f0d-8de3-44b1-961d-ce762722047a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:46.089529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ba35f0d-8de3-44b1-961d-ce762722047a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:46.090390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ba35f0d-8de3-44b1-961d-ce762722047a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:46.090840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ba35f0d-8de3-44b1-961d-ce762722047a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:46.124379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9ba35f0d-8de3-44b1-961d-ce762722047a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049318 Jul 25 19:43:46.124977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1048/1923] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:46 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:46.559487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74029a93-d73b-407b-869a-8932c3dbefaf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:46.560321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-74029a93-d73b-407b-869a-8932c3dbefaf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:46.567596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74029a93-d73b-407b-869a-8932c3dbefaf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:46.568055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74029a93-d73b-407b-869a-8932c3dbefaf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:46.568851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74029a93-d73b-407b-869a-8932c3dbefaf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:46.569321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74029a93-d73b-407b-869a-8932c3dbefaf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:46.588042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8b54f890-6dae-434e-b8ca-436cb1887455 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:46.588914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8b54f890-6dae-434e-b8ca-436cb1887455 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:46.590573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:46.597810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8b54f890-6dae-434e-b8ca-436cb1887455 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:46.598251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8b54f890-6dae-434e-b8ca-436cb1887455 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:46.599045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8b54f890-6dae-434e-b8ca-436cb1887455 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:46.599479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8b54f890-6dae-434e-b8ca-436cb1887455 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:46.662728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-74029a93-d73b-407b-869a-8932c3dbefaf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:46.674833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74029a93-d73b-407b-869a-8932c3dbefaf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.120075 Jul 25 19:43:46.676002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 876/1924] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:46.694692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8b54f890-6dae-434e-b8ca-436cb1887455 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:46.704268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8b54f890-6dae-434e-b8ca-436cb1887455 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.120898 Jul 25 19:43:46.704914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1049/1925] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:46 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:47.138640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d3e25ab3-1060-4a53-973c-1251f6bc8670 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:47.140953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d3e25ab3-1060-4a53-973c-1251f6bc8670 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:47.147492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3e25ab3-1060-4a53-973c-1251f6bc8670 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:47.147980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3e25ab3-1060-4a53-973c-1251f6bc8670 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:47.148777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3e25ab3-1060-4a53-973c-1251f6bc8670 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:47.149221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3e25ab3-1060-4a53-973c-1251f6bc8670 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:47.186265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d3e25ab3-1060-4a53-973c-1251f6bc8670 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052749 Jul 25 19:43:47.186990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 877/1926] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:47 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:47.699029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b7297e69-0c20-4d61-af79-b7bc49e03a90 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:47.699666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b7297e69-0c20-4d61-af79-b7bc49e03a90 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:47.706792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7297e69-0c20-4d61-af79-b7bc49e03a90 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:47.707252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7297e69-0c20-4d61-af79-b7bc49e03a90 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:47.708076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7297e69-0c20-4d61-af79-b7bc49e03a90 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:47.708517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7297e69-0c20-4d61-af79-b7bc49e03a90 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:47.730260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ba4276f9-240f-41cd-9815-c1eed0884cb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:47.731316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ba4276f9-240f-41cd-9815-c1eed0884cb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:47.740230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba4276f9-240f-41cd-9815-c1eed0884cb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:47.740680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba4276f9-240f-41cd-9815-c1eed0884cb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:47.741479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba4276f9-240f-41cd-9815-c1eed0884cb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:47.741922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba4276f9-240f-41cd-9815-c1eed0884cb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:47.786090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b7297e69-0c20-4d61-af79-b7bc49e03a90 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:47.801176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b7297e69-0c20-4d61-af79-b7bc49e03a90 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.106330 Jul 25 19:43:47.802306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1050/1927] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:47.837687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba4276f9-240f-41cd-9815-c1eed0884cb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:47.851893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ba4276f9-240f-41cd-9815-c1eed0884cb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.127314 Jul 25 19:43:47.852922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 878/1928] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:47 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:48.202079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-99452ee9-c381-48d6-8b17-40c9f34196d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:48.204800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-99452ee9-c381-48d6-8b17-40c9f34196d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:48.212108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99452ee9-c381-48d6-8b17-40c9f34196d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:48.212576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99452ee9-c381-48d6-8b17-40c9f34196d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:48.214149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99452ee9-c381-48d6-8b17-40c9f34196d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:48.214782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99452ee9-c381-48d6-8b17-40c9f34196d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:48.250086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-99452ee9-c381-48d6-8b17-40c9f34196d9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053549 Jul 25 19:43:48.250687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1051/1929] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:48 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:48.835493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62269098-40d5-4254-bd87-3f904797fe39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:48.836308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62269098-40d5-4254-bd87-3f904797fe39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:48.845083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62269098-40d5-4254-bd87-3f904797fe39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:48.845764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62269098-40d5-4254-bd87-3f904797fe39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:48.846885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62269098-40d5-4254-bd87-3f904797fe39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:48.847393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62269098-40d5-4254-bd87-3f904797fe39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:48.884841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e59c2f67-6fae-460e-a5ff-a948e0407ed4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:48.886163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e59c2f67-6fae-460e-a5ff-a948e0407ed4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:48.894027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e59c2f67-6fae-460e-a5ff-a948e0407ed4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:48.894473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e59c2f67-6fae-460e-a5ff-a948e0407ed4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:48.895271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e59c2f67-6fae-460e-a5ff-a948e0407ed4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:48.895765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e59c2f67-6fae-460e-a5ff-a948e0407ed4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:48.922724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62269098-40d5-4254-bd87-3f904797fe39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:48.936911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62269098-40d5-4254-bd87-3f904797fe39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.104965 Jul 25 19:43:48.937869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 879/1930] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:48.986149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e59c2f67-6fae-460e-a5ff-a948e0407ed4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:48.997299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e59c2f67-6fae-460e-a5ff-a948e0407ed4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.114609 Jul 25 19:43:48.997952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1052/1931] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:48 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:49.262980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-69ac0c3e-a8aa-4172-a9f7-75622602d21c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:49.265679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-69ac0c3e-a8aa-4172-a9f7-75622602d21c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:49.272345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69ac0c3e-a8aa-4172-a9f7-75622602d21c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:49.272929 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69ac0c3e-a8aa-4172-a9f7-75622602d21c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:49.273803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69ac0c3e-a8aa-4172-a9f7-75622602d21c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:49.274398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69ac0c3e-a8aa-4172-a9f7-75622602d21c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:49.311544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-69ac0c3e-a8aa-4172-a9f7-75622602d21c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053159 Jul 25 19:43:49.312292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 880/1932] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:49 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:49.964496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-adbb38eb-dd6c-4528-8e2b-5c0adcb3964e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:49.965468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-adbb38eb-dd6c-4528-8e2b-5c0adcb3964e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:49.973158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adbb38eb-dd6c-4528-8e2b-5c0adcb3964e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:49.973606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adbb38eb-dd6c-4528-8e2b-5c0adcb3964e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:49.974391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adbb38eb-dd6c-4528-8e2b-5c0adcb3964e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:49.974825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adbb38eb-dd6c-4528-8e2b-5c0adcb3964e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:50.049620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-adbb38eb-dd6c-4528-8e2b-5c0adcb3964e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:50.058744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-adbb38eb-dd6c-4528-8e2b-5c0adcb3964e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.098771 Jul 25 19:43:50.059357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1053/1933] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:50.074529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-819ff59b-77ad-4039-88cc-b6ad221daeb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:50.075358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-819ff59b-77ad-4039-88cc-b6ad221daeb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:50.082333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-819ff59b-77ad-4039-88cc-b6ad221daeb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:50.082827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-819ff59b-77ad-4039-88cc-b6ad221daeb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:50.083720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-819ff59b-77ad-4039-88cc-b6ad221daeb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:50.084193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-819ff59b-77ad-4039-88cc-b6ad221daeb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:50.177124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-819ff59b-77ad-4039-88cc-b6ad221daeb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:50.187706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-819ff59b-77ad-4039-88cc-b6ad221daeb5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.171752 Jul 25 19:43:50.188477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 881/1934] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:50 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:50.326117 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-95d41a9f-a9a8-4228-addd-e3b57e5dc233 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:50.328979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-95d41a9f-a9a8-4228-addd-e3b57e5dc233 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:50.335478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-95d41a9f-a9a8-4228-addd-e3b57e5dc233 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:50.335960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-95d41a9f-a9a8-4228-addd-e3b57e5dc233 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:50.336783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-95d41a9f-a9a8-4228-addd-e3b57e5dc233 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:50.337227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-95d41a9f-a9a8-4228-addd-e3b57e5dc233 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:50.374225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-95d41a9f-a9a8-4228-addd-e3b57e5dc233 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053690 Jul 25 19:43:50.374981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1054/1935] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:50 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:51.083465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-427147d6-5838-451b-b8b7-a63b5438f4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:51.084114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-427147d6-5838-451b-b8b7-a63b5438f4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:51.092075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-427147d6-5838-451b-b8b7-a63b5438f4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:51.092527 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-427147d6-5838-451b-b8b7-a63b5438f4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:51.093321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-427147d6-5838-451b-b8b7-a63b5438f4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:51.093763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-427147d6-5838-451b-b8b7-a63b5438f4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:51.163794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-427147d6-5838-451b-b8b7-a63b5438f4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:51.173789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-427147d6-5838-451b-b8b7-a63b5438f4b9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094356 Jul 25 19:43:51.174396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 882/1936] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:51.209802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0887d5bc-c58b-4af8-a0ea-4c61b1d178f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:51.210424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0887d5bc-c58b-4af8-a0ea-4c61b1d178f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:51.218597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0887d5bc-c58b-4af8-a0ea-4c61b1d178f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:51.219038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0887d5bc-c58b-4af8-a0ea-4c61b1d178f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:51.219918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0887d5bc-c58b-4af8-a0ea-4c61b1d178f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:51.220356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0887d5bc-c58b-4af8-a0ea-4c61b1d178f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:51.299875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0887d5bc-c58b-4af8-a0ea-4c61b1d178f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:51.309562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0887d5bc-c58b-4af8-a0ea-4c61b1d178f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.103606 Jul 25 19:43:51.310198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1055/1937] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:51 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:51.388238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74d41d5f-66a7-4dfc-8fe3-a76107158be5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:51.390761 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-74d41d5f-66a7-4dfc-8fe3-a76107158be5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:51.397443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74d41d5f-66a7-4dfc-8fe3-a76107158be5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:51.397887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74d41d5f-66a7-4dfc-8fe3-a76107158be5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:51.398679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74d41d5f-66a7-4dfc-8fe3-a76107158be5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:51.399114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74d41d5f-66a7-4dfc-8fe3-a76107158be5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:51.440518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74d41d5f-66a7-4dfc-8fe3-a76107158be5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056855 Jul 25 19:43:51.443978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 883/1938] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:51 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:52.197276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9cf79897-556a-46c1-9687-04249ebd4501 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:52.199227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9cf79897-556a-46c1-9687-04249ebd4501 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:52.206902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cf79897-556a-46c1-9687-04249ebd4501 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:52.207355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cf79897-556a-46c1-9687-04249ebd4501 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:52.208411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cf79897-556a-46c1-9687-04249ebd4501 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:52.208912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9cf79897-556a-46c1-9687-04249ebd4501 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:52.283489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9cf79897-556a-46c1-9687-04249ebd4501 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:52.294549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9cf79897-556a-46c1-9687-04249ebd4501 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.101469 Jul 25 19:43:52.295203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1056/1939] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:52 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:52.331723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-640a2684-30fb-47a7-85d4-513abddf1a2a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:52.332461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-640a2684-30fb-47a7-85d4-513abddf1a2a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:52.340762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-640a2684-30fb-47a7-85d4-513abddf1a2a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:52.341206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-640a2684-30fb-47a7-85d4-513abddf1a2a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:52.341993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-640a2684-30fb-47a7-85d4-513abddf1a2a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:52.342462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-640a2684-30fb-47a7-85d4-513abddf1a2a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:52.417582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-640a2684-30fb-47a7-85d4-513abddf1a2a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:52.426826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-640a2684-30fb-47a7-85d4-513abddf1a2a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.099496 Jul 25 19:43:52.427412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 884/1940] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:52 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:52.459365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-de3ee682-f618-43eb-9200-711d9d70daa3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:52.461883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-de3ee682-f618-43eb-9200-711d9d70daa3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:52.469012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3ee682-f618-43eb-9200-711d9d70daa3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:52.469486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3ee682-f618-43eb-9200-711d9d70daa3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:52.470336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3ee682-f618-43eb-9200-711d9d70daa3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:52.470781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-de3ee682-f618-43eb-9200-711d9d70daa3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:52.506929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-de3ee682-f618-43eb-9200-711d9d70daa3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052131 Jul 25 19:43:52.507566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1057/1941] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:53.317051 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3563ac0d-dcf3-42f7-b6d4-ad59cc9dcf1c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:53.317744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3563ac0d-dcf3-42f7-b6d4-ad59cc9dcf1c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:53.324929 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3563ac0d-dcf3-42f7-b6d4-ad59cc9dcf1c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:53.325616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3563ac0d-dcf3-42f7-b6d4-ad59cc9dcf1c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:53.326411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3563ac0d-dcf3-42f7-b6d4-ad59cc9dcf1c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:53.327012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3563ac0d-dcf3-42f7-b6d4-ad59cc9dcf1c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:53.397429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3563ac0d-dcf3-42f7-b6d4-ad59cc9dcf1c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:53.406523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3563ac0d-dcf3-42f7-b6d4-ad59cc9dcf1c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.093247 Jul 25 19:43:53.407545 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 885/1942] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:53.450467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2b7ecafd-189b-40cc-8f95-5e0e5e73e1ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:53.451321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2b7ecafd-189b-40cc-8f95-5e0e5e73e1ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:53.458168 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b7ecafd-189b-40cc-8f95-5e0e5e73e1ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:53.458661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b7ecafd-189b-40cc-8f95-5e0e5e73e1ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:53.459484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b7ecafd-189b-40cc-8f95-5e0e5e73e1ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:53.460023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2b7ecafd-189b-40cc-8f95-5e0e5e73e1ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:53.521177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-57988888-4c23-41c3-bc52-0c80c8cb7959 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:53.523882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-57988888-4c23-41c3-bc52-0c80c8cb7959 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:53.532150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57988888-4c23-41c3-bc52-0c80c8cb7959 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:53.532700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57988888-4c23-41c3-bc52-0c80c8cb7959 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:53.533634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57988888-4c23-41c3-bc52-0c80c8cb7959 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:53.534134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57988888-4c23-41c3-bc52-0c80c8cb7959 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:53.554186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2b7ecafd-189b-40cc-8f95-5e0e5e73e1ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:53.568123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2b7ecafd-189b-40cc-8f95-5e0e5e73e1ed tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.122340 Jul 25 19:43:53.569079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1058/1943] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:53 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:53.579938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-57988888-4c23-41c3-bc52-0c80c8cb7959 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062831 Jul 25 19:43:53.580752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 886/1944] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:53 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:54.429736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ca388437-e390-4288-bb9f-ee6099ad5362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:54.430240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ca388437-e390-4288-bb9f-ee6099ad5362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:54.438274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca388437-e390-4288-bb9f-ee6099ad5362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:54.438719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca388437-e390-4288-bb9f-ee6099ad5362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:54.439545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca388437-e390-4288-bb9f-ee6099ad5362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:54.440068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ca388437-e390-4288-bb9f-ee6099ad5362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:54.514282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ca388437-e390-4288-bb9f-ee6099ad5362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:54.525926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ca388437-e390-4288-bb9f-ee6099ad5362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.100281 Jul 25 19:43:54.529060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1059/1945] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:54.595078 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da114c59-b1b0-47ea-ab36-12973dea2820 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:54.596045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da114c59-b1b0-47ea-ab36-12973dea2820 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:54.596903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4e733347-83e8-4a65-bfc9-49335701c4ec tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:54.600400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4e733347-83e8-4a65-bfc9-49335701c4ec tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:54.608426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da114c59-b1b0-47ea-ab36-12973dea2820 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:54.608771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e733347-83e8-4a65-bfc9-49335701c4ec tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:54.608953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da114c59-b1b0-47ea-ab36-12973dea2820 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:54.609115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e733347-83e8-4a65-bfc9-49335701c4ec tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:54.609921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da114c59-b1b0-47ea-ab36-12973dea2820 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:54.610105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e733347-83e8-4a65-bfc9-49335701c4ec tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:54.610359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da114c59-b1b0-47ea-ab36-12973dea2820 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:54.610532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e733347-83e8-4a65-bfc9-49335701c4ec tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:54.645884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4e733347-83e8-4a65-bfc9-49335701c4ec tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055852 Jul 25 19:43:54.646518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1060/1946] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:54 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:54.688591 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-da114c59-b1b0-47ea-ab36-12973dea2820 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:54.697413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da114c59-b1b0-47ea-ab36-12973dea2820 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.108051 Jul 25 19:43:54.699810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 887/1947] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:54 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:55.549060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c8079e17-55e9-4467-b8c8-8fbf1b4ca1b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:55.549680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c8079e17-55e9-4467-b8c8-8fbf1b4ca1b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:55.558123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8079e17-55e9-4467-b8c8-8fbf1b4ca1b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:55.558775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8079e17-55e9-4467-b8c8-8fbf1b4ca1b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:55.559781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8079e17-55e9-4467-b8c8-8fbf1b4ca1b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:55.560329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8079e17-55e9-4467-b8c8-8fbf1b4ca1b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:55.629670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c8079e17-55e9-4467-b8c8-8fbf1b4ca1b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:55.640786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c8079e17-55e9-4467-b8c8-8fbf1b4ca1b0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095645 Jul 25 19:43:55.641423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1061/1948] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:55.661459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-702bd41f-f1ec-4ba0-9eca-e6422d4bf6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:55.663794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-702bd41f-f1ec-4ba0-9eca-e6422d4bf6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:55.672104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-702bd41f-f1ec-4ba0-9eca-e6422d4bf6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:55.672557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-702bd41f-f1ec-4ba0-9eca-e6422d4bf6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:55.673523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-702bd41f-f1ec-4ba0-9eca-e6422d4bf6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:55.673873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-702bd41f-f1ec-4ba0-9eca-e6422d4bf6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:55.710730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-702bd41f-f1ec-4ba0-9eca-e6422d4bf6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054798 Jul 25 19:43:55.711328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 888/1949] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:55 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:55.724940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e33392da-bfff-4898-a839-6b0efc122805 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:55.726051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e33392da-bfff-4898-a839-6b0efc122805 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:55.736933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e33392da-bfff-4898-a839-6b0efc122805 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:55.737694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e33392da-bfff-4898-a839-6b0efc122805 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:55.739019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e33392da-bfff-4898-a839-6b0efc122805 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:55.739838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e33392da-bfff-4898-a839-6b0efc122805 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:55.823170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e33392da-bfff-4898-a839-6b0efc122805 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:55.831649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e33392da-bfff-4898-a839-6b0efc122805 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.113727 Jul 25 19:43:55.832246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1062/1950] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:55 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:56.667459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-491b3f7d-c132-4448-b65f-8ba24ad99511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:56.668533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-491b3f7d-c132-4448-b65f-8ba24ad99511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:56.676149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-491b3f7d-c132-4448-b65f-8ba24ad99511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:56.676604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-491b3f7d-c132-4448-b65f-8ba24ad99511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:56.677397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-491b3f7d-c132-4448-b65f-8ba24ad99511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:56.677870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-491b3f7d-c132-4448-b65f-8ba24ad99511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:56.724411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-31e66da2-e2f3-4f76-8074-246443016b8e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:56.727470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-31e66da2-e2f3-4f76-8074-246443016b8e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:56.738472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31e66da2-e2f3-4f76-8074-246443016b8e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:56.738927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31e66da2-e2f3-4f76-8074-246443016b8e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:56.739910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31e66da2-e2f3-4f76-8074-246443016b8e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:56.740211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31e66da2-e2f3-4f76-8074-246443016b8e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:56.750008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-491b3f7d-c132-4448-b65f-8ba24ad99511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:56.758959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-491b3f7d-c132-4448-b65f-8ba24ad99511 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.096228 Jul 25 19:43:56.759584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 889/1951] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:56.771562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:56.777833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-31e66da2-e2f3-4f76-8074-246443016b8e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058182 Jul 25 19:43:56.778428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1063/1952] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:56 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:56.854131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-70c52f49-5667-4500-aa33-11ab15952541 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:56.855298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-70c52f49-5667-4500-aa33-11ab15952541 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:56.862144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70c52f49-5667-4500-aa33-11ab15952541 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:56.862590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70c52f49-5667-4500-aa33-11ab15952541 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:56.863367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70c52f49-5667-4500-aa33-11ab15952541 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:56.863831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70c52f49-5667-4500-aa33-11ab15952541 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:56.931260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-70c52f49-5667-4500-aa33-11ab15952541 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:56.940799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-70c52f49-5667-4500-aa33-11ab15952541 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.090885 Jul 25 19:43:56.941387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 890/1953] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:56 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:57.789508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0fec9fd4-1db1-49ad-9a3d-c8e371e4a7d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:57.790228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0fec9fd4-1db1-49ad-9a3d-c8e371e4a7d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:57.793876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1bf08acc-1440-475b-bbaa-53fd4af3af2b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:57.797873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1bf08acc-1440-475b-bbaa-53fd4af3af2b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:57.798641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0fec9fd4-1db1-49ad-9a3d-c8e371e4a7d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:57.799083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0fec9fd4-1db1-49ad-9a3d-c8e371e4a7d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:57.799904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0fec9fd4-1db1-49ad-9a3d-c8e371e4a7d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:57.800339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0fec9fd4-1db1-49ad-9a3d-c8e371e4a7d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:57.808508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bf08acc-1440-475b-bbaa-53fd4af3af2b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:57.809215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bf08acc-1440-475b-bbaa-53fd4af3af2b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:57.810507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bf08acc-1440-475b-bbaa-53fd4af3af2b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:57.811330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bf08acc-1440-475b-bbaa-53fd4af3af2b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:57.862938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1bf08acc-1440-475b-bbaa-53fd4af3af2b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076370 Jul 25 19:43:57.863569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 891/1954] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:57 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:43:57.874891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0fec9fd4-1db1-49ad-9a3d-c8e371e4a7d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:57.887134 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0fec9fd4-1db1-49ad-9a3d-c8e371e4a7d0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.102145 Jul 25 19:43:57.887936 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1064/1955] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:57.961991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc76b680-e617-4ad0-8fbd-b22ca80256c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:57.962660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cc76b680-e617-4ad0-8fbd-b22ca80256c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:57.970251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc76b680-e617-4ad0-8fbd-b22ca80256c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:57.970698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc76b680-e617-4ad0-8fbd-b22ca80256c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:57.971478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc76b680-e617-4ad0-8fbd-b22ca80256c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:57.971934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc76b680-e617-4ad0-8fbd-b22ca80256c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:58.047558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cc76b680-e617-4ad0-8fbd-b22ca80256c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:58.055684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cc76b680-e617-4ad0-8fbd-b22ca80256c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.097496 Jul 25 19:43:58.056286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 892/1956] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:57 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:43:58.876806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2f36bf98-7858-4859-9ce6-74185b85dc71 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:58.879477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2f36bf98-7858-4859-9ce6-74185b85dc71 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:58.886815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f36bf98-7858-4859-9ce6-74185b85dc71 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:58.887256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f36bf98-7858-4859-9ce6-74185b85dc71 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:58.888057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f36bf98-7858-4859-9ce6-74185b85dc71 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:58.888518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f36bf98-7858-4859-9ce6-74185b85dc71 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:58.910033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-951bc703-a2ff-4caa-b03c-815234c039fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:58.910688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-951bc703-a2ff-4caa-b03c-815234c039fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:58.917768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-951bc703-a2ff-4caa-b03c-815234c039fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:58.918196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-951bc703-a2ff-4caa-b03c-815234c039fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:58.918964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-951bc703-a2ff-4caa-b03c-815234c039fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:58.919402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-951bc703-a2ff-4caa-b03c-815234c039fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:58.921362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2f36bf98-7858-4859-9ce6-74185b85dc71 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049092 Jul 25 19:43:58.921945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1065/1957] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:58 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:43:58.925733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:43:58.994129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-951bc703-a2ff-4caa-b03c-815234c039fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:59.003456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-951bc703-a2ff-4caa-b03c-815234c039fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.097284 Jul 25 19:43:59.004075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 893/1958] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:59.081641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-32de8a6d-ff70-477c-831b-14de55c99163 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:59.082245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-32de8a6d-ff70-477c-831b-14de55c99163 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:59.089018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32de8a6d-ff70-477c-831b-14de55c99163 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:59.089598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32de8a6d-ff70-477c-831b-14de55c99163 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:59.090382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32de8a6d-ff70-477c-831b-14de55c99163 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:59.090825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32de8a6d-ff70-477c-831b-14de55c99163 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:59.157153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-32de8a6d-ff70-477c-831b-14de55c99163 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:43:59.164889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-32de8a6d-ff70-477c-831b-14de55c99163 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.086981 Jul 25 19:43:59.165479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1066/1959] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:43:59 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:43:59.939036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-54e55bb6-89f4-4e57-8919-4c640868d928 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:43:59.942817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-54e55bb6-89f4-4e57-8919-4c640868d928 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:43:59.955408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54e55bb6-89f4-4e57-8919-4c640868d928 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:59.956120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54e55bb6-89f4-4e57-8919-4c640868d928 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:59.957065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54e55bb6-89f4-4e57-8919-4c640868d928 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:43:59.957511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54e55bb6-89f4-4e57-8919-4c640868d928 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:43:59.989736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-54e55bb6-89f4-4e57-8919-4c640868d928 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059013 Jul 25 19:43:59.990451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 894/1960] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:43:59 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:00.025191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-44d068b1-5dde-4bbf-81c7-afead9fcb430 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:00.026471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-44d068b1-5dde-4bbf-81c7-afead9fcb430 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:00.033246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44d068b1-5dde-4bbf-81c7-afead9fcb430 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:00.033696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44d068b1-5dde-4bbf-81c7-afead9fcb430 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:00.034462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44d068b1-5dde-4bbf-81c7-afead9fcb430 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:00.034903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44d068b1-5dde-4bbf-81c7-afead9fcb430 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:00.102754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-44d068b1-5dde-4bbf-81c7-afead9fcb430 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:00.111668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-44d068b1-5dde-4bbf-81c7-afead9fcb430 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090347 Jul 25 19:44:00.112254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1067/1961] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:00.187883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-02fb7517-ca1b-4590-a00d-c01142a27afc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:00.188794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-02fb7517-ca1b-4590-a00d-c01142a27afc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:00.195806 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02fb7517-ca1b-4590-a00d-c01142a27afc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:00.196169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02fb7517-ca1b-4590-a00d-c01142a27afc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:00.196959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02fb7517-ca1b-4590-a00d-c01142a27afc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:00.197934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02fb7517-ca1b-4590-a00d-c01142a27afc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:00.277799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-02fb7517-ca1b-4590-a00d-c01142a27afc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:00.285869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-02fb7517-ca1b-4590-a00d-c01142a27afc tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.102342 Jul 25 19:44:00.286489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 895/1962] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:00 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:01.004176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9c42fff3-892e-45a4-9538-ed905d8012f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:01.006871 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9c42fff3-892e-45a4-9538-ed905d8012f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:01.014271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c42fff3-892e-45a4-9538-ed905d8012f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:01.014840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c42fff3-892e-45a4-9538-ed905d8012f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:01.016171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c42fff3-892e-45a4-9538-ed905d8012f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:01.016832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c42fff3-892e-45a4-9538-ed905d8012f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:01.063972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9c42fff3-892e-45a4-9538-ed905d8012f0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064614 Jul 25 19:44:01.064799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1068/1963] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:00 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:01.133368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5c631714-fa84-47d9-aaf5-2991c3ee6d9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:01.134261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5c631714-fa84-47d9-aaf5-2991c3ee6d9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:01.142473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5c631714-fa84-47d9-aaf5-2991c3ee6d9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:01.143028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5c631714-fa84-47d9-aaf5-2991c3ee6d9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:01.144439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5c631714-fa84-47d9-aaf5-2991c3ee6d9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:01.145209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5c631714-fa84-47d9-aaf5-2991c3ee6d9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:01.233236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5c631714-fa84-47d9-aaf5-2991c3ee6d9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:01.243336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5c631714-fa84-47d9-aaf5-2991c3ee6d9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.113844 Jul 25 19:44:01.244079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 896/1964] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:01.308935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-57d961a5-1baa-4d0e-8c9a-22f4f1cc5a75 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:01.309545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-57d961a5-1baa-4d0e-8c9a-22f4f1cc5a75 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:01.325848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57d961a5-1baa-4d0e-8c9a-22f4f1cc5a75 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:01.326300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57d961a5-1baa-4d0e-8c9a-22f4f1cc5a75 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:01.327089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57d961a5-1baa-4d0e-8c9a-22f4f1cc5a75 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:01.327555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57d961a5-1baa-4d0e-8c9a-22f4f1cc5a75 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:01.404202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-57d961a5-1baa-4d0e-8c9a-22f4f1cc5a75 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:01.413060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-57d961a5-1baa-4d0e-8c9a-22f4f1cc5a75 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.108793 Jul 25 19:44:01.413726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1069/1965] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:01 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:02.077873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fef18299-b32f-4d0b-8aa4-ec9d4c232975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:02.080085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fef18299-b32f-4d0b-8aa4-ec9d4c232975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:02.086275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fef18299-b32f-4d0b-8aa4-ec9d4c232975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:02.086716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fef18299-b32f-4d0b-8aa4-ec9d4c232975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:02.087478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fef18299-b32f-4d0b-8aa4-ec9d4c232975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:02.087935 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fef18299-b32f-4d0b-8aa4-ec9d4c232975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:02.117977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fef18299-b32f-4d0b-8aa4-ec9d4c232975 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Jul 25 19:44:02.118456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 897/1966] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:02 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:02.269665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-28bc244d-3665-4c17-a4ae-1aeb3692534e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:02.269665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-28bc244d-3665-4c17-a4ae-1aeb3692534e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:02.276885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28bc244d-3665-4c17-a4ae-1aeb3692534e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:02.277327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28bc244d-3665-4c17-a4ae-1aeb3692534e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:02.278112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28bc244d-3665-4c17-a4ae-1aeb3692534e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:02.278543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28bc244d-3665-4c17-a4ae-1aeb3692534e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:02.349511 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-28bc244d-3665-4c17-a4ae-1aeb3692534e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:02.364682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-28bc244d-3665-4c17-a4ae-1aeb3692534e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.101535 Jul 25 19:44:02.365749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1070/1967] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:02.441480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8163fbd4-e6fc-41c5-bc06-4aafbf5861e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:02.442069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8163fbd4-e6fc-41c5-bc06-4aafbf5861e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:02.449736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8163fbd4-e6fc-41c5-bc06-4aafbf5861e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:02.450179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8163fbd4-e6fc-41c5-bc06-4aafbf5861e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:02.451918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8163fbd4-e6fc-41c5-bc06-4aafbf5861e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:02.451918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8163fbd4-e6fc-41c5-bc06-4aafbf5861e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:02.524693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8163fbd4-e6fc-41c5-bc06-4aafbf5861e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:02.532741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8163fbd4-e6fc-41c5-bc06-4aafbf5861e8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.095139 Jul 25 19:44:02.533345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 898/1968] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:02 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:03.130858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-259310a4-922b-4af0-b0a8-31c9960125be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:03.133202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-259310a4-922b-4af0-b0a8-31c9960125be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:03.141000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-259310a4-922b-4af0-b0a8-31c9960125be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:03.141452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-259310a4-922b-4af0-b0a8-31c9960125be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:03.142246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-259310a4-922b-4af0-b0a8-31c9960125be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:03.142688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-259310a4-922b-4af0-b0a8-31c9960125be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:03.177201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-259310a4-922b-4af0-b0a8-31c9960125be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050400 Jul 25 19:44:03.178100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1071/1969] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:03 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:03.388524 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bcabef4b-92a2-4d4e-a715-b4fe7415f61e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:03.389074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bcabef4b-92a2-4d4e-a715-b4fe7415f61e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:03.397707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcabef4b-92a2-4d4e-a715-b4fe7415f61e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:03.398506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcabef4b-92a2-4d4e-a715-b4fe7415f61e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:03.399902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcabef4b-92a2-4d4e-a715-b4fe7415f61e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:03.401190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcabef4b-92a2-4d4e-a715-b4fe7415f61e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:03.483047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bcabef4b-92a2-4d4e-a715-b4fe7415f61e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:03.492016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bcabef4b-92a2-4d4e-a715-b4fe7415f61e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.108490 Jul 25 19:44:03.492610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 899/1970] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:03 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:03.554693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3de4b822-769d-4fa5-a519-e703c25666dd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:03.555434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3de4b822-769d-4fa5-a519-e703c25666dd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:03.564318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3de4b822-769d-4fa5-a519-e703c25666dd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:03.564770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3de4b822-769d-4fa5-a519-e703c25666dd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:03.565703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3de4b822-769d-4fa5-a519-e703c25666dd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:03.566152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3de4b822-769d-4fa5-a519-e703c25666dd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:03.636029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3de4b822-769d-4fa5-a519-e703c25666dd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:03.645931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3de4b822-769d-4fa5-a519-e703c25666dd tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.095237 Jul 25 19:44:03.646412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1072/1971] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:03 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:04.193100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc26b95b-b8b2-4b35-8e5a-73d2950b4db2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:04.195397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cc26b95b-b8b2-4b35-8e5a-73d2950b4db2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:04.202819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc26b95b-b8b2-4b35-8e5a-73d2950b4db2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:04.203310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc26b95b-b8b2-4b35-8e5a-73d2950b4db2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:04.204167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc26b95b-b8b2-4b35-8e5a-73d2950b4db2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:04.204650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc26b95b-b8b2-4b35-8e5a-73d2950b4db2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:04.239327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cc26b95b-b8b2-4b35-8e5a-73d2950b4db2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050207 Jul 25 19:44:04.240043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 900/1972] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:04 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:04.516575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-03897228-f4ac-4eea-9429-6d0ef49fde8b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:04.517195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-03897228-f4ac-4eea-9429-6d0ef49fde8b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:04.523486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03897228-f4ac-4eea-9429-6d0ef49fde8b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:04.523975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03897228-f4ac-4eea-9429-6d0ef49fde8b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:04.524763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03897228-f4ac-4eea-9429-6d0ef49fde8b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:04.525205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03897228-f4ac-4eea-9429-6d0ef49fde8b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:04.593108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-03897228-f4ac-4eea-9429-6d0ef49fde8b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:04.602042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-03897228-f4ac-4eea-9429-6d0ef49fde8b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089210 Jul 25 19:44:04.602641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1073/1973] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:04.670842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc959afb-f1f2-4c29-8513-45c3ccd228b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:04.671480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cc959afb-f1f2-4c29-8513-45c3ccd228b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:04.678462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc959afb-f1f2-4c29-8513-45c3ccd228b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:04.678918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc959afb-f1f2-4c29-8513-45c3ccd228b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:04.679825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc959afb-f1f2-4c29-8513-45c3ccd228b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:04.680271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc959afb-f1f2-4c29-8513-45c3ccd228b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:04.772936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cc959afb-f1f2-4c29-8513-45c3ccd228b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:04.782276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cc959afb-f1f2-4c29-8513-45c3ccd228b9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.115336 Jul 25 19:44:04.782885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 901/1974] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:04 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:05.252657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6929ae6b-fe62-4cbe-9641-4ee5ad7c7e0a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:05.254897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6929ae6b-fe62-4cbe-9641-4ee5ad7c7e0a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:05.262163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6929ae6b-fe62-4cbe-9641-4ee5ad7c7e0a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:05.262625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6929ae6b-fe62-4cbe-9641-4ee5ad7c7e0a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:05.263882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6929ae6b-fe62-4cbe-9641-4ee5ad7c7e0a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:05.264348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6929ae6b-fe62-4cbe-9641-4ee5ad7c7e0a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:05.304815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6929ae6b-fe62-4cbe-9641-4ee5ad7c7e0a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056174 Jul 25 19:44:05.305404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1074/1975] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:05 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:05.624835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5b6967fd-c03c-4665-bfa2-de9b9ab854c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:05.625444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5b6967fd-c03c-4665-bfa2-de9b9ab854c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:05.632015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b6967fd-c03c-4665-bfa2-de9b9ab854c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:05.632585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b6967fd-c03c-4665-bfa2-de9b9ab854c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:05.633504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b6967fd-c03c-4665-bfa2-de9b9ab854c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:05.633978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b6967fd-c03c-4665-bfa2-de9b9ab854c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:05.706010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5b6967fd-c03c-4665-bfa2-de9b9ab854c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:05.714885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5b6967fd-c03c-4665-bfa2-de9b9ab854c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.093888 Jul 25 19:44:05.715483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 902/1976] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:05.802217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5e863309-e915-46ec-aa9b-80a6202aad7a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:05.802816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5e863309-e915-46ec-aa9b-80a6202aad7a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:05.805236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=82 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:05.812441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e863309-e915-46ec-aa9b-80a6202aad7a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:05.812836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e863309-e915-46ec-aa9b-80a6202aad7a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:05.813621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e863309-e915-46ec-aa9b-80a6202aad7a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:05.814064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e863309-e915-46ec-aa9b-80a6202aad7a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:05.895176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5e863309-e915-46ec-aa9b-80a6202aad7a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:05.910331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5e863309-e915-46ec-aa9b-80a6202aad7a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.111479 Jul 25 19:44:05.911412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1075/1977] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:05 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:06.317837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0e054af8-7f31-4913-a1bd-c6883bedc137 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:06.320299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0e054af8-7f31-4913-a1bd-c6883bedc137 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:06.327775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e054af8-7f31-4913-a1bd-c6883bedc137 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:06.328186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e054af8-7f31-4913-a1bd-c6883bedc137 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:06.328966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e054af8-7f31-4913-a1bd-c6883bedc137 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:06.329398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e054af8-7f31-4913-a1bd-c6883bedc137 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:06.367721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0e054af8-7f31-4913-a1bd-c6883bedc137 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054033 Jul 25 19:44:06.368317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 903/1978] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:06 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:06.736749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9de9b48a-da15-4444-9b37-0a277967ef81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:06.737448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9de9b48a-da15-4444-9b37-0a277967ef81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:06.745338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9de9b48a-da15-4444-9b37-0a277967ef81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:06.745846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9de9b48a-da15-4444-9b37-0a277967ef81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:06.746677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9de9b48a-da15-4444-9b37-0a277967ef81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:06.747152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9de9b48a-da15-4444-9b37-0a277967ef81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:06.814965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9de9b48a-da15-4444-9b37-0a277967ef81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:06.824600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9de9b48a-da15-4444-9b37-0a277967ef81 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092047 Jul 25 19:44:06.825292 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1076/1979] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:06.933359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0f343acb-854a-4d35-bb88-e31870d504ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:06.933994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0f343acb-854a-4d35-bb88-e31870d504ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:06.936611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=84 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:06.942612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f343acb-854a-4d35-bb88-e31870d504ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:06.943144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f343acb-854a-4d35-bb88-e31870d504ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:06.944042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f343acb-854a-4d35-bb88-e31870d504ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:06.944599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f343acb-854a-4d35-bb88-e31870d504ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:07.017529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f343acb-854a-4d35-bb88-e31870d504ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:07.026485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0f343acb-854a-4d35-bb88-e31870d504ca tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.097296 Jul 25 19:44:07.027278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 904/1980] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:06 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:07.381040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-28305ab3-c22d-4afc-84d3-5ecf3b333694 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:07.383314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-28305ab3-c22d-4afc-84d3-5ecf3b333694 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:07.392438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28305ab3-c22d-4afc-84d3-5ecf3b333694 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:07.392937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28305ab3-c22d-4afc-84d3-5ecf3b333694 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:07.393734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28305ab3-c22d-4afc-84d3-5ecf3b333694 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:07.394175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28305ab3-c22d-4afc-84d3-5ecf3b333694 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:07.435562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-28305ab3-c22d-4afc-84d3-5ecf3b333694 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058054 Jul 25 19:44:07.436260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1077/1981] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:07 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:07.846988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13ae19a2-2be8-42c3-9027-c54789d51bf3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:07.847625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-13ae19a2-2be8-42c3-9027-c54789d51bf3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:07.857368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13ae19a2-2be8-42c3-9027-c54789d51bf3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:07.857889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13ae19a2-2be8-42c3-9027-c54789d51bf3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:07.858730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13ae19a2-2be8-42c3-9027-c54789d51bf3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:07.859210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13ae19a2-2be8-42c3-9027-c54789d51bf3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:07.929628 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-13ae19a2-2be8-42c3-9027-c54789d51bf3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:07.939722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13ae19a2-2be8-42c3-9027-c54789d51bf3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.096589 Jul 25 19:44:07.940475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 905/1982] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:08.049529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1bea3407-205d-4b58-9f46-0b495015cb01 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:08.050238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1bea3407-205d-4b58-9f46-0b495015cb01 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:08.058423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1bea3407-205d-4b58-9f46-0b495015cb01 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:08.058926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1bea3407-205d-4b58-9f46-0b495015cb01 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:08.059902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1bea3407-205d-4b58-9f46-0b495015cb01 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:08.060368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1bea3407-205d-4b58-9f46-0b495015cb01 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:08.130802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1bea3407-205d-4b58-9f46-0b495015cb01 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:08.139943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1bea3407-205d-4b58-9f46-0b495015cb01 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.095443 Jul 25 19:44:08.140535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1078/1983] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:08 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:08.450889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b79c4c1e-cba1-4d69-b09d-32f62e1c6194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:08.453041 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b79c4c1e-cba1-4d69-b09d-32f62e1c6194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:08.460675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b79c4c1e-cba1-4d69-b09d-32f62e1c6194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:08.461242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b79c4c1e-cba1-4d69-b09d-32f62e1c6194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:08.462144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b79c4c1e-cba1-4d69-b09d-32f62e1c6194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:08.462681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b79c4c1e-cba1-4d69-b09d-32f62e1c6194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:08.494432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b79c4c1e-cba1-4d69-b09d-32f62e1c6194 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048914 Jul 25 19:44:08.495021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 906/1984] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:08 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:08.973102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6d0c7182-b99c-4ba0-ad58-ff5063e05373 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:08.973716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6d0c7182-b99c-4ba0-ad58-ff5063e05373 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:08.981457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6d0c7182-b99c-4ba0-ad58-ff5063e05373 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:08.982208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6d0c7182-b99c-4ba0-ad58-ff5063e05373 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:08.983242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6d0c7182-b99c-4ba0-ad58-ff5063e05373 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:08.983900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6d0c7182-b99c-4ba0-ad58-ff5063e05373 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:09.050788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6d0c7182-b99c-4ba0-ad58-ff5063e05373 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:09.060612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6d0c7182-b99c-4ba0-ad58-ff5063e05373 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.091462 Jul 25 19:44:09.061207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1079/1985] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:09.168147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d6764766-fd5c-41db-8ee4-0e1f2676a990 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:09.169235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d6764766-fd5c-41db-8ee4-0e1f2676a990 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:09.181104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6764766-fd5c-41db-8ee4-0e1f2676a990 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:09.183137 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6764766-fd5c-41db-8ee4-0e1f2676a990 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:09.184694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6764766-fd5c-41db-8ee4-0e1f2676a990 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:09.185485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6764766-fd5c-41db-8ee4-0e1f2676a990 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:09.261460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6764766-fd5c-41db-8ee4-0e1f2676a990 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:09.270307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d6764766-fd5c-41db-8ee4-0e1f2676a990 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.111218 Jul 25 19:44:09.270953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 907/1986] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:09 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:09.507826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c6ba0957-6e61-49f8-9d08-55bea5d560c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:09.510768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c6ba0957-6e61-49f8-9d08-55bea5d560c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:09.517149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c6ba0957-6e61-49f8-9d08-55bea5d560c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:09.517590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c6ba0957-6e61-49f8-9d08-55bea5d560c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:09.518365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c6ba0957-6e61-49f8-9d08-55bea5d560c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:09.518795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c6ba0957-6e61-49f8-9d08-55bea5d560c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:09.538343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:09.554548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c6ba0957-6e61-49f8-9d08-55bea5d560c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051018 Jul 25 19:44:09.555275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1080/1987] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:09 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:10.082570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c5f010a3-5775-449d-af2b-63ef62e36df8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:10.083209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c5f010a3-5775-449d-af2b-63ef62e36df8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:10.091071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5f010a3-5775-449d-af2b-63ef62e36df8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:10.091541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5f010a3-5775-449d-af2b-63ef62e36df8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:10.092340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5f010a3-5775-449d-af2b-63ef62e36df8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:10.092782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5f010a3-5775-449d-af2b-63ef62e36df8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:10.162542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c5f010a3-5775-449d-af2b-63ef62e36df8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:10.174086 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c5f010a3-5775-449d-af2b-63ef62e36df8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095288 Jul 25 19:44:10.174815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 908/1988] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:10.292419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-282b82cf-7493-4bcf-8940-7f80983d823a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:10.293233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-282b82cf-7493-4bcf-8940-7f80983d823a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:10.299986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-282b82cf-7493-4bcf-8940-7f80983d823a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:10.300428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-282b82cf-7493-4bcf-8940-7f80983d823a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:10.301196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-282b82cf-7493-4bcf-8940-7f80983d823a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:10.301627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-282b82cf-7493-4bcf-8940-7f80983d823a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:10.372969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-282b82cf-7493-4bcf-8940-7f80983d823a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:10.390395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-282b82cf-7493-4bcf-8940-7f80983d823a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.099277 Jul 25 19:44:10.390395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1081/1989] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:10 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:10.573313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4558cd0f-d323-475a-b477-7b9a3cffdf5e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:10.576875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4558cd0f-d323-475a-b477-7b9a3cffdf5e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:10.586748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4558cd0f-d323-475a-b477-7b9a3cffdf5e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:10.587298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4558cd0f-d323-475a-b477-7b9a3cffdf5e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:10.589058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4558cd0f-d323-475a-b477-7b9a3cffdf5e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:10.589507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4558cd0f-d323-475a-b477-7b9a3cffdf5e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:10.618916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:10.625306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4558cd0f-d323-475a-b477-7b9a3cffdf5e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059491 Jul 25 19:44:10.625897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 909/1990] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:10 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:11.198760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3dc3a942-0a73-4d7e-9ec7-7677a5690cfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:11.199727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3dc3a942-0a73-4d7e-9ec7-7677a5690cfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:11.206934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3dc3a942-0a73-4d7e-9ec7-7677a5690cfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:11.207395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3dc3a942-0a73-4d7e-9ec7-7677a5690cfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:11.208218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3dc3a942-0a73-4d7e-9ec7-7677a5690cfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:11.208658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3dc3a942-0a73-4d7e-9ec7-7677a5690cfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:11.279543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3dc3a942-0a73-4d7e-9ec7-7677a5690cfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:11.288201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3dc3a942-0a73-4d7e-9ec7-7677a5690cfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.093706 Jul 25 19:44:11.288805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1082/1991] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:11 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:11.410500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a23129ab-90b7-48b9-b8ff-32ddff17bbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:11.411147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a23129ab-90b7-48b9-b8ff-32ddff17bbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:11.418864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23129ab-90b7-48b9-b8ff-32ddff17bbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:11.419360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23129ab-90b7-48b9-b8ff-32ddff17bbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:11.420259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23129ab-90b7-48b9-b8ff-32ddff17bbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:11.420738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23129ab-90b7-48b9-b8ff-32ddff17bbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:11.643248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b79f6936-cee7-44fd-be81-acca711125d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:11.646201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b79f6936-cee7-44fd-be81-acca711125d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:11.656002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b79f6936-cee7-44fd-be81-acca711125d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:11.656618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b79f6936-cee7-44fd-be81-acca711125d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:11.657710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b79f6936-cee7-44fd-be81-acca711125d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:11.658216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b79f6936-cee7-44fd-be81-acca711125d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:11.704010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b79f6936-cee7-44fd-be81-acca711125d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064891 Jul 25 19:44:11.704801 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1083/1992] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:11 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:11.775914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a23129ab-90b7-48b9-b8ff-32ddff17bbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:11.784568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a23129ab-90b7-48b9-b8ff-32ddff17bbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.377992 Jul 25 19:44:11.785194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 910/1993] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:11 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:12.310641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-948f08e9-2312-4982-8c8a-940cb0b9fa02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:12.311328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-948f08e9-2312-4982-8c8a-940cb0b9fa02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:12.318591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-948f08e9-2312-4982-8c8a-940cb0b9fa02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:12.319088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-948f08e9-2312-4982-8c8a-940cb0b9fa02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:12.319988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-948f08e9-2312-4982-8c8a-940cb0b9fa02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:12.320515 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-948f08e9-2312-4982-8c8a-940cb0b9fa02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:12.389312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-948f08e9-2312-4982-8c8a-940cb0b9fa02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:12.397953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-948f08e9-2312-4982-8c8a-940cb0b9fa02 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.091357 Jul 25 19:44:12.398555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1084/1994] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:12.717339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d55519a6-d0e4-4bff-85a6-2e2c9ac7e7cd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:12.719964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d55519a6-d0e4-4bff-85a6-2e2c9ac7e7cd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:12.727294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d55519a6-d0e4-4bff-85a6-2e2c9ac7e7cd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:12.727826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d55519a6-d0e4-4bff-85a6-2e2c9ac7e7cd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:12.729016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d55519a6-d0e4-4bff-85a6-2e2c9ac7e7cd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:12.729526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d55519a6-d0e4-4bff-85a6-2e2c9ac7e7cd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:12.765555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d55519a6-d0e4-4bff-85a6-2e2c9ac7e7cd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052436 Jul 25 19:44:12.766140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 911/1995] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:12 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:12.821467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-89336e17-211a-4f19-b041-28dcc0377e7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:12.822789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-89336e17-211a-4f19-b041-28dcc0377e7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:12.829707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89336e17-211a-4f19-b041-28dcc0377e7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:12.830305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89336e17-211a-4f19-b041-28dcc0377e7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:12.831141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89336e17-211a-4f19-b041-28dcc0377e7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:12.831667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89336e17-211a-4f19-b041-28dcc0377e7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:12.902258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-89336e17-211a-4f19-b041-28dcc0377e7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:12.910268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-89336e17-211a-4f19-b041-28dcc0377e7b tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.092908 Jul 25 19:44:12.910861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1085/1996] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:12 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:13.423787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b2361faf-596e-461b-a045-38207a624b4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:13.424704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b2361faf-596e-461b-a045-38207a624b4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:13.433240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2361faf-596e-461b-a045-38207a624b4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:13.433774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2361faf-596e-461b-a045-38207a624b4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:13.434576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2361faf-596e-461b-a045-38207a624b4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:13.435010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2361faf-596e-461b-a045-38207a624b4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:13.507439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2361faf-596e-461b-a045-38207a624b4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:13.517114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b2361faf-596e-461b-a045-38207a624b4e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099999 Jul 25 19:44:13.517761 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 912/1997] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:13.778676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-72620d3d-b37a-41a5-8d79-d1742823ceb2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:13.781156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-72620d3d-b37a-41a5-8d79-d1742823ceb2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:13.788665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72620d3d-b37a-41a5-8d79-d1742823ceb2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:13.789114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72620d3d-b37a-41a5-8d79-d1742823ceb2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:13.789904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72620d3d-b37a-41a5-8d79-d1742823ceb2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:13.790339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72620d3d-b37a-41a5-8d79-d1742823ceb2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:13.825837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-72620d3d-b37a-41a5-8d79-d1742823ceb2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051432 Jul 25 19:44:13.826606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1086/1998] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:13 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:13.933339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-db2e21f5-2f7f-470e-830b-12c2120c1b37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:13.934362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-db2e21f5-2f7f-470e-830b-12c2120c1b37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:13.941957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db2e21f5-2f7f-470e-830b-12c2120c1b37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:13.942556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db2e21f5-2f7f-470e-830b-12c2120c1b37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:13.943565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db2e21f5-2f7f-470e-830b-12c2120c1b37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:13.944136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db2e21f5-2f7f-470e-830b-12c2120c1b37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:14.020736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-db2e21f5-2f7f-470e-830b-12c2120c1b37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:14.031594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-db2e21f5-2f7f-470e-830b-12c2120c1b37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.102578 Jul 25 19:44:14.032191 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 913/1999] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:13 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:14.538828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-33f5c28a-5f58-4ab1-87b0-03e8d4dac94d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:14.539600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-33f5c28a-5f58-4ab1-87b0-03e8d4dac94d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:14.547570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33f5c28a-5f58-4ab1-87b0-03e8d4dac94d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:14.548015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33f5c28a-5f58-4ab1-87b0-03e8d4dac94d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:14.548791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33f5c28a-5f58-4ab1-87b0-03e8d4dac94d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:14.549423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33f5c28a-5f58-4ab1-87b0-03e8d4dac94d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:14.621479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-33f5c28a-5f58-4ab1-87b0-03e8d4dac94d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:14.629951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-33f5c28a-5f58-4ab1-87b0-03e8d4dac94d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095395 Jul 25 19:44:14.630558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1087/2000] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:14 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:14.842153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1575f6f3-33da-4512-88fc-4ba8a179660f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:14.844388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1575f6f3-33da-4512-88fc-4ba8a179660f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:14.850984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1575f6f3-33da-4512-88fc-4ba8a179660f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:14.851421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1575f6f3-33da-4512-88fc-4ba8a179660f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:14.852226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1575f6f3-33da-4512-88fc-4ba8a179660f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:14.852661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1575f6f3-33da-4512-88fc-4ba8a179660f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:14.887944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1575f6f3-33da-4512-88fc-4ba8a179660f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050486 Jul 25 19:44:14.888553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 914/2001] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:14 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:15.053938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1c83785f-0538-41c0-82ee-fa31babc9d18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:15.054637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1c83785f-0538-41c0-82ee-fa31babc9d18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:15.062122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c83785f-0538-41c0-82ee-fa31babc9d18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:15.062659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c83785f-0538-41c0-82ee-fa31babc9d18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:15.063640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c83785f-0538-41c0-82ee-fa31babc9d18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:15.064079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c83785f-0538-41c0-82ee-fa31babc9d18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:15.133648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1c83785f-0538-41c0-82ee-fa31babc9d18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:15.142233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1c83785f-0538-41c0-82ee-fa31babc9d18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.092303 Jul 25 19:44:15.142889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1088/2002] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:15 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:15.653118 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-425e86dd-8900-48b7-8578-61cb245dcf39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:15.653733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-425e86dd-8900-48b7-8578-61cb245dcf39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:15.668073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-425e86dd-8900-48b7-8578-61cb245dcf39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:15.668539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-425e86dd-8900-48b7-8578-61cb245dcf39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:15.669337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-425e86dd-8900-48b7-8578-61cb245dcf39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:15.669768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-425e86dd-8900-48b7-8578-61cb245dcf39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:15.739637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-425e86dd-8900-48b7-8578-61cb245dcf39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:15.748133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-425e86dd-8900-48b7-8578-61cb245dcf39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099570 Jul 25 19:44:15.748718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 915/2003] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:15.904059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-01f4fe9e-354f-4196-9929-cc8af3b7c775 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:15.907581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-01f4fe9e-354f-4196-9929-cc8af3b7c775 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:15.915468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-01f4fe9e-354f-4196-9929-cc8af3b7c775 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:15.916016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-01f4fe9e-354f-4196-9929-cc8af3b7c775 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:15.916883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-01f4fe9e-354f-4196-9929-cc8af3b7c775 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:15.917363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-01f4fe9e-354f-4196-9929-cc8af3b7c775 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:15.953035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-01f4fe9e-354f-4196-9929-cc8af3b7c775 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056074 Jul 25 19:44:15.953636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1089/2004] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:15 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:16.168123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66b4fd64-0eee-424c-a096-1b14327c9a67 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:16.169152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66b4fd64-0eee-424c-a096-1b14327c9a67 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:16.180365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b4fd64-0eee-424c-a096-1b14327c9a67 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:16.181180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b4fd64-0eee-424c-a096-1b14327c9a67 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:16.183154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b4fd64-0eee-424c-a096-1b14327c9a67 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:16.184025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b4fd64-0eee-424c-a096-1b14327c9a67 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:16.258780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66b4fd64-0eee-424c-a096-1b14327c9a67 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:16.267389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66b4fd64-0eee-424c-a096-1b14327c9a67 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.107212 Jul 25 19:44:16.268045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 916/2005] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:16 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:16.769622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eb11874d-6d60-4f92-a2bd-d90661a165e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:16.770636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eb11874d-6d60-4f92-a2bd-d90661a165e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:16.778656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb11874d-6d60-4f92-a2bd-d90661a165e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:16.779108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb11874d-6d60-4f92-a2bd-d90661a165e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:16.779948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb11874d-6d60-4f92-a2bd-d90661a165e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:16.780391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb11874d-6d60-4f92-a2bd-d90661a165e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:16.847076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eb11874d-6d60-4f92-a2bd-d90661a165e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:16.856440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eb11874d-6d60-4f92-a2bd-d90661a165e4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090806 Jul 25 19:44:16.857040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1090/2006] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:16.965275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aaf8a4af-0b4a-47c8-9610-1ead5caaa7c0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:16.967692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aaf8a4af-0b4a-47c8-9610-1ead5caaa7c0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:16.975117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aaf8a4af-0b4a-47c8-9610-1ead5caaa7c0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:16.975593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aaf8a4af-0b4a-47c8-9610-1ead5caaa7c0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:16.976441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aaf8a4af-0b4a-47c8-9610-1ead5caaa7c0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:16.976883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aaf8a4af-0b4a-47c8-9610-1ead5caaa7c0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:17.009724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aaf8a4af-0b4a-47c8-9610-1ead5caaa7c0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Jul 25 19:44:17.010316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 917/2007] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:16 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:17.290050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6e045f1c-8064-4d2a-90f4-4c337441a464 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:17.290686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6e045f1c-8064-4d2a-90f4-4c337441a464 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:17.298372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e045f1c-8064-4d2a-90f4-4c337441a464 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:17.298809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e045f1c-8064-4d2a-90f4-4c337441a464 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:17.299605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e045f1c-8064-4d2a-90f4-4c337441a464 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:17.300046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e045f1c-8064-4d2a-90f4-4c337441a464 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:17.370225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6e045f1c-8064-4d2a-90f4-4c337441a464 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:17.378276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6e045f1c-8064-4d2a-90f4-4c337441a464 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.092039 Jul 25 19:44:17.378865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1091/2008] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:17 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:17.878549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-33223a2e-4900-4f1a-8c40-b76e559cd9ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:17.879174 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-33223a2e-4900-4f1a-8c40-b76e559cd9ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:17.886870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33223a2e-4900-4f1a-8c40-b76e559cd9ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:17.887296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33223a2e-4900-4f1a-8c40-b76e559cd9ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:17.888351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33223a2e-4900-4f1a-8c40-b76e559cd9ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:17.888784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33223a2e-4900-4f1a-8c40-b76e559cd9ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:17.961110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-33223a2e-4900-4f1a-8c40-b76e559cd9ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:17.970669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-33223a2e-4900-4f1a-8c40-b76e559cd9ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.096019 Jul 25 19:44:17.971629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 918/2009] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:18.023640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-894c414a-8d94-47fa-b538-e0cea5581522 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:18.026046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-894c414a-8d94-47fa-b538-e0cea5581522 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:18.032835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-894c414a-8d94-47fa-b538-e0cea5581522 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:18.033284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-894c414a-8d94-47fa-b538-e0cea5581522 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:18.034062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-894c414a-8d94-47fa-b538-e0cea5581522 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:18.034497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-894c414a-8d94-47fa-b538-e0cea5581522 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:18.070304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-894c414a-8d94-47fa-b538-e0cea5581522 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050733 Jul 25 19:44:18.070897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1092/2010] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:18 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:18.399592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-43051125-8b06-44c1-87b8-1d6acc702067 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:18.400250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-43051125-8b06-44c1-87b8-1d6acc702067 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:18.407246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43051125-8b06-44c1-87b8-1d6acc702067 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:18.407732 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43051125-8b06-44c1-87b8-1d6acc702067 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:18.408637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43051125-8b06-44c1-87b8-1d6acc702067 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:18.409180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43051125-8b06-44c1-87b8-1d6acc702067 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:18.480169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-43051125-8b06-44c1-87b8-1d6acc702067 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:18.489139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-43051125-8b06-44c1-87b8-1d6acc702067 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.093383 Jul 25 19:44:18.489723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 919/2011] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:18 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:19.001693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f473054a-0d44-49c4-8ccc-b0950806a242 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:19.002423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f473054a-0d44-49c4-8ccc-b0950806a242 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:19.010457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f473054a-0d44-49c4-8ccc-b0950806a242 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:19.010938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f473054a-0d44-49c4-8ccc-b0950806a242 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:19.011966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f473054a-0d44-49c4-8ccc-b0950806a242 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:19.012408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f473054a-0d44-49c4-8ccc-b0950806a242 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:19.083608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-151c4636-d2f4-4103-8d45-82a124fe3df3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:19.084376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f473054a-0d44-49c4-8ccc-b0950806a242 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:19.085813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-151c4636-d2f4-4103-8d45-82a124fe3df3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:19.093235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-151c4636-d2f4-4103-8d45-82a124fe3df3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:19.093482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f473054a-0d44-49c4-8ccc-b0950806a242 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095650 Jul 25 19:44:19.093722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-151c4636-d2f4-4103-8d45-82a124fe3df3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:19.093879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1093/2012] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:19.094492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-151c4636-d2f4-4103-8d45-82a124fe3df3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:19.094932 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-151c4636-d2f4-4103-8d45-82a124fe3df3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:19.143305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-151c4636-d2f4-4103-8d45-82a124fe3df3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064056 Jul 25 19:44:19.144082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 920/2013] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:19 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:19.511822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-09658dac-d2ca-4710-9ec1-3fcffe5ddbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:19.512510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-09658dac-d2ca-4710-9ec1-3fcffe5ddbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:19.520288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-09658dac-d2ca-4710-9ec1-3fcffe5ddbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:19.520867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-09658dac-d2ca-4710-9ec1-3fcffe5ddbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:19.521774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-09658dac-d2ca-4710-9ec1-3fcffe5ddbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:19.522260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-09658dac-d2ca-4710-9ec1-3fcffe5ddbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:19.593463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-09658dac-d2ca-4710-9ec1-3fcffe5ddbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:19.605969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-09658dac-d2ca-4710-9ec1-3fcffe5ddbe8 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.098013 Jul 25 19:44:19.606592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1094/2014] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:19 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:20.117036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df4676d9-f0a1-4e8f-984f-1a554cfb2f37 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:20.117651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-df4676d9-f0a1-4e8f-984f-1a554cfb2f37 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:20.125576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df4676d9-f0a1-4e8f-984f-1a554cfb2f37 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:20.126019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df4676d9-f0a1-4e8f-984f-1a554cfb2f37 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:20.127003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df4676d9-f0a1-4e8f-984f-1a554cfb2f37 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:20.127708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df4676d9-f0a1-4e8f-984f-1a554cfb2f37 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:20.157064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-29360f22-9a00-4ad3-9604-4e1d4ac4a738 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:20.159572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-29360f22-9a00-4ad3-9604-4e1d4ac4a738 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:20.167204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29360f22-9a00-4ad3-9604-4e1d4ac4a738 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:20.167491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29360f22-9a00-4ad3-9604-4e1d4ac4a738 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:20.168299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29360f22-9a00-4ad3-9604-4e1d4ac4a738 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:20.168735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29360f22-9a00-4ad3-9604-4e1d4ac4a738 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:20.198602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df4676d9-f0a1-4e8f-984f-1a554cfb2f37 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:20.206899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df4676d9-f0a1-4e8f-984f-1a554cfb2f37 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.093740 Jul 25 19:44:20.207711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-29360f22-9a00-4ad3-9604-4e1d4ac4a738 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054382 Jul 25 19:44:20.207881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 921/2015] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:20.208296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1095/2016] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:20 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:20.630238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8c421a91-9bf9-4c3c-ab79-fc48fab024f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:20.631031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8c421a91-9bf9-4c3c-ab79-fc48fab024f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:20.639682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c421a91-9bf9-4c3c-ab79-fc48fab024f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:20.640286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c421a91-9bf9-4c3c-ab79-fc48fab024f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:20.641181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c421a91-9bf9-4c3c-ab79-fc48fab024f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:20.641924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c421a91-9bf9-4c3c-ab79-fc48fab024f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:20.716022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8c421a91-9bf9-4c3c-ab79-fc48fab024f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:20.724444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8c421a91-9bf9-4c3c-ab79-fc48fab024f0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.099302 Jul 25 19:44:20.724953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 922/2017] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:20 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:21.220080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e35149c4-9fe4-42f7-86a8-26f7368ae532 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:21.222494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e35149c4-9fe4-42f7-86a8-26f7368ae532 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:21.231192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e35149c4-9fe4-42f7-86a8-26f7368ae532 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:21.231675 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e35149c4-9fe4-42f7-86a8-26f7368ae532 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:21.232464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e35149c4-9fe4-42f7-86a8-26f7368ae532 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:21.232905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e35149c4-9fe4-42f7-86a8-26f7368ae532 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:21.233356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-602133ad-b18d-48e9-aa4b-230e77810409 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:21.234231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-602133ad-b18d-48e9-aa4b-230e77810409 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:21.241359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602133ad-b18d-48e9-aa4b-230e77810409 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:21.241815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602133ad-b18d-48e9-aa4b-230e77810409 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:21.242593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602133ad-b18d-48e9-aa4b-230e77810409 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:21.243033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602133ad-b18d-48e9-aa4b-230e77810409 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:21.265771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e35149c4-9fe4-42f7-86a8-26f7368ae532 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049673 Jul 25 19:44:21.266705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1096/2018] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:21 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:21.312141 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-602133ad-b18d-48e9-aa4b-230e77810409 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:21.320646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-602133ad-b18d-48e9-aa4b-230e77810409 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.093551 Jul 25 19:44:21.321251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 923/2019] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:21.746176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-244baca1-105d-4a96-9a00-b2d0471fd6d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:21.746785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-244baca1-105d-4a96-9a00-b2d0471fd6d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:21.753287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-244baca1-105d-4a96-9a00-b2d0471fd6d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:21.753727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-244baca1-105d-4a96-9a00-b2d0471fd6d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:21.754492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-244baca1-105d-4a96-9a00-b2d0471fd6d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:21.754927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-244baca1-105d-4a96-9a00-b2d0471fd6d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:21.759103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:21.829628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-244baca1-105d-4a96-9a00-b2d0471fd6d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:21.837497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-244baca1-105d-4a96-9a00-b2d0471fd6d9 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.095204 Jul 25 19:44:21.838798 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1097/2020] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:21 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:22.280938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-761606f0-b89c-49cf-80a3-604ac588fb8f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:22.283100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-761606f0-b89c-49cf-80a3-604ac588fb8f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:22.289409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-761606f0-b89c-49cf-80a3-604ac588fb8f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:22.289875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-761606f0-b89c-49cf-80a3-604ac588fb8f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:22.291160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-761606f0-b89c-49cf-80a3-604ac588fb8f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:22.292821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-761606f0-b89c-49cf-80a3-604ac588fb8f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:22.327652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-761606f0-b89c-49cf-80a3-604ac588fb8f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052780 Jul 25 19:44:22.328151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 924/2021] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:22 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:22.342730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9d507930-5e52-4f1e-a403-088c5453e87b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:22.343327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9d507930-5e52-4f1e-a403-088c5453e87b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:22.350221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d507930-5e52-4f1e-a403-088c5453e87b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:22.350755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d507930-5e52-4f1e-a403-088c5453e87b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:22.351618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d507930-5e52-4f1e-a403-088c5453e87b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:22.352074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d507930-5e52-4f1e-a403-088c5453e87b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:22.424560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9d507930-5e52-4f1e-a403-088c5453e87b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:22.434138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9d507930-5e52-4f1e-a403-088c5453e87b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.096443 Jul 25 19:44:22.434734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1098/2022] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:22.861476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e30a1fd2-595f-4934-99c9-bdcf025659f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:22.862099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e30a1fd2-595f-4934-99c9-bdcf025659f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:22.869791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e30a1fd2-595f-4934-99c9-bdcf025659f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:22.870267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e30a1fd2-595f-4934-99c9-bdcf025659f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:22.871071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e30a1fd2-595f-4934-99c9-bdcf025659f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:22.871540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e30a1fd2-595f-4934-99c9-bdcf025659f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:22.953320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e30a1fd2-595f-4934-99c9-bdcf025659f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:22.963728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e30a1fd2-595f-4934-99c9-bdcf025659f4 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.106020 Jul 25 19:44:22.964365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 925/2023] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:22 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:23.340357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d626a4b9-d712-4c1e-a075-3d53e68800a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:23.342519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d626a4b9-d712-4c1e-a075-3d53e68800a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:23.349122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d626a4b9-d712-4c1e-a075-3d53e68800a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:23.349852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d626a4b9-d712-4c1e-a075-3d53e68800a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:23.350323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d626a4b9-d712-4c1e-a075-3d53e68800a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:23.350754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d626a4b9-d712-4c1e-a075-3d53e68800a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:23.382752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d626a4b9-d712-4c1e-a075-3d53e68800a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046946 Jul 25 19:44:23.383383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1099/2024] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:23 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:23.458098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df8457e4-6824-4397-8b48-74c9d89a7b08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:23.458831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-df8457e4-6824-4397-8b48-74c9d89a7b08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:23.465726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df8457e4-6824-4397-8b48-74c9d89a7b08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:23.466166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df8457e4-6824-4397-8b48-74c9d89a7b08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:23.467704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df8457e4-6824-4397-8b48-74c9d89a7b08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:23.468201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df8457e4-6824-4397-8b48-74c9d89a7b08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:23.490358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:23.537977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df8457e4-6824-4397-8b48-74c9d89a7b08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:23.548469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df8457e4-6824-4397-8b48-74c9d89a7b08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094350 Jul 25 19:44:23.549095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 926/2025] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:23.985907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bec883c9-16bd-4ae9-aa65-3d44f35aad99 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:23.986518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bec883c9-16bd-4ae9-aa65-3d44f35aad99 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:23.992578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bec883c9-16bd-4ae9-aa65-3d44f35aad99 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:23.993029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bec883c9-16bd-4ae9-aa65-3d44f35aad99 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:23.993789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bec883c9-16bd-4ae9-aa65-3d44f35aad99 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:23.994223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bec883c9-16bd-4ae9-aa65-3d44f35aad99 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:24.058255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bec883c9-16bd-4ae9-aa65-3d44f35aad99 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:24.065928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bec883c9-16bd-4ae9-aa65-3d44f35aad99 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.084140 Jul 25 19:44:24.066500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1100/2026] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:23 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:24.396014 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-00f87317-7ec6-4f10-b2f3-49d5ec4de7e5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:24.398397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-00f87317-7ec6-4f10-b2f3-49d5ec4de7e5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:24.405781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00f87317-7ec6-4f10-b2f3-49d5ec4de7e5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:24.406233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00f87317-7ec6-4f10-b2f3-49d5ec4de7e5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:24.407010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00f87317-7ec6-4f10-b2f3-49d5ec4de7e5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:24.407447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00f87317-7ec6-4f10-b2f3-49d5ec4de7e5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:24.440343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-00f87317-7ec6-4f10-b2f3-49d5ec4de7e5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048347 Jul 25 19:44:24.440986 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 927/2027] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:24 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:24.570837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-85feffb3-dfdb-44e6-8870-869dec5fdd93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:24.571619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-85feffb3-dfdb-44e6-8870-869dec5fdd93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:24.578309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-85feffb3-dfdb-44e6-8870-869dec5fdd93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:24.578751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-85feffb3-dfdb-44e6-8870-869dec5fdd93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:24.579534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-85feffb3-dfdb-44e6-8870-869dec5fdd93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:24.579979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-85feffb3-dfdb-44e6-8870-869dec5fdd93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:24.645015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-85feffb3-dfdb-44e6-8870-869dec5fdd93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:24.653415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-85feffb3-dfdb-44e6-8870-869dec5fdd93 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086465 Jul 25 19:44:24.653921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1101/2028] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:25.088167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e43c2f4-01eb-4480-802b-fab2a30db128 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:25.089092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e43c2f4-01eb-4480-802b-fab2a30db128 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:25.095847 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e43c2f4-01eb-4480-802b-fab2a30db128 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:25.096296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e43c2f4-01eb-4480-802b-fab2a30db128 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:25.097121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e43c2f4-01eb-4480-802b-fab2a30db128 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:25.097612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e43c2f4-01eb-4480-802b-fab2a30db128 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:25.169750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1e43c2f4-01eb-4480-802b-fab2a30db128 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:25.177526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e43c2f4-01eb-4480-802b-fab2a30db128 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.093402 Jul 25 19:44:25.178110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 928/2029] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:25 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:25.454263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-716c51f1-edf6-4a08-bed2-8c21aea34ad6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:25.456560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-716c51f1-edf6-4a08-bed2-8c21aea34ad6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:25.463992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-716c51f1-edf6-4a08-bed2-8c21aea34ad6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:25.464438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-716c51f1-edf6-4a08-bed2-8c21aea34ad6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:25.465375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-716c51f1-edf6-4a08-bed2-8c21aea34ad6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:25.465832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-716c51f1-edf6-4a08-bed2-8c21aea34ad6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:25.500956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-716c51f1-edf6-4a08-bed2-8c21aea34ad6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051286 Jul 25 19:44:25.501539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1102/2030] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:25 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:25.675009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af909f47-fe63-4886-89fe-6395b800129f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:25.675861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af909f47-fe63-4886-89fe-6395b800129f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:25.682201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af909f47-fe63-4886-89fe-6395b800129f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:25.682645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af909f47-fe63-4886-89fe-6395b800129f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:25.683418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af909f47-fe63-4886-89fe-6395b800129f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:25.683876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af909f47-fe63-4886-89fe-6395b800129f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:25.751400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-af909f47-fe63-4886-89fe-6395b800129f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:25.760268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af909f47-fe63-4886-89fe-6395b800129f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089155 Jul 25 19:44:25.760869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 929/2031] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:26.202831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4285c072-5415-44cd-af0f-f2b10adbc36a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:26.203430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4285c072-5415-44cd-af0f-f2b10adbc36a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:26.210870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4285c072-5415-44cd-af0f-f2b10adbc36a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:26.211315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4285c072-5415-44cd-af0f-f2b10adbc36a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:26.212266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4285c072-5415-44cd-af0f-f2b10adbc36a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:26.214184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4285c072-5415-44cd-af0f-f2b10adbc36a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:26.281522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4285c072-5415-44cd-af0f-f2b10adbc36a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:26.289310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4285c072-5415-44cd-af0f-f2b10adbc36a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.092481 Jul 25 19:44:26.289881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1103/2032] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:26 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:26.514228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6cdeea7e-876c-47e1-b638-080f783143c7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:26.516445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6cdeea7e-876c-47e1-b638-080f783143c7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:26.523328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cdeea7e-876c-47e1-b638-080f783143c7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:26.523805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cdeea7e-876c-47e1-b638-080f783143c7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:26.524579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cdeea7e-876c-47e1-b638-080f783143c7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:26.525594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cdeea7e-876c-47e1-b638-080f783143c7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:26.561164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6cdeea7e-876c-47e1-b638-080f783143c7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051270 Jul 25 19:44:26.561748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 930/2033] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:26 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:26.782011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b88f9fe3-bc86-4b1b-9084-e010119711c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:26.782533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b88f9fe3-bc86-4b1b-9084-e010119711c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:26.788749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b88f9fe3-bc86-4b1b-9084-e010119711c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:26.789200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b88f9fe3-bc86-4b1b-9084-e010119711c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:26.789970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b88f9fe3-bc86-4b1b-9084-e010119711c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:26.790407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b88f9fe3-bc86-4b1b-9084-e010119711c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:26.855290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b88f9fe3-bc86-4b1b-9084-e010119711c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:26.863606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b88f9fe3-bc86-4b1b-9084-e010119711c8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085488 Jul 25 19:44:26.864181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1104/2034] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:27.311289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ddc92593-2886-4fec-944d-9ab2dd5f0e5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:27.311995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ddc92593-2886-4fec-944d-9ab2dd5f0e5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:27.318525 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddc92593-2886-4fec-944d-9ab2dd5f0e5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:27.318970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddc92593-2886-4fec-944d-9ab2dd5f0e5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:27.319785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddc92593-2886-4fec-944d-9ab2dd5f0e5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:27.320225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddc92593-2886-4fec-944d-9ab2dd5f0e5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:27.391839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ddc92593-2886-4fec-944d-9ab2dd5f0e5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:27.401280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ddc92593-2886-4fec-944d-9ab2dd5f0e5a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.094028 Jul 25 19:44:27.401882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 931/2035] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:27 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:27.573948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3a6745a7-f5a8-404e-a966-11a288222f82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:27.577050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3a6745a7-f5a8-404e-a966-11a288222f82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:27.584427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a6745a7-f5a8-404e-a966-11a288222f82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:27.584875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a6745a7-f5a8-404e-a966-11a288222f82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:27.585636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a6745a7-f5a8-404e-a966-11a288222f82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:27.586066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a6745a7-f5a8-404e-a966-11a288222f82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:27.625161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3a6745a7-f5a8-404e-a966-11a288222f82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055896 Jul 25 19:44:27.625750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1105/2036] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:27 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:27.886074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-60c22718-6373-4eae-afbe-763b870bc799 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:27.886672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-60c22718-6373-4eae-afbe-763b870bc799 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:27.893553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60c22718-6373-4eae-afbe-763b870bc799 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:27.893994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60c22718-6373-4eae-afbe-763b870bc799 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:27.894767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60c22718-6373-4eae-afbe-763b870bc799 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:27.895199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60c22718-6373-4eae-afbe-763b870bc799 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:27.962066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60c22718-6373-4eae-afbe-763b870bc799 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:27.970827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-60c22718-6373-4eae-afbe-763b870bc799 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089494 Jul 25 19:44:27.971404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 932/2037] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:28.424099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-760d9e60-c2a3-41d6-a8f8-03571847530a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:28.424799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-760d9e60-c2a3-41d6-a8f8-03571847530a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:28.432972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-760d9e60-c2a3-41d6-a8f8-03571847530a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:28.433563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-760d9e60-c2a3-41d6-a8f8-03571847530a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:28.434452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-760d9e60-c2a3-41d6-a8f8-03571847530a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:28.435002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-760d9e60-c2a3-41d6-a8f8-03571847530a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:28.519671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-760d9e60-c2a3-41d6-a8f8-03571847530a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:28.528556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-760d9e60-c2a3-41d6-a8f8-03571847530a tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.109409 Jul 25 19:44:28.529387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1106/2038] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:28 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:28.640458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2358ba16-a106-4772-9eee-7aada31bf74c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:28.643081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2358ba16-a106-4772-9eee-7aada31bf74c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:28.649749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2358ba16-a106-4772-9eee-7aada31bf74c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:28.650755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2358ba16-a106-4772-9eee-7aada31bf74c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:28.651785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2358ba16-a106-4772-9eee-7aada31bf74c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:28.652285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2358ba16-a106-4772-9eee-7aada31bf74c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:28.686995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2358ba16-a106-4772-9eee-7aada31bf74c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050559 Jul 25 19:44:28.687630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 933/2039] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:28 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:29.003626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-101786f8-3128-4b04-b6c7-09fb41e831f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:29.004285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-101786f8-3128-4b04-b6c7-09fb41e831f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:29.011974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-101786f8-3128-4b04-b6c7-09fb41e831f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:29.012421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-101786f8-3128-4b04-b6c7-09fb41e831f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:29.013212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-101786f8-3128-4b04-b6c7-09fb41e831f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:29.013647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-101786f8-3128-4b04-b6c7-09fb41e831f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:29.085917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-101786f8-3128-4b04-b6c7-09fb41e831f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:29.094704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-101786f8-3128-4b04-b6c7-09fb41e831f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095406 Jul 25 19:44:29.095286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1107/2040] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:29.551907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb967078-df2d-4012-9072-09ac311fd39c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:29.552624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb967078-df2d-4012-9072-09ac311fd39c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:29.561795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb967078-df2d-4012-9072-09ac311fd39c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:29.562249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb967078-df2d-4012-9072-09ac311fd39c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:29.563033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb967078-df2d-4012-9072-09ac311fd39c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:29.563504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb967078-df2d-4012-9072-09ac311fd39c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:29.634007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb967078-df2d-4012-9072-09ac311fd39c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:29.643076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb967078-df2d-4012-9072-09ac311fd39c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.095153 Jul 25 19:44:29.643709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 934/2041] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:29 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:29.700346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e2d7cea5-ef88-4190-8056-c6dcf1707a9e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:29.702508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e2d7cea5-ef88-4190-8056-c6dcf1707a9e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:29.709435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2d7cea5-ef88-4190-8056-c6dcf1707a9e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:29.709883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2d7cea5-ef88-4190-8056-c6dcf1707a9e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:29.710671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2d7cea5-ef88-4190-8056-c6dcf1707a9e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:29.711112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e2d7cea5-ef88-4190-8056-c6dcf1707a9e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:29.746681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e2d7cea5-ef88-4190-8056-c6dcf1707a9e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050799 Jul 25 19:44:29.747305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1108/2042] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:29 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:30.117570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9491d353-de37-4606-a8f4-f0513ea7a34a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:30.118283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9491d353-de37-4606-a8f4-f0513ea7a34a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:30.125898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9491d353-de37-4606-a8f4-f0513ea7a34a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:30.126357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9491d353-de37-4606-a8f4-f0513ea7a34a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:30.127155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9491d353-de37-4606-a8f4-f0513ea7a34a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:30.127638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9491d353-de37-4606-a8f4-f0513ea7a34a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:30.204503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9491d353-de37-4606-a8f4-f0513ea7a34a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:30.219616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9491d353-de37-4606-a8f4-f0513ea7a34a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.106223 Jul 25 19:44:30.220600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 935/2043] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:30.666677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-379989be-e85b-44ca-a451-7a0d0a2739cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:30.667419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-379989be-e85b-44ca-a451-7a0d0a2739cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:30.674760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-379989be-e85b-44ca-a451-7a0d0a2739cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:30.675208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-379989be-e85b-44ca-a451-7a0d0a2739cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:30.676058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-379989be-e85b-44ca-a451-7a0d0a2739cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:30.676498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-379989be-e85b-44ca-a451-7a0d0a2739cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:30.746298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-379989be-e85b-44ca-a451-7a0d0a2739cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:30.754339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-379989be-e85b-44ca-a451-7a0d0a2739cf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.092918 Jul 25 19:44:30.754984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1109/2044] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:30 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:30.764578 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1f0536b2-7bc5-48ad-ae5a-24214748e113 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:30.768696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1f0536b2-7bc5-48ad-ae5a-24214748e113 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:30.780517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f0536b2-7bc5-48ad-ae5a-24214748e113 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:30.781066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f0536b2-7bc5-48ad-ae5a-24214748e113 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:30.781996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f0536b2-7bc5-48ad-ae5a-24214748e113 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:30.782758 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f0536b2-7bc5-48ad-ae5a-24214748e113 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:30.819347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1f0536b2-7bc5-48ad-ae5a-24214748e113 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063241 Jul 25 19:44:30.820017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 936/2045] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:30 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:31.253176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a015a024-60f2-4663-8c30-ac413caf2aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:31.253819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a015a024-60f2-4663-8c30-ac413caf2aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:31.263146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a015a024-60f2-4663-8c30-ac413caf2aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:31.263905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a015a024-60f2-4663-8c30-ac413caf2aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:31.265276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a015a024-60f2-4663-8c30-ac413caf2aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:31.266049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a015a024-60f2-4663-8c30-ac413caf2aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:31.347490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a015a024-60f2-4663-8c30-ac413caf2aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:31.357820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a015a024-60f2-4663-8c30-ac413caf2aba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.108739 Jul 25 19:44:31.358639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1110/2046] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:31.787358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1c3de96e-ffb8-4503-82ad-493730c96438 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:31.788218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1c3de96e-ffb8-4503-82ad-493730c96438 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:31.796029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c3de96e-ffb8-4503-82ad-493730c96438 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:31.796484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c3de96e-ffb8-4503-82ad-493730c96438 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:31.797301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c3de96e-ffb8-4503-82ad-493730c96438 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:31.797744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c3de96e-ffb8-4503-82ad-493730c96438 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:31.836616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a1304f49-17e2-4000-803f-859841ff91fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:31.841881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a1304f49-17e2-4000-803f-859841ff91fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:31.855127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1304f49-17e2-4000-803f-859841ff91fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:31.856056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1304f49-17e2-4000-803f-859841ff91fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:31.857458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1304f49-17e2-4000-803f-859841ff91fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:31.858228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1304f49-17e2-4000-803f-859841ff91fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:31.872652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1c3de96e-ffb8-4503-82ad-493730c96438 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:31.891139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1c3de96e-ffb8-4503-82ad-493730c96438 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.107682 Jul 25 19:44:31.899568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 937/2047] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:31 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:31.907649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a1304f49-17e2-4000-803f-859841ff91fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078488 Jul 25 19:44:31.908236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1111/2048] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:31 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:32.382153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b132550d-a2ce-4c30-a66d-6085289e1a22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:32.382846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b132550d-a2ce-4c30-a66d-6085289e1a22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:32.390861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b132550d-a2ce-4c30-a66d-6085289e1a22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:32.391375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b132550d-a2ce-4c30-a66d-6085289e1a22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:32.392229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b132550d-a2ce-4c30-a66d-6085289e1a22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:32.392707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b132550d-a2ce-4c30-a66d-6085289e1a22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:32.465821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b132550d-a2ce-4c30-a66d-6085289e1a22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:32.477204 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b132550d-a2ce-4c30-a66d-6085289e1a22 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099375 Jul 25 19:44:32.478429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 938/2049] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:32.921330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dc3bc24c-d375-49c1-8d2b-a995d43caa10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:32.923167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-153ea61a-9b25-440e-8265-b73665b635b6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:32.923970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dc3bc24c-d375-49c1-8d2b-a995d43caa10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:32.924187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-153ea61a-9b25-440e-8265-b73665b635b6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:32.932867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-153ea61a-9b25-440e-8265-b73665b635b6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:32.933205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc3bc24c-d375-49c1-8d2b-a995d43caa10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:32.933413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-153ea61a-9b25-440e-8265-b73665b635b6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:32.933595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc3bc24c-d375-49c1-8d2b-a995d43caa10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:32.934464 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-153ea61a-9b25-440e-8265-b73665b635b6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:32.934855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc3bc24c-d375-49c1-8d2b-a995d43caa10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:32.935064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-153ea61a-9b25-440e-8265-b73665b635b6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:32.935429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc3bc24c-d375-49c1-8d2b-a995d43caa10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:32.971446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dc3bc24c-d375-49c1-8d2b-a995d43caa10 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054381 Jul 25 19:44:32.972304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1112/2050] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:32 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:33.006838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-153ea61a-9b25-440e-8265-b73665b635b6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:33.015177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-153ea61a-9b25-440e-8265-b73665b635b6 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.096485 Jul 25 19:44:33.015879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 939/2051] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:32 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:33.519057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eb0fb862-97f1-495f-ae69-2094b7780b30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:33.520114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eb0fb862-97f1-495f-ae69-2094b7780b30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:33.532919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb0fb862-97f1-495f-ae69-2094b7780b30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:33.533704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb0fb862-97f1-495f-ae69-2094b7780b30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:33.535113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb0fb862-97f1-495f-ae69-2094b7780b30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:33.535955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb0fb862-97f1-495f-ae69-2094b7780b30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:33.641029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eb0fb862-97f1-495f-ae69-2094b7780b30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:33.646963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:33.659812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eb0fb862-97f1-495f-ae69-2094b7780b30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.148187 Jul 25 19:44:33.660880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1113/2052] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:33.986238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ddfdac0f-69ac-4798-b3ec-faeeed0dba04 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:33.988458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ddfdac0f-69ac-4798-b3ec-faeeed0dba04 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:33.996385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddfdac0f-69ac-4798-b3ec-faeeed0dba04 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:33.996825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddfdac0f-69ac-4798-b3ec-faeeed0dba04 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:33.998273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddfdac0f-69ac-4798-b3ec-faeeed0dba04 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:33.998712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddfdac0f-69ac-4798-b3ec-faeeed0dba04 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:34.031775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ddfdac0f-69ac-4798-b3ec-faeeed0dba04 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049724 Jul 25 19:44:34.032491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 940/2053] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:33 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:34.037641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f52215c5-a51a-4b76-abf7-8eb6feae1ee5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:34.038254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f52215c5-a51a-4b76-abf7-8eb6feae1ee5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:34.046258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f52215c5-a51a-4b76-abf7-8eb6feae1ee5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:34.046704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f52215c5-a51a-4b76-abf7-8eb6feae1ee5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:34.047500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f52215c5-a51a-4b76-abf7-8eb6feae1ee5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:34.047985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f52215c5-a51a-4b76-abf7-8eb6feae1ee5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:34.120839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f52215c5-a51a-4b76-abf7-8eb6feae1ee5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:34.129437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f52215c5-a51a-4b76-abf7-8eb6feae1ee5 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.095576 Jul 25 19:44:34.130051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1114/2054] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:34 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:34.683179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cf668cbb-5b18-459b-b00a-cd2cd0d1f6fa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:34.683855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cf668cbb-5b18-459b-b00a-cd2cd0d1f6fa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:34.690409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf668cbb-5b18-459b-b00a-cd2cd0d1f6fa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:34.690854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf668cbb-5b18-459b-b00a-cd2cd0d1f6fa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:34.691657 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf668cbb-5b18-459b-b00a-cd2cd0d1f6fa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:34.692092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf668cbb-5b18-459b-b00a-cd2cd0d1f6fa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:34.782742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cf668cbb-5b18-459b-b00a-cd2cd0d1f6fa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:34.791705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cf668cbb-5b18-459b-b00a-cd2cd0d1f6fa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.112522 Jul 25 19:44:34.792523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 941/2055] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:35.044933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e24cf359-0398-4eff-a525-9845055fa6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:35.047122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e24cf359-0398-4eff-a525-9845055fa6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:35.054331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e24cf359-0398-4eff-a525-9845055fa6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:35.054990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e24cf359-0398-4eff-a525-9845055fa6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:35.056007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e24cf359-0398-4eff-a525-9845055fa6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:35.057120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e24cf359-0398-4eff-a525-9845055fa6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:35.090102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e24cf359-0398-4eff-a525-9845055fa6c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050049 Jul 25 19:44:35.090802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1115/2056] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:35 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:35.152428 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62552e54-d099-47f8-8c61-28b46db50728 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:35.153445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62552e54-d099-47f8-8c61-28b46db50728 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:35.160972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62552e54-d099-47f8-8c61-28b46db50728 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:35.161464 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62552e54-d099-47f8-8c61-28b46db50728 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:35.162406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62552e54-d099-47f8-8c61-28b46db50728 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:35.162884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62552e54-d099-47f8-8c61-28b46db50728 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:35.233632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62552e54-d099-47f8-8c61-28b46db50728 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:35.244351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62552e54-d099-47f8-8c61-28b46db50728 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.095211 Jul 25 19:44:35.245134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 942/2057] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:35 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:35.814639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-acaf8a57-f180-4f04-b85c-baa2104bdc6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:35.815341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-acaf8a57-f180-4f04-b85c-baa2104bdc6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:35.817441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=82 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:35.824190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-acaf8a57-f180-4f04-b85c-baa2104bdc6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:35.824659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-acaf8a57-f180-4f04-b85c-baa2104bdc6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:35.825466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-acaf8a57-f180-4f04-b85c-baa2104bdc6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:35.825912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-acaf8a57-f180-4f04-b85c-baa2104bdc6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:35.903211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-acaf8a57-f180-4f04-b85c-baa2104bdc6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:35.918666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-acaf8a57-f180-4f04-b85c-baa2104bdc6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.108246 Jul 25 19:44:35.919746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1116/2058] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:35 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:36.103786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae0eb873-ab36-4a32-8195-e3dee0df6881 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:36.106075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae0eb873-ab36-4a32-8195-e3dee0df6881 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:36.113558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae0eb873-ab36-4a32-8195-e3dee0df6881 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:36.114196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae0eb873-ab36-4a32-8195-e3dee0df6881 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:36.115371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae0eb873-ab36-4a32-8195-e3dee0df6881 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:36.115848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae0eb873-ab36-4a32-8195-e3dee0df6881 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:36.121632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:36.153784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae0eb873-ab36-4a32-8195-e3dee0df6881 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054585 Jul 25 19:44:36.154462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 943/2059] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:36 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:36.279425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1d8879c0-2a47-4e93-ae0a-d5587a2ca090 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:36.280238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1d8879c0-2a47-4e93-ae0a-d5587a2ca090 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:36.287429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d8879c0-2a47-4e93-ae0a-d5587a2ca090 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:36.288035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d8879c0-2a47-4e93-ae0a-d5587a2ca090 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:36.288911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d8879c0-2a47-4e93-ae0a-d5587a2ca090 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:36.289345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d8879c0-2a47-4e93-ae0a-d5587a2ca090 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:36.365557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1d8879c0-2a47-4e93-ae0a-d5587a2ca090 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:36.376022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1d8879c0-2a47-4e93-ae0a-d5587a2ca090 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.101343 Jul 25 19:44:36.376830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1117/2060] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:36 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:36.955221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77851d71-1d7b-4d8e-8318-24f2842c7bf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:36.955917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-77851d71-1d7b-4d8e-8318-24f2842c7bf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:36.958955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=80 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:36.966655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77851d71-1d7b-4d8e-8318-24f2842c7bf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:36.967095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77851d71-1d7b-4d8e-8318-24f2842c7bf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:36.967914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77851d71-1d7b-4d8e-8318-24f2842c7bf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:36.968346 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77851d71-1d7b-4d8e-8318-24f2842c7bf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:37.043639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-77851d71-1d7b-4d8e-8318-24f2842c7bf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:37.052862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-77851d71-1d7b-4d8e-8318-24f2842c7bf7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.101759 Jul 25 19:44:37.053448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 944/2061] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:37.166796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2471241d-7541-4b9d-b46f-c7e8b8dccb77 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:37.169745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2471241d-7541-4b9d-b46f-c7e8b8dccb77 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:37.176293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2471241d-7541-4b9d-b46f-c7e8b8dccb77 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:37.176747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2471241d-7541-4b9d-b46f-c7e8b8dccb77 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:37.177718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2471241d-7541-4b9d-b46f-c7e8b8dccb77 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:37.178176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2471241d-7541-4b9d-b46f-c7e8b8dccb77 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:37.211550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2471241d-7541-4b9d-b46f-c7e8b8dccb77 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048706 Jul 25 19:44:37.212120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1118/2062] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:37 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:37.399194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bfcbb691-5d82-47e0-932d-98819f48b184 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:37.400038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bfcbb691-5d82-47e0-932d-98819f48b184 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:37.407595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bfcbb691-5d82-47e0-932d-98819f48b184 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:37.408041 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bfcbb691-5d82-47e0-932d-98819f48b184 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:37.408807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bfcbb691-5d82-47e0-932d-98819f48b184 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:37.409235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bfcbb691-5d82-47e0-932d-98819f48b184 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:37.501689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bfcbb691-5d82-47e0-932d-98819f48b184 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:37.511141 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bfcbb691-5d82-47e0-932d-98819f48b184 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.116244 Jul 25 19:44:37.512303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 945/2063] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:37 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:38.089344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8d57e93b-f23c-46b4-a295-41589faeb469 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:38.090065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8d57e93b-f23c-46b4-a295-41589faeb469 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:38.097450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d57e93b-f23c-46b4-a295-41589faeb469 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:38.097900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d57e93b-f23c-46b4-a295-41589faeb469 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:38.098692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d57e93b-f23c-46b4-a295-41589faeb469 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:38.099150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d57e93b-f23c-46b4-a295-41589faeb469 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:38.172473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8d57e93b-f23c-46b4-a295-41589faeb469 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:38.184793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8d57e93b-f23c-46b4-a295-41589faeb469 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.100678 Jul 25 19:44:38.185383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1119/2064] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:38.226699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfa16b00-18ba-4be7-ba16-70200932fe49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:38.230104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfa16b00-18ba-4be7-ba16-70200932fe49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:38.237513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfa16b00-18ba-4be7-ba16-70200932fe49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:38.237968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfa16b00-18ba-4be7-ba16-70200932fe49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:38.238758 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfa16b00-18ba-4be7-ba16-70200932fe49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:38.239201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfa16b00-18ba-4be7-ba16-70200932fe49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:38.278052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfa16b00-18ba-4be7-ba16-70200932fe49 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057239 Jul 25 19:44:38.278653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 946/2065] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:38 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:38.546007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5ef2a135-1986-46ab-9ede-02cddd1ec61e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:38.546635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5ef2a135-1986-46ab-9ede-02cddd1ec61e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:38.553725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ef2a135-1986-46ab-9ede-02cddd1ec61e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:38.554198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ef2a135-1986-46ab-9ede-02cddd1ec61e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:38.555404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ef2a135-1986-46ab-9ede-02cddd1ec61e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:38.555888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ef2a135-1986-46ab-9ede-02cddd1ec61e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:38.637122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5ef2a135-1986-46ab-9ede-02cddd1ec61e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:38.648663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5ef2a135-1986-46ab-9ede-02cddd1ec61e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.106517 Jul 25 19:44:38.649816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1120/2066] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:38 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:39.206558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-24b9c6a5-95c0-43ef-8b52-62ca47221473 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:39.207395 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-24b9c6a5-95c0-43ef-8b52-62ca47221473 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:39.217365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24b9c6a5-95c0-43ef-8b52-62ca47221473 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:39.218174 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24b9c6a5-95c0-43ef-8b52-62ca47221473 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:39.219942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24b9c6a5-95c0-43ef-8b52-62ca47221473 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:39.220746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24b9c6a5-95c0-43ef-8b52-62ca47221473 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:39.291904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8ef7d308-897e-4d46-9ebe-c39d7da6cd58 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:39.294266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8ef7d308-897e-4d46-9ebe-c39d7da6cd58 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:39.301392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ef7d308-897e-4d46-9ebe-c39d7da6cd58 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:39.301829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ef7d308-897e-4d46-9ebe-c39d7da6cd58 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:39.302616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ef7d308-897e-4d46-9ebe-c39d7da6cd58 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:39.303048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8ef7d308-897e-4d46-9ebe-c39d7da6cd58 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:39.337103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8ef7d308-897e-4d46-9ebe-c39d7da6cd58 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050002 Jul 25 19:44:39.338420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-24b9c6a5-95c0-43ef-8b52-62ca47221473 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:39.338783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1121/2067] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:39 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:39.348222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-24b9c6a5-95c0-43ef-8b52-62ca47221473 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.145331 Jul 25 19:44:39.348759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 947/2068] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:39.671147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a7def76b-cbf5-4d21-a777-b37ac1317f18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:39.671704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a7def76b-cbf5-4d21-a777-b37ac1317f18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:39.678089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7def76b-cbf5-4d21-a777-b37ac1317f18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:39.678547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7def76b-cbf5-4d21-a777-b37ac1317f18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:39.679328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7def76b-cbf5-4d21-a777-b37ac1317f18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:39.679792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7def76b-cbf5-4d21-a777-b37ac1317f18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:39.748233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a7def76b-cbf5-4d21-a777-b37ac1317f18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:39.757472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a7def76b-cbf5-4d21-a777-b37ac1317f18 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.090373 Jul 25 19:44:39.758067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1122/2069] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:39 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:40.350762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-866eae05-4632-4146-9581-74edb1f50d6c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:40.353187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-866eae05-4632-4146-9581-74edb1f50d6c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:40.360821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-866eae05-4632-4146-9581-74edb1f50d6c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:40.361263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-866eae05-4632-4146-9581-74edb1f50d6c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:40.362057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-866eae05-4632-4146-9581-74edb1f50d6c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:40.362521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-866eae05-4632-4146-9581-74edb1f50d6c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:40.372657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-558093e3-70ba-41dd-9fdc-68b49107806f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:40.373551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-558093e3-70ba-41dd-9fdc-68b49107806f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:40.383392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-558093e3-70ba-41dd-9fdc-68b49107806f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:40.383877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-558093e3-70ba-41dd-9fdc-68b49107806f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:40.385238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-558093e3-70ba-41dd-9fdc-68b49107806f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:40.385696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-558093e3-70ba-41dd-9fdc-68b49107806f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:40.403448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-866eae05-4632-4146-9581-74edb1f50d6c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056148 Jul 25 19:44:40.405442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 948/2070] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:40 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:40.457714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-558093e3-70ba-41dd-9fdc-68b49107806f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:40.469366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-558093e3-70ba-41dd-9fdc-68b49107806f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.100348 Jul 25 19:44:40.469366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1123/2071] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:40.779039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6c5065cc-d70d-4a49-85b5-2bd661eeec33 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:40.779577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6c5065cc-d70d-4a49-85b5-2bd661eeec33 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:40.786676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c5065cc-d70d-4a49-85b5-2bd661eeec33 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:40.787119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c5065cc-d70d-4a49-85b5-2bd661eeec33 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:40.787962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c5065cc-d70d-4a49-85b5-2bd661eeec33 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:40.788394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c5065cc-d70d-4a49-85b5-2bd661eeec33 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:40.861215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6c5065cc-d70d-4a49-85b5-2bd661eeec33 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:40.872686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6c5065cc-d70d-4a49-85b5-2bd661eeec33 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.097822 Jul 25 19:44:40.873296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 949/2072] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:40 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:41.418843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9c992013-775c-4143-88d0-9076ad9d5142 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:41.421616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9c992013-775c-4143-88d0-9076ad9d5142 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:41.428916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c992013-775c-4143-88d0-9076ad9d5142 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:41.429356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c992013-775c-4143-88d0-9076ad9d5142 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:41.430124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c992013-775c-4143-88d0-9076ad9d5142 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:41.430550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9c992013-775c-4143-88d0-9076ad9d5142 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:41.466598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9c992013-775c-4143-88d0-9076ad9d5142 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051932 Jul 25 19:44:41.467187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1124/2073] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:41 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:41.491268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad0a823f-81d6-46dd-943a-46fea906d065 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:41.491923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad0a823f-81d6-46dd-943a-46fea906d065 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:41.498795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad0a823f-81d6-46dd-943a-46fea906d065 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:41.499241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad0a823f-81d6-46dd-943a-46fea906d065 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:41.500059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad0a823f-81d6-46dd-943a-46fea906d065 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:41.500496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad0a823f-81d6-46dd-943a-46fea906d065 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:41.567974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad0a823f-81d6-46dd-943a-46fea906d065 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:41.577555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad0a823f-81d6-46dd-943a-46fea906d065 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090397 Jul 25 19:44:41.578167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 950/2074] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:41.895251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-74caf939-27ca-4f0f-9d07-cf4df22c0fd1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:41.895980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-74caf939-27ca-4f0f-9d07-cf4df22c0fd1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:41.902830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74caf939-27ca-4f0f-9d07-cf4df22c0fd1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:41.903354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74caf939-27ca-4f0f-9d07-cf4df22c0fd1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:41.904238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74caf939-27ca-4f0f-9d07-cf4df22c0fd1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:41.904695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74caf939-27ca-4f0f-9d07-cf4df22c0fd1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:41.972758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-74caf939-27ca-4f0f-9d07-cf4df22c0fd1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:41.982711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-74caf939-27ca-4f0f-9d07-cf4df22c0fd1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.091366 Jul 25 19:44:41.983317 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1125/2075] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:41 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:42.480646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1bbf26bb-8e81-4dc6-802c-a2b8f60687f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:42.482752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1bbf26bb-8e81-4dc6-802c-a2b8f60687f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:42.490068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bbf26bb-8e81-4dc6-802c-a2b8f60687f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:42.490544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bbf26bb-8e81-4dc6-802c-a2b8f60687f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:42.491544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bbf26bb-8e81-4dc6-802c-a2b8f60687f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:42.492142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bbf26bb-8e81-4dc6-802c-a2b8f60687f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:42.531609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1bbf26bb-8e81-4dc6-802c-a2b8f60687f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055568 Jul 25 19:44:42.532201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 951/2076] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:42 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:42.603547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f9f6196a-cd96-4422-ab3d-f6b9d905bee3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:42.604577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f9f6196a-cd96-4422-ab3d-f6b9d905bee3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:42.615891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9f6196a-cd96-4422-ab3d-f6b9d905bee3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:42.616608 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9f6196a-cd96-4422-ab3d-f6b9d905bee3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:42.617869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9f6196a-cd96-4422-ab3d-f6b9d905bee3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:42.618663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9f6196a-cd96-4422-ab3d-f6b9d905bee3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:42.697342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f9f6196a-cd96-4422-ab3d-f6b9d905bee3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:42.706427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f9f6196a-cd96-4422-ab3d-f6b9d905bee3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.110574 Jul 25 19:44:42.707012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1126/2077] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:42 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:43.005356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-baa26a24-26de-4c47-9989-3b86a28ee46e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:43.006139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-baa26a24-26de-4c47-9989-3b86a28ee46e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:43.015471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baa26a24-26de-4c47-9989-3b86a28ee46e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:43.015973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baa26a24-26de-4c47-9989-3b86a28ee46e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:43.016810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baa26a24-26de-4c47-9989-3b86a28ee46e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:43.017251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baa26a24-26de-4c47-9989-3b86a28ee46e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:43.094636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-baa26a24-26de-4c47-9989-3b86a28ee46e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:43.103674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-baa26a24-26de-4c47-9989-3b86a28ee46e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.101679 Jul 25 19:44:43.104694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 952/2078] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:43 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:43.545390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-801a0254-fd81-4fe1-a718-e6d426ec845f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:43.548062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-801a0254-fd81-4fe1-a718-e6d426ec845f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:43.558784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-801a0254-fd81-4fe1-a718-e6d426ec845f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:43.559131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-801a0254-fd81-4fe1-a718-e6d426ec845f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:43.559985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-801a0254-fd81-4fe1-a718-e6d426ec845f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:43.560426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-801a0254-fd81-4fe1-a718-e6d426ec845f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:43.598608 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-801a0254-fd81-4fe1-a718-e6d426ec845f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058480 Jul 25 19:44:43.599215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1127/2079] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:43 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:43.728869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-49ba5bce-d317-4da8-86e3-85972f65e88c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:43.729517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-49ba5bce-d317-4da8-86e3-85972f65e88c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:43.737756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49ba5bce-d317-4da8-86e3-85972f65e88c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:43.738204 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49ba5bce-d317-4da8-86e3-85972f65e88c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:43.738979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49ba5bce-d317-4da8-86e3-85972f65e88c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:43.739417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49ba5bce-d317-4da8-86e3-85972f65e88c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:43.807941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-49ba5bce-d317-4da8-86e3-85972f65e88c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:43.816499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-49ba5bce-d317-4da8-86e3-85972f65e88c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.091696 Jul 25 19:44:43.817104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 953/2080] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:44.126534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f3045598-945b-461b-9b3e-dc6aa49d2d05 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:44.127349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f3045598-945b-461b-9b3e-dc6aa49d2d05 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:44.134961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3045598-945b-461b-9b3e-dc6aa49d2d05 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:44.135414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3045598-945b-461b-9b3e-dc6aa49d2d05 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:44.136238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3045598-945b-461b-9b3e-dc6aa49d2d05 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:44.136684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3045598-945b-461b-9b3e-dc6aa49d2d05 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:44.226860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3045598-945b-461b-9b3e-dc6aa49d2d05 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:44.235544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f3045598-945b-461b-9b3e-dc6aa49d2d05 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.112901 Jul 25 19:44:44.236145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1128/2081] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:44 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:44.614409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad284d99-5f11-421e-a8eb-acc1ecaed934 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:44.616679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad284d99-5f11-421e-a8eb-acc1ecaed934 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:44.624082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad284d99-5f11-421e-a8eb-acc1ecaed934 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:44.624572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad284d99-5f11-421e-a8eb-acc1ecaed934 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:44.625403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad284d99-5f11-421e-a8eb-acc1ecaed934 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:44.625934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad284d99-5f11-421e-a8eb-acc1ecaed934 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:44.659553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad284d99-5f11-421e-a8eb-acc1ecaed934 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049295 Jul 25 19:44:44.660242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 954/2082] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:44 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:44.838308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-15787d26-34f2-43a9-8088-9786b5589732 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:44.839068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-15787d26-34f2-43a9-8088-9786b5589732 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:44.845799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15787d26-34f2-43a9-8088-9786b5589732 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:44.846247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15787d26-34f2-43a9-8088-9786b5589732 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:44.847014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15787d26-34f2-43a9-8088-9786b5589732 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:44.847444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-15787d26-34f2-43a9-8088-9786b5589732 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:44.916499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-15787d26-34f2-43a9-8088-9786b5589732 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:44.925289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-15787d26-34f2-43a9-8088-9786b5589732 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.091184 Jul 25 19:44:44.925881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1129/2083] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:45.269374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-40b9f57f-d9b8-4032-a4f9-e5b46f8e8d37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:45.270061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-40b9f57f-d9b8-4032-a4f9-e5b46f8e8d37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:45.277540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40b9f57f-d9b8-4032-a4f9-e5b46f8e8d37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:45.278071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40b9f57f-d9b8-4032-a4f9-e5b46f8e8d37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:45.278911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40b9f57f-d9b8-4032-a4f9-e5b46f8e8d37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:45.279485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40b9f57f-d9b8-4032-a4f9-e5b46f8e8d37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:45.354962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-40b9f57f-d9b8-4032-a4f9-e5b46f8e8d37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:45.363820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-40b9f57f-d9b8-4032-a4f9-e5b46f8e8d37 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.102458 Jul 25 19:44:45.364521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 955/2084] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:45 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:45.672391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4e557cea-314f-4d45-be01-ab1fb2ca3321 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:45.674671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4e557cea-314f-4d45-be01-ab1fb2ca3321 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:45.681558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e557cea-314f-4d45-be01-ab1fb2ca3321 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:45.682312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e557cea-314f-4d45-be01-ab1fb2ca3321 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:45.683077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e557cea-314f-4d45-be01-ab1fb2ca3321 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:45.683655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e557cea-314f-4d45-be01-ab1fb2ca3321 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:45.703042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:45.719197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4e557cea-314f-4d45-be01-ab1fb2ca3321 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050886 Jul 25 19:44:45.719872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1130/2085] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:45 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:44:45.948788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d22242f3-af0a-4b2e-b323-5af53ef76449 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:45.949314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d22242f3-af0a-4b2e-b323-5af53ef76449 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:45.956093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d22242f3-af0a-4b2e-b323-5af53ef76449 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:45.956699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d22242f3-af0a-4b2e-b323-5af53ef76449 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:45.957607 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d22242f3-af0a-4b2e-b323-5af53ef76449 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:45.958049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d22242f3-af0a-4b2e-b323-5af53ef76449 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:46.030858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d22242f3-af0a-4b2e-b323-5af53ef76449 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:46.039779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d22242f3-af0a-4b2e-b323-5af53ef76449 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095745 Jul 25 19:44:46.041121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 956/2086] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:46.388155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5444696d-b8a6-4880-80e6-d8cb5f4f77a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:46.388921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5444696d-b8a6-4880-80e6-d8cb5f4f77a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:46.396216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5444696d-b8a6-4880-80e6-d8cb5f4f77a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:46.396753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5444696d-b8a6-4880-80e6-d8cb5f4f77a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:46.397615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5444696d-b8a6-4880-80e6-d8cb5f4f77a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:46.398114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5444696d-b8a6-4880-80e6-d8cb5f4f77a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:46.477354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5444696d-b8a6-4880-80e6-d8cb5f4f77a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:46.490502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5444696d-b8a6-4880-80e6-d8cb5f4f77a0 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.107810 Jul 25 19:44:46.491224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1131/2087] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:46 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:46.734616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ee2e72b-ac05-4ebe-ace8-e5c5591a10f2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:46.739447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ee2e72b-ac05-4ebe-ace8-e5c5591a10f2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:46.750775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ee2e72b-ac05-4ebe-ace8-e5c5591a10f2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:46.751564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ee2e72b-ac05-4ebe-ace8-e5c5591a10f2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:46.752964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ee2e72b-ac05-4ebe-ace8-e5c5591a10f2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:46.753904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ee2e72b-ac05-4ebe-ace8-e5c5591a10f2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:46.801825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4ee2e72b-ac05-4ebe-ace8-e5c5591a10f2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072378 Jul 25 19:44:46.802498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 957/2088] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:46 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:47.063385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8620d8bc-a775-497b-9b16-aea99af703c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:47.064035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8620d8bc-a775-497b-9b16-aea99af703c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:47.070877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8620d8bc-a775-497b-9b16-aea99af703c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:47.071402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8620d8bc-a775-497b-9b16-aea99af703c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:47.072467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8620d8bc-a775-497b-9b16-aea99af703c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:47.072920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8620d8bc-a775-497b-9b16-aea99af703c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:47.141037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8620d8bc-a775-497b-9b16-aea99af703c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:47.149526 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8620d8bc-a775-497b-9b16-aea99af703c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089940 Jul 25 19:44:47.150728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1132/2089] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:47.515944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5b0b9251-a146-4da6-889f-49813d468b70 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:47.516460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5b0b9251-a146-4da6-889f-49813d468b70 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:47.522736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b0b9251-a146-4da6-889f-49813d468b70 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:47.523181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b0b9251-a146-4da6-889f-49813d468b70 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:47.523984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b0b9251-a146-4da6-889f-49813d468b70 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:47.524422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b0b9251-a146-4da6-889f-49813d468b70 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:47.593569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5b0b9251-a146-4da6-889f-49813d468b70 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:47.601588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5b0b9251-a146-4da6-889f-49813d468b70 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.089576 Jul 25 19:44:47.602184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 958/2090] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:47 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:47.816890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bfb5803f-6cae-4735-8212-ea9a06c82942 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:47.819033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bfb5803f-6cae-4735-8212-ea9a06c82942 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:47.831265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bfb5803f-6cae-4735-8212-ea9a06c82942 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:47.831742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bfb5803f-6cae-4735-8212-ea9a06c82942 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:47.832521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bfb5803f-6cae-4735-8212-ea9a06c82942 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:47.832956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bfb5803f-6cae-4735-8212-ea9a06c82942 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:47.865949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bfb5803f-6cae-4735-8212-ea9a06c82942 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053424 Jul 25 19:44:47.866535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1133/2091] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:47 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:48.172348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-30f33c68-7806-42ae-b8b7-136c2c4d4954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:48.172963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-30f33c68-7806-42ae-b8b7-136c2c4d4954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:48.179638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30f33c68-7806-42ae-b8b7-136c2c4d4954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:48.180088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30f33c68-7806-42ae-b8b7-136c2c4d4954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:48.180912 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30f33c68-7806-42ae-b8b7-136c2c4d4954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:48.181421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30f33c68-7806-42ae-b8b7-136c2c4d4954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:48.245859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-30f33c68-7806-42ae-b8b7-136c2c4d4954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:48.249369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:44:48.255250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-30f33c68-7806-42ae-b8b7-136c2c4d4954 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086649 Jul 25 19:44:48.255882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 959/2092] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:48.623176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-38ff5481-8325-4592-8f93-40fab93b5adf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:48.623932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-38ff5481-8325-4592-8f93-40fab93b5adf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:48.630687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38ff5481-8325-4592-8f93-40fab93b5adf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:48.631120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38ff5481-8325-4592-8f93-40fab93b5adf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:48.631913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38ff5481-8325-4592-8f93-40fab93b5adf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:48.632412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38ff5481-8325-4592-8f93-40fab93b5adf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:48.698305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-38ff5481-8325-4592-8f93-40fab93b5adf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:48.706691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-38ff5481-8325-4592-8f93-40fab93b5adf tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.087431 Jul 25 19:44:48.707300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1134/2093] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:48 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:48.879265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-75652678-3d5d-4f8b-86f8-939eae8cffeb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:48.881724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-75652678-3d5d-4f8b-86f8-939eae8cffeb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:48.889553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75652678-3d5d-4f8b-86f8-939eae8cffeb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:48.890009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75652678-3d5d-4f8b-86f8-939eae8cffeb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:48.890796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75652678-3d5d-4f8b-86f8-939eae8cffeb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:48.891263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75652678-3d5d-4f8b-86f8-939eae8cffeb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:48.924828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-75652678-3d5d-4f8b-86f8-939eae8cffeb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050008 Jul 25 19:44:48.925431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 960/2094] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 19:44:48 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:44:49.277186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b76cc55e-5496-4713-8096-7f6a616266c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:49.277803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b76cc55e-5496-4713-8096-7f6a616266c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:49.284026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b76cc55e-5496-4713-8096-7f6a616266c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:49.284470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b76cc55e-5496-4713-8096-7f6a616266c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:49.285236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b76cc55e-5496-4713-8096-7f6a616266c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:49.285672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b76cc55e-5496-4713-8096-7f6a616266c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:49.350305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b76cc55e-5496-4713-8096-7f6a616266c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:49.360422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b76cc55e-5496-4713-8096-7f6a616266c1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087002 Jul 25 19:44:49.361007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1135/2095] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:49.727878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d57ac604-8a8c-40d6-89e6-c9e77f3b93c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:49.728652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d57ac604-8a8c-40d6-89e6-c9e77f3b93c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:49.735800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d57ac604-8a8c-40d6-89e6-c9e77f3b93c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:49.736243 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d57ac604-8a8c-40d6-89e6-c9e77f3b93c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:49.737006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d57ac604-8a8c-40d6-89e6-c9e77f3b93c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:49.737438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d57ac604-8a8c-40d6-89e6-c9e77f3b93c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:49.807670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d57ac604-8a8c-40d6-89e6-c9e77f3b93c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:49.815470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d57ac604-8a8c-40d6-89e6-c9e77f3b93c1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.091617 Jul 25 19:44:49.816081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 961/2096] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:49 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:49.938388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3e78af5d-94f3-4e66-8996-3dfd3fa2a186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:44:49.940633 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3e78af5d-94f3-4e66-8996-3dfd3fa2a186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:49.950144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3e78af5d-94f3-4e66-8996-3dfd3fa2a186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:49.950589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3e78af5d-94f3-4e66-8996-3dfd3fa2a186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:49.951362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3e78af5d-94f3-4e66-8996-3dfd3fa2a186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:49.951823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3e78af5d-94f3-4e66-8996-3dfd3fa2a186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:50.072099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3e78af5d-94f3-4e66-8996-3dfd3fa2a186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "POST /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/action" status: 200 len: 76156 microversion: 2.1 time: 0.137029 Jul 25 19:44:50.073033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1136/2097] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 19:44:49 2022] POST /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079/action => generated 76156 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:44:50.382320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1717c5b9-0131-472e-ae47-a691f7fc72c5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:50.382846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1717c5b9-0131-472e-ae47-a691f7fc72c5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:50.389487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1717c5b9-0131-472e-ae47-a691f7fc72c5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:50.389939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1717c5b9-0131-472e-ae47-a691f7fc72c5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:50.391400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1717c5b9-0131-472e-ae47-a691f7fc72c5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:50.391915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1717c5b9-0131-472e-ae47-a691f7fc72c5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:50.465171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1717c5b9-0131-472e-ae47-a691f7fc72c5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:50.474521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1717c5b9-0131-472e-ae47-a691f7fc72c5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.096049 Jul 25 19:44:50.475139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 962/2098] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:50.838101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-79cc439c-e8a8-442a-85d8-d9a8b849df5c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:50.839019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-79cc439c-e8a8-442a-85d8-d9a8b849df5c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:50.846594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79cc439c-e8a8-442a-85d8-d9a8b849df5c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:50.847079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79cc439c-e8a8-442a-85d8-d9a8b849df5c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:50.847963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79cc439c-e8a8-442a-85d8-d9a8b849df5c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:50.848300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79cc439c-e8a8-442a-85d8-d9a8b849df5c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:50.916558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-18aa9a49-fd12-4643-86f2-cb246eeca2aa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:50.917105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-18aa9a49-fd12-4643-86f2-cb246eeca2aa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:50.923308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-79cc439c-e8a8-442a-85d8-d9a8b849df5c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:50.924475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18aa9a49-fd12-4643-86f2-cb246eeca2aa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:50.925060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18aa9a49-fd12-4643-86f2-cb246eeca2aa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:50.925756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18aa9a49-fd12-4643-86f2-cb246eeca2aa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:50.926268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18aa9a49-fd12-4643-86f2-cb246eeca2aa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:50.932769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-79cc439c-e8a8-442a-85d8-d9a8b849df5c tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.099298 Jul 25 19:44:50.933425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1137/2099] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:50 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:50.965458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-18aa9a49-fd12-4643-86f2-cb246eeca2aa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:44:51.066514 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-18aa9a49-fd12-4643-86f2-cb246eeca2aa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 204 len: 0 microversion: 2.20 time: 0.153944 Jul 25 19:44:51.067150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 963/2100] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Jul 25 19:44:50 2022] DELETE /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 19:44:51.077357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf3836da-c45b-43ed-bb54-cff25b887d4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:51.078157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cf3836da-c45b-43ed-bb54-cff25b887d4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:51.085114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf3836da-c45b-43ed-bb54-cff25b887d4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:51.085561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf3836da-c45b-43ed-bb54-cff25b887d4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:51.086329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf3836da-c45b-43ed-bb54-cff25b887d4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:51.086764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf3836da-c45b-43ed-bb54-cff25b887d4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:51.235776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf3836da-c45b-43ed-bb54-cff25b887d4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:51.245557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf3836da-c45b-43ed-bb54-cff25b887d4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:51.247176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf3836da-c45b-43ed-bb54-cff25b887d4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:51.248460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cf3836da-c45b-43ed-bb54-cff25b887d4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.176751 Jul 25 19:44:51.249068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1138/2101] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:44:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:44:51.499315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9aa3f261-73ad-4f36-bd7b-90c839b1b097 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:51.499957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9aa3f261-73ad-4f36-bd7b-90c839b1b097 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:51.506486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9aa3f261-73ad-4f36-bd7b-90c839b1b097 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:51.506934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9aa3f261-73ad-4f36-bd7b-90c839b1b097 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:51.507768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9aa3f261-73ad-4f36-bd7b-90c839b1b097 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:51.508213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9aa3f261-73ad-4f36-bd7b-90c839b1b097 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:51.579190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9aa3f261-73ad-4f36-bd7b-90c839b1b097 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:51.588733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9aa3f261-73ad-4f36-bd7b-90c839b1b097 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.093758 Jul 25 19:44:51.589409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 964/2102] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:51.954040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1c9ff931-00b6-4db6-b908-1d51cd83aaa1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:51.954663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1c9ff931-00b6-4db6-b908-1d51cd83aaa1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] [instance: a44f6c42-c9a6-4a85-8776-d2f694f0ac8e] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:51.962877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c9ff931-00b6-4db6-b908-1d51cd83aaa1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:51.963457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c9ff931-00b6-4db6-b908-1d51cd83aaa1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:51.964247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c9ff931-00b6-4db6-b908-1d51cd83aaa1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:51.964681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c9ff931-00b6-4db6-b908-1d51cd83aaa1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:52.035312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1c9ff931-00b6-4db6-b908-1d51cd83aaa1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574d0113dce74ab199c0162abe26934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9166cf61c5d944fd9f1e2174c6544faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:52.043989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1c9ff931-00b6-4db6-b908-1d51cd83aaa1 tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e" status: 200 len: 1213 microversion: 2.1 time: 0.093935 Jul 25 19:44:52.044580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1139/2103] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:51 2022] GET /compute/v2.1/servers/a44f6c42-c9a6-4a85-8776-d2f694f0ac8e => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:52.249325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b63078c1-24e2-4498-8753-3440f559f27e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] Calling method '.version_select at 0x7feb0c4ba8b0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:52.277237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-23de35c9-1bff-4536-bf8f-f953204fef0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:52.278183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-23de35c9-1bff-4536-bf8f-f953204fef0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:52.287496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b63078c1-24e2-4498-8753-3440f559f27e tempest-TestShelveInstance-1924694863 tempest-TestShelveInstance-1924694863-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1963016785" status: 202 len: 0 microversion: 2.1 time: 0.045421 Jul 25 19:44:52.288712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 965/2104] 10.222.0.18 () {58 vars in 1254 bytes} [Mon Jul 25 19:44:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1963016785 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:44:52.302875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23de35c9-1bff-4536-bf8f-f953204fef0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:52.303320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23de35c9-1bff-4536-bf8f-f953204fef0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:52.304266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23de35c9-1bff-4536-bf8f-f953204fef0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:52.304727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23de35c9-1bff-4536-bf8f-f953204fef0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:52.492872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-23de35c9-1bff-4536-bf8f-f953204fef0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:52.502270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-23de35c9-1bff-4536-bf8f-f953204fef0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:52.503812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-23de35c9-1bff-4536-bf8f-f953204fef0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:52.505022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-23de35c9-1bff-4536-bf8f-f953204fef0c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.235190 Jul 25 19:44:52.505578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1140/2105] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:44:52 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:44:52.619093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-75a287f9-5ccb-4b93-b110-669c77738016 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:52.620282 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-75a287f9-5ccb-4b93-b110-669c77738016 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:52.628443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75a287f9-5ccb-4b93-b110-669c77738016 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:52.628885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75a287f9-5ccb-4b93-b110-669c77738016 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:52.629682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75a287f9-5ccb-4b93-b110-669c77738016 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:52.630100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75a287f9-5ccb-4b93-b110-669c77738016 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:52.730453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-75a287f9-5ccb-4b93-b110-669c77738016 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:52.739651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-75a287f9-5ccb-4b93-b110-669c77738016 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.127673 Jul 25 19:44:52.740247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 966/2106] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:52 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:53.530355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-624f8d48-7287-4bb9-934c-0fdddd0baf44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:53.531135 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-624f8d48-7287-4bb9-934c-0fdddd0baf44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:53.538108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-624f8d48-7287-4bb9-934c-0fdddd0baf44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:53.538555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-624f8d48-7287-4bb9-934c-0fdddd0baf44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:53.539354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-624f8d48-7287-4bb9-934c-0fdddd0baf44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:53.539834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-624f8d48-7287-4bb9-934c-0fdddd0baf44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:53.692229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-624f8d48-7287-4bb9-934c-0fdddd0baf44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:53.702131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-624f8d48-7287-4bb9-934c-0fdddd0baf44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:53.703687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-624f8d48-7287-4bb9-934c-0fdddd0baf44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:53.704882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-624f8d48-7287-4bb9-934c-0fdddd0baf44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.179147 Jul 25 19:44:53.705467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1141/2107] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:44:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:44:53.764879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-84327c4b-f238-408f-87f6-af6c07631347 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:53.765474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-84327c4b-f238-408f-87f6-af6c07631347 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:53.771985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84327c4b-f238-408f-87f6-af6c07631347 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:53.772427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84327c4b-f238-408f-87f6-af6c07631347 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:53.773410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84327c4b-f238-408f-87f6-af6c07631347 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:53.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84327c4b-f238-408f-87f6-af6c07631347 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:53.856416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84327c4b-f238-408f-87f6-af6c07631347 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:53.869385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-84327c4b-f238-408f-87f6-af6c07631347 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.111061 Jul 25 19:44:53.870471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 967/2108] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:54.729686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e33c977b-eb15-487b-9209-bfa7152aa6d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:54.730425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e33c977b-eb15-487b-9209-bfa7152aa6d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:54.738176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e33c977b-eb15-487b-9209-bfa7152aa6d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:54.738790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e33c977b-eb15-487b-9209-bfa7152aa6d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:54.739965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e33c977b-eb15-487b-9209-bfa7152aa6d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:54.740478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e33c977b-eb15-487b-9209-bfa7152aa6d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:54.892563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ac110eb6-749e-4b6d-be55-2c02e119899e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:54.893884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ac110eb6-749e-4b6d-be55-2c02e119899e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:54.901835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac110eb6-749e-4b6d-be55-2c02e119899e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:54.902526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac110eb6-749e-4b6d-be55-2c02e119899e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:54.903157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e33c977b-eb15-487b-9209-bfa7152aa6d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:54.903919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac110eb6-749e-4b6d-be55-2c02e119899e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:54.904577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac110eb6-749e-4b6d-be55-2c02e119899e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:54.917149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e33c977b-eb15-487b-9209-bfa7152aa6d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:54.919383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e33c977b-eb15-487b-9209-bfa7152aa6d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:54.920786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e33c977b-eb15-487b-9209-bfa7152aa6d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.195846 Jul 25 19:44:54.922642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1142/2109] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:44:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:44:54.992665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ac110eb6-749e-4b6d-be55-2c02e119899e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:55.016586 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ac110eb6-749e-4b6d-be55-2c02e119899e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.122892 Jul 25 19:44:55.031256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 968/2110] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:44:55.951235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-28bbd959-5e6d-4275-80e5-994fe3578df9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:55.951915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-28bbd959-5e6d-4275-80e5-994fe3578df9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:55.964058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28bbd959-5e6d-4275-80e5-994fe3578df9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:55.968019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28bbd959-5e6d-4275-80e5-994fe3578df9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:55.968885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28bbd959-5e6d-4275-80e5-994fe3578df9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:55.969329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28bbd959-5e6d-4275-80e5-994fe3578df9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:56.041397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-72984b4b-4673-43e4-aa27-840acf51e669 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:56.042551 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-72984b4b-4673-43e4-aa27-840acf51e669 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:56.058377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72984b4b-4673-43e4-aa27-840acf51e669 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:56.058893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72984b4b-4673-43e4-aa27-840acf51e669 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:56.059746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72984b4b-4673-43e4-aa27-840acf51e669 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:56.060189 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72984b4b-4673-43e4-aa27-840acf51e669 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:56.170664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-72984b4b-4673-43e4-aa27-840acf51e669 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:56.180117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-72984b4b-4673-43e4-aa27-840acf51e669 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.145395 Jul 25 19:44:56.180762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 969/2111] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:56.260386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-28bbd959-5e6d-4275-80e5-994fe3578df9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:56.273393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-28bbd959-5e6d-4275-80e5-994fe3578df9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:56.276545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-28bbd959-5e6d-4275-80e5-994fe3578df9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:56.278096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-28bbd959-5e6d-4275-80e5-994fe3578df9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.335266 Jul 25 19:44:56.278702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1143/2112] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:44:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:44:57.216994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-692a49be-c52b-45c9-8cf0-c9acdc424188 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:57.217878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-692a49be-c52b-45c9-8cf0-c9acdc424188 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:57.229798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-692a49be-c52b-45c9-8cf0-c9acdc424188 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:57.230573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-692a49be-c52b-45c9-8cf0-c9acdc424188 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:57.232074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-692a49be-c52b-45c9-8cf0-c9acdc424188 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:57.232887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-692a49be-c52b-45c9-8cf0-c9acdc424188 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:57.317872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-692a49be-c52b-45c9-8cf0-c9acdc424188 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:57.327487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ed8a288b-5a80-4700-8197-0fd3b9196a9c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:57.328518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ed8a288b-5a80-4700-8197-0fd3b9196a9c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:57.330345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-692a49be-c52b-45c9-8cf0-c9acdc424188 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.121134 Jul 25 19:44:57.331355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 970/2113] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:57.340171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed8a288b-5a80-4700-8197-0fd3b9196a9c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:57.340625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed8a288b-5a80-4700-8197-0fd3b9196a9c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:57.341417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed8a288b-5a80-4700-8197-0fd3b9196a9c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:57.341864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed8a288b-5a80-4700-8197-0fd3b9196a9c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:57.517115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ed8a288b-5a80-4700-8197-0fd3b9196a9c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:57.526931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ed8a288b-5a80-4700-8197-0fd3b9196a9c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:57.528496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ed8a288b-5a80-4700-8197-0fd3b9196a9c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:57.529745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ed8a288b-5a80-4700-8197-0fd3b9196a9c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.206440 Jul 25 19:44:57.530414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1144/2114] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:44:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:44:58.365404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-722b7a0e-de84-4194-95c4-e0c365cb13e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:58.366380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-722b7a0e-de84-4194-95c4-e0c365cb13e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:58.373709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-722b7a0e-de84-4194-95c4-e0c365cb13e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:58.374150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-722b7a0e-de84-4194-95c4-e0c365cb13e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:58.375922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-722b7a0e-de84-4194-95c4-e0c365cb13e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:58.376422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-722b7a0e-de84-4194-95c4-e0c365cb13e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:58.490518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-722b7a0e-de84-4194-95c4-e0c365cb13e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:58.525529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-722b7a0e-de84-4194-95c4-e0c365cb13e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.162807 Jul 25 19:44:58.549908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 971/2115] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:58.562770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3b6fee1c-783c-4e7d-8d80-289019cc650e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:58.564225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3b6fee1c-783c-4e7d-8d80-289019cc650e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:58.572409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b6fee1c-783c-4e7d-8d80-289019cc650e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:58.573248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b6fee1c-783c-4e7d-8d80-289019cc650e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:58.574275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b6fee1c-783c-4e7d-8d80-289019cc650e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:58.574926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b6fee1c-783c-4e7d-8d80-289019cc650e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:58.779169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b6fee1c-783c-4e7d-8d80-289019cc650e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:58.796379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b6fee1c-783c-4e7d-8d80-289019cc650e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:58.800007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b6fee1c-783c-4e7d-8d80-289019cc650e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:58.802207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3b6fee1c-783c-4e7d-8d80-289019cc650e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.246982 Jul 25 19:44:58.803917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1145/2116] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:44:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:44:58.915396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:44:58.915801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:44:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:44:59.556263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7363fb50-1920-40e9-8430-17775a92af52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:59.557403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7363fb50-1920-40e9-8430-17775a92af52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:59.565868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7363fb50-1920-40e9-8430-17775a92af52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:59.566325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7363fb50-1920-40e9-8430-17775a92af52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:59.567112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7363fb50-1920-40e9-8430-17775a92af52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:59.567572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7363fb50-1920-40e9-8430-17775a92af52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:59.672846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7363fb50-1920-40e9-8430-17775a92af52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:44:59.682925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7363fb50-1920-40e9-8430-17775a92af52 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.131690 Jul 25 19:44:59.683439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 972/2117] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:44:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:44:59.835281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f3e92d56-1b47-4185-b24c-623fc9cd2c7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:44:59.837988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f3e92d56-1b47-4185-b24c-623fc9cd2c7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:44:59.862046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3e92d56-1b47-4185-b24c-623fc9cd2c7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:59.863956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3e92d56-1b47-4185-b24c-623fc9cd2c7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:44:59.866816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3e92d56-1b47-4185-b24c-623fc9cd2c7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:44:59.868053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3e92d56-1b47-4185-b24c-623fc9cd2c7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:00.135316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3e92d56-1b47-4185-b24c-623fc9cd2c7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:00.145651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3e92d56-1b47-4185-b24c-623fc9cd2c7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:00.147043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3e92d56-1b47-4185-b24c-623fc9cd2c7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:00.148138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f3e92d56-1b47-4185-b24c-623fc9cd2c7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.322490 Jul 25 19:45:00.166972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1146/2118] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:44:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:00.720617 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-44ef9933-b237-4582-94c0-c894d36bf180 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:00.721370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-44ef9933-b237-4582-94c0-c894d36bf180 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:00.741943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44ef9933-b237-4582-94c0-c894d36bf180 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:00.742902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44ef9933-b237-4582-94c0-c894d36bf180 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:00.746191 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44ef9933-b237-4582-94c0-c894d36bf180 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:00.746981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44ef9933-b237-4582-94c0-c894d36bf180 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:00.854077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-44ef9933-b237-4582-94c0-c894d36bf180 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:00.865277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-44ef9933-b237-4582-94c0-c894d36bf180 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.152284 Jul 25 19:45:00.865868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 973/2119] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:01.176577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-76e409bb-b396-4055-b9bc-025169cd3915 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:01.177446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-76e409bb-b396-4055-b9bc-025169cd3915 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:01.184984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e409bb-b396-4055-b9bc-025169cd3915 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:01.185436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e409bb-b396-4055-b9bc-025169cd3915 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:01.186227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e409bb-b396-4055-b9bc-025169cd3915 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:01.186670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e409bb-b396-4055-b9bc-025169cd3915 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:01.210061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:01.403123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-76e409bb-b396-4055-b9bc-025169cd3915 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:01.414143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-76e409bb-b396-4055-b9bc-025169cd3915 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:01.416965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-76e409bb-b396-4055-b9bc-025169cd3915 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:01.418194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-76e409bb-b396-4055-b9bc-025169cd3915 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.248510 Jul 25 19:45:01.418783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1147/2120] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:01 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:01.894145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f14b8e36-4f40-401f-b39f-7afb69d70269 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:01.895396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f14b8e36-4f40-401f-b39f-7afb69d70269 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:01.907787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f14b8e36-4f40-401f-b39f-7afb69d70269 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:01.908471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f14b8e36-4f40-401f-b39f-7afb69d70269 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:01.909729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f14b8e36-4f40-401f-b39f-7afb69d70269 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:01.910525 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f14b8e36-4f40-401f-b39f-7afb69d70269 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:02.008978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f14b8e36-4f40-401f-b39f-7afb69d70269 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:02.018393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f14b8e36-4f40-401f-b39f-7afb69d70269 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.132145 Jul 25 19:45:02.019203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 974/2121] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:02.450057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2857e07e-2da7-494e-90b5-10488647dc78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:02.450625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2857e07e-2da7-494e-90b5-10488647dc78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:02.457332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2857e07e-2da7-494e-90b5-10488647dc78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:02.457755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2857e07e-2da7-494e-90b5-10488647dc78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:02.458518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2857e07e-2da7-494e-90b5-10488647dc78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:02.458951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2857e07e-2da7-494e-90b5-10488647dc78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:02.614158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2857e07e-2da7-494e-90b5-10488647dc78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:02.624505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2857e07e-2da7-494e-90b5-10488647dc78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:02.626184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2857e07e-2da7-494e-90b5-10488647dc78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:02.627376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2857e07e-2da7-494e-90b5-10488647dc78 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.181908 Jul 25 19:45:02.628017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1148/2122] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:03.049759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c17c9009-5a29-4422-aa98-f61047c874e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:03.050406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c17c9009-5a29-4422-aa98-f61047c874e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:03.059329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c17c9009-5a29-4422-aa98-f61047c874e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:03.059804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c17c9009-5a29-4422-aa98-f61047c874e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:03.060917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c17c9009-5a29-4422-aa98-f61047c874e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:03.061173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c17c9009-5a29-4422-aa98-f61047c874e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:03.147353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c17c9009-5a29-4422-aa98-f61047c874e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:03.151880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:03.159072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c17c9009-5a29-4422-aa98-f61047c874e2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.113246 Jul 25 19:45:03.159699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 975/2123] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:03 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:03.651594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b3d0332d-460d-4037-ba4a-3186fd2848d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:03.652295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b3d0332d-460d-4037-ba4a-3186fd2848d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:03.661241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3d0332d-460d-4037-ba4a-3186fd2848d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:03.661693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3d0332d-460d-4037-ba4a-3186fd2848d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:03.662487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3d0332d-460d-4037-ba4a-3186fd2848d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:03.663086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b3d0332d-460d-4037-ba4a-3186fd2848d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:03.825783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b3d0332d-460d-4037-ba4a-3186fd2848d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:03.835166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b3d0332d-460d-4037-ba4a-3186fd2848d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:03.837518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b3d0332d-460d-4037-ba4a-3186fd2848d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:03.838886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b3d0332d-460d-4037-ba4a-3186fd2848d6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.191961 Jul 25 19:45:03.839555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1149/2124] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:45:04.183850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f8b92acc-93f2-4db1-9e1c-a06ed23aaa3a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:04.184498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f8b92acc-93f2-4db1-9e1c-a06ed23aaa3a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:04.193157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8b92acc-93f2-4db1-9e1c-a06ed23aaa3a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:04.193611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8b92acc-93f2-4db1-9e1c-a06ed23aaa3a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:04.194406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8b92acc-93f2-4db1-9e1c-a06ed23aaa3a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:04.194848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8b92acc-93f2-4db1-9e1c-a06ed23aaa3a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:04.268559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f8b92acc-93f2-4db1-9e1c-a06ed23aaa3a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:04.276903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f8b92acc-93f2-4db1-9e1c-a06ed23aaa3a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.096958 Jul 25 19:45:04.277497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 976/2125] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:45:04.864905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-53fd2331-2cd5-4cd2-a952-8e0052cd73bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:04.865512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-53fd2331-2cd5-4cd2-a952-8e0052cd73bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:04.873012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53fd2331-2cd5-4cd2-a952-8e0052cd73bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:04.873452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53fd2331-2cd5-4cd2-a952-8e0052cd73bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:04.874216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53fd2331-2cd5-4cd2-a952-8e0052cd73bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:04.874659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53fd2331-2cd5-4cd2-a952-8e0052cd73bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:05.014415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-53fd2331-2cd5-4cd2-a952-8e0052cd73bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:05.023354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-53fd2331-2cd5-4cd2-a952-8e0052cd73bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:05.025521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-53fd2331-2cd5-4cd2-a952-8e0052cd73bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:05.026695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-53fd2331-2cd5-4cd2-a952-8e0052cd73bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.165832 Jul 25 19:45:05.027261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1150/2126] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:05.299975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-06eaba0c-67c5-4a4d-acdd-a901ebd68eef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:05.300714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-06eaba0c-67c5-4a4d-acdd-a901ebd68eef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:05.310064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06eaba0c-67c5-4a4d-acdd-a901ebd68eef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:05.310688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06eaba0c-67c5-4a4d-acdd-a901ebd68eef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:05.312083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06eaba0c-67c5-4a4d-acdd-a901ebd68eef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:05.312684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06eaba0c-67c5-4a4d-acdd-a901ebd68eef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:05.386220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-06eaba0c-67c5-4a4d-acdd-a901ebd68eef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:05.397444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-06eaba0c-67c5-4a4d-acdd-a901ebd68eef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.103477 Jul 25 19:45:05.398057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 977/2127] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:06.051366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-20007e23-1ba2-4a0e-89a5-1cc1e18cef4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:06.052059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-20007e23-1ba2-4a0e-89a5-1cc1e18cef4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:06.054677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=70 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:06.061870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-20007e23-1ba2-4a0e-89a5-1cc1e18cef4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:06.062402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-20007e23-1ba2-4a0e-89a5-1cc1e18cef4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:06.063201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-20007e23-1ba2-4a0e-89a5-1cc1e18cef4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:06.063685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-20007e23-1ba2-4a0e-89a5-1cc1e18cef4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:06.217641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-20007e23-1ba2-4a0e-89a5-1cc1e18cef4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:06.226651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-20007e23-1ba2-4a0e-89a5-1cc1e18cef4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:06.229134 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-20007e23-1ba2-4a0e-89a5-1cc1e18cef4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:06.230328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-20007e23-1ba2-4a0e-89a5-1cc1e18cef4a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.182907 Jul 25 19:45:06.230897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1151/2128] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:06.420135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dd4e94d8-3376-40ec-a540-6a5b44955ae2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:06.420776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dd4e94d8-3376-40ec-a540-6a5b44955ae2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:06.427354 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd4e94d8-3376-40ec-a540-6a5b44955ae2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:06.427831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd4e94d8-3376-40ec-a540-6a5b44955ae2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:06.428609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd4e94d8-3376-40ec-a540-6a5b44955ae2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:06.429043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd4e94d8-3376-40ec-a540-6a5b44955ae2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:06.500799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd4e94d8-3376-40ec-a540-6a5b44955ae2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:06.515660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dd4e94d8-3376-40ec-a540-6a5b44955ae2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099535 Jul 25 19:45:06.516516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 978/2129] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:07.254542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-364c7f1a-bdc5-4869-bd95-235a6d09787b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:07.255160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-364c7f1a-bdc5-4869-bd95-235a6d09787b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:07.262929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-364c7f1a-bdc5-4869-bd95-235a6d09787b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:07.263627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-364c7f1a-bdc5-4869-bd95-235a6d09787b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:07.264965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-364c7f1a-bdc5-4869-bd95-235a6d09787b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:07.265503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-364c7f1a-bdc5-4869-bd95-235a6d09787b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:07.409514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-364c7f1a-bdc5-4869-bd95-235a6d09787b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:07.419181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-364c7f1a-bdc5-4869-bd95-235a6d09787b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:07.420727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-364c7f1a-bdc5-4869-bd95-235a6d09787b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:07.421994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-364c7f1a-bdc5-4869-bd95-235a6d09787b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.171304 Jul 25 19:45:07.422656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1152/2130] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:07.541793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8206435e-94a8-4337-9091-b96d98b970ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:07.542428 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8206435e-94a8-4337-9091-b96d98b970ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:07.544962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:07.551109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8206435e-94a8-4337-9091-b96d98b970ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:07.551581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8206435e-94a8-4337-9091-b96d98b970ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:07.552368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8206435e-94a8-4337-9091-b96d98b970ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:07.552807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8206435e-94a8-4337-9091-b96d98b970ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:07.631443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8206435e-94a8-4337-9091-b96d98b970ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:07.641114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8206435e-94a8-4337-9091-b96d98b970ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.107440 Jul 25 19:45:07.641936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 979/2131] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:45:08.448645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b05feb58-98c6-4d53-aca6-a39871ef0ee4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:08.449205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b05feb58-98c6-4d53-aca6-a39871ef0ee4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:08.455887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b05feb58-98c6-4d53-aca6-a39871ef0ee4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:08.456335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b05feb58-98c6-4d53-aca6-a39871ef0ee4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:08.457113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b05feb58-98c6-4d53-aca6-a39871ef0ee4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:08.457552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b05feb58-98c6-4d53-aca6-a39871ef0ee4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:08.608484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b05feb58-98c6-4d53-aca6-a39871ef0ee4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:08.618538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b05feb58-98c6-4d53-aca6-a39871ef0ee4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:08.620240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b05feb58-98c6-4d53-aca6-a39871ef0ee4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:08.621425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b05feb58-98c6-4d53-aca6-a39871ef0ee4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.177108 Jul 25 19:45:08.621999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1153/2132] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:08.971406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-754d4e1d-eac9-425a-8cf1-b371bfecfa92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:08.972548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-754d4e1d-eac9-425a-8cf1-b371bfecfa92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:08.984787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-754d4e1d-eac9-425a-8cf1-b371bfecfa92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:08.985829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-754d4e1d-eac9-425a-8cf1-b371bfecfa92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:08.987400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-754d4e1d-eac9-425a-8cf1-b371bfecfa92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:08.988219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-754d4e1d-eac9-425a-8cf1-b371bfecfa92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:09.197892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-754d4e1d-eac9-425a-8cf1-b371bfecfa92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:09.206220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-754d4e1d-eac9-425a-8cf1-b371bfecfa92 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.543993 Jul 25 19:45:09.206820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 980/2133] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:09.645656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6b9f4912-9743-468f-98f8-9c02d54da88f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:09.646294 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6b9f4912-9743-468f-98f8-9c02d54da88f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:09.653698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b9f4912-9743-468f-98f8-9c02d54da88f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:09.654145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b9f4912-9743-468f-98f8-9c02d54da88f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:09.654936 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b9f4912-9743-468f-98f8-9c02d54da88f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:09.655376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6b9f4912-9743-468f-98f8-9c02d54da88f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:09.857640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6b9f4912-9743-468f-98f8-9c02d54da88f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:09.867150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6b9f4912-9743-468f-98f8-9c02d54da88f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:09.869434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6b9f4912-9743-468f-98f8-9c02d54da88f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:09.870651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6b9f4912-9743-468f-98f8-9c02d54da88f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.228949 Jul 25 19:45:09.871237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1154/2134] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:10.227908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-784980ee-55dc-4dbd-aef2-95932ec5c82b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:10.228554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-784980ee-55dc-4dbd-aef2-95932ec5c82b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:10.235599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-784980ee-55dc-4dbd-aef2-95932ec5c82b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:10.236048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-784980ee-55dc-4dbd-aef2-95932ec5c82b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:10.236827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-784980ee-55dc-4dbd-aef2-95932ec5c82b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:10.237260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-784980ee-55dc-4dbd-aef2-95932ec5c82b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:10.303771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-784980ee-55dc-4dbd-aef2-95932ec5c82b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:10.312217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-784980ee-55dc-4dbd-aef2-95932ec5c82b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088147 Jul 25 19:45:10.312800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 981/2135] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:10.895748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f2f0ad34-65d6-415b-8f24-ecb280082a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:10.896381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f2f0ad34-65d6-415b-8f24-ecb280082a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:10.903976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2f0ad34-65d6-415b-8f24-ecb280082a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:10.904423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2f0ad34-65d6-415b-8f24-ecb280082a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:10.907554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2f0ad34-65d6-415b-8f24-ecb280082a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:10.907554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2f0ad34-65d6-415b-8f24-ecb280082a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:11.045230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f2f0ad34-65d6-415b-8f24-ecb280082a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:11.053845 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f2f0ad34-65d6-415b-8f24-ecb280082a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:11.055545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f2f0ad34-65d6-415b-8f24-ecb280082a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:11.057074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f2f0ad34-65d6-415b-8f24-ecb280082a9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.165299 Jul 25 19:45:11.057637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1155/2136] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:11.334234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3aa4fd7b-1683-4d3d-871e-0f97f6efa4c3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:11.335171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3aa4fd7b-1683-4d3d-871e-0f97f6efa4c3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:11.342891 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3aa4fd7b-1683-4d3d-871e-0f97f6efa4c3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:11.343330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3aa4fd7b-1683-4d3d-871e-0f97f6efa4c3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:11.344126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3aa4fd7b-1683-4d3d-871e-0f97f6efa4c3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:11.344565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3aa4fd7b-1683-4d3d-871e-0f97f6efa4c3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:11.415900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3aa4fd7b-1683-4d3d-871e-0f97f6efa4c3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:11.424388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3aa4fd7b-1683-4d3d-871e-0f97f6efa4c3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.093993 Jul 25 19:45:11.424893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 982/2137] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:11 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:12.080252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-75e07ec0-1303-4a12-a443-afb973d9a2b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:12.082495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-75e07ec0-1303-4a12-a443-afb973d9a2b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:12.089805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75e07ec0-1303-4a12-a443-afb973d9a2b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:12.090256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75e07ec0-1303-4a12-a443-afb973d9a2b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:12.091031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75e07ec0-1303-4a12-a443-afb973d9a2b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:12.091468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75e07ec0-1303-4a12-a443-afb973d9a2b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:12.229248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-75e07ec0-1303-4a12-a443-afb973d9a2b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:12.238177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-75e07ec0-1303-4a12-a443-afb973d9a2b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:12.239688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-75e07ec0-1303-4a12-a443-afb973d9a2b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:12.240834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-75e07ec0-1303-4a12-a443-afb973d9a2b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.164840 Jul 25 19:45:12.241399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1156/2138] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:12.447055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e5cf3009-bcb2-4456-8e8a-07d3489282de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:12.447881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e5cf3009-bcb2-4456-8e8a-07d3489282de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:12.454983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5cf3009-bcb2-4456-8e8a-07d3489282de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:12.455432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5cf3009-bcb2-4456-8e8a-07d3489282de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:12.456254 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5cf3009-bcb2-4456-8e8a-07d3489282de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:12.456693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5cf3009-bcb2-4456-8e8a-07d3489282de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:12.525708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e5cf3009-bcb2-4456-8e8a-07d3489282de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:12.534605 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e5cf3009-bcb2-4456-8e8a-07d3489282de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092793 Jul 25 19:45:12.535190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 983/2139] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:13.265252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-008d2eb8-631b-41bc-9b78-2d5f29c3ef10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:13.265976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-008d2eb8-631b-41bc-9b78-2d5f29c3ef10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:13.272860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-008d2eb8-631b-41bc-9b78-2d5f29c3ef10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:13.273327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-008d2eb8-631b-41bc-9b78-2d5f29c3ef10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:13.274666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-008d2eb8-631b-41bc-9b78-2d5f29c3ef10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:13.275469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-008d2eb8-631b-41bc-9b78-2d5f29c3ef10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:13.424865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-008d2eb8-631b-41bc-9b78-2d5f29c3ef10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:13.434554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-008d2eb8-631b-41bc-9b78-2d5f29c3ef10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:13.436071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-008d2eb8-631b-41bc-9b78-2d5f29c3ef10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:13.437210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-008d2eb8-631b-41bc-9b78-2d5f29c3ef10 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.176265 Jul 25 19:45:13.437766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1157/2140] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:13.557509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a9bb4414-e8b8-4274-bea6-329351a1188c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:13.558153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a9bb4414-e8b8-4274-bea6-329351a1188c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:13.565821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9bb4414-e8b8-4274-bea6-329351a1188c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:13.566257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9bb4414-e8b8-4274-bea6-329351a1188c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:13.567022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9bb4414-e8b8-4274-bea6-329351a1188c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:13.567451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9bb4414-e8b8-4274-bea6-329351a1188c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:13.638969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a9bb4414-e8b8-4274-bea6-329351a1188c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:13.648485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a9bb4414-e8b8-4274-bea6-329351a1188c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.096154 Jul 25 19:45:13.649984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 984/2141] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:14.461283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-585e8ca1-39ea-4961-b262-29240c191121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:14.462139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-585e8ca1-39ea-4961-b262-29240c191121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:14.468909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585e8ca1-39ea-4961-b262-29240c191121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:14.469349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585e8ca1-39ea-4961-b262-29240c191121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:14.470117 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585e8ca1-39ea-4961-b262-29240c191121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:14.470553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-585e8ca1-39ea-4961-b262-29240c191121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:14.607409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-585e8ca1-39ea-4961-b262-29240c191121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:14.616241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-585e8ca1-39ea-4961-b262-29240c191121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:14.618265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-585e8ca1-39ea-4961-b262-29240c191121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:14.619435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-585e8ca1-39ea-4961-b262-29240c191121 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.162136 Jul 25 19:45:14.620029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1158/2142] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:14.688069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f3659aa3-e841-41e3-b04e-5c05c7bd6bf0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:14.688683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f3659aa3-e841-41e3-b04e-5c05c7bd6bf0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:14.695116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3659aa3-e841-41e3-b04e-5c05c7bd6bf0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:14.695585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3659aa3-e841-41e3-b04e-5c05c7bd6bf0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:14.697179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3659aa3-e841-41e3-b04e-5c05c7bd6bf0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:14.697572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3659aa3-e841-41e3-b04e-5c05c7bd6bf0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:14.765368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f3659aa3-e841-41e3-b04e-5c05c7bd6bf0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:14.774856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f3659aa3-e841-41e3-b04e-5c05c7bd6bf0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090471 Jul 25 19:45:14.775388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 985/2143] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:14 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:15.643700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-232efadd-793e-4378-9013-6dff0ea72bfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:15.644374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-232efadd-793e-4378-9013-6dff0ea72bfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:15.654548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-232efadd-793e-4378-9013-6dff0ea72bfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:15.655315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-232efadd-793e-4378-9013-6dff0ea72bfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:15.656186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-232efadd-793e-4378-9013-6dff0ea72bfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:15.656786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-232efadd-793e-4378-9013-6dff0ea72bfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:15.798368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aa12655a-50ef-4100-95a5-99e278787ce5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:15.799324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aa12655a-50ef-4100-95a5-99e278787ce5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:15.809609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa12655a-50ef-4100-95a5-99e278787ce5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:15.810067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa12655a-50ef-4100-95a5-99e278787ce5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:15.810851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa12655a-50ef-4100-95a5-99e278787ce5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:15.811480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa12655a-50ef-4100-95a5-99e278787ce5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:15.816265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-232efadd-793e-4378-9013-6dff0ea72bfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:15.828894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-232efadd-793e-4378-9013-6dff0ea72bfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:15.831797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-232efadd-793e-4378-9013-6dff0ea72bfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:15.833963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-232efadd-793e-4378-9013-6dff0ea72bfe tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.193902 Jul 25 19:45:15.834998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1159/2144] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:45:15.884110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa12655a-50ef-4100-95a5-99e278787ce5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:15.893454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aa12655a-50ef-4100-95a5-99e278787ce5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.100192 Jul 25 19:45:15.894044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 986/2145] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:16.878797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-615c0948-406e-48a9-b017-fbc07b9538a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:16.879407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-615c0948-406e-48a9-b017-fbc07b9538a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:16.886731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-615c0948-406e-48a9-b017-fbc07b9538a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:16.887169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-615c0948-406e-48a9-b017-fbc07b9538a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:16.887964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-615c0948-406e-48a9-b017-fbc07b9538a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:16.888410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-615c0948-406e-48a9-b017-fbc07b9538a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:16.927329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0eb630b7-b424-445e-9250-b971dcb84907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:16.927947 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0eb630b7-b424-445e-9250-b971dcb84907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:16.935351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0eb630b7-b424-445e-9250-b971dcb84907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:16.935833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0eb630b7-b424-445e-9250-b971dcb84907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:16.936597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0eb630b7-b424-445e-9250-b971dcb84907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:16.937024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0eb630b7-b424-445e-9250-b971dcb84907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:17.023669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0eb630b7-b424-445e-9250-b971dcb84907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:17.031940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0eb630b7-b424-445e-9250-b971dcb84907 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.108358 Jul 25 19:45:17.032532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 987/2146] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:17.058830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-615c0948-406e-48a9-b017-fbc07b9538a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:17.068911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-615c0948-406e-48a9-b017-fbc07b9538a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:17.070366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-615c0948-406e-48a9-b017-fbc07b9538a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:17.072312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-615c0948-406e-48a9-b017-fbc07b9538a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.197422 Jul 25 19:45:17.072889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1160/2147] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:18.055128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50ce8166-e486-418a-b1f4-66134f89521e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:18.056549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50ce8166-e486-418a-b1f4-66134f89521e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:18.063458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50ce8166-e486-418a-b1f4-66134f89521e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:18.063936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50ce8166-e486-418a-b1f4-66134f89521e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:18.064743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50ce8166-e486-418a-b1f4-66134f89521e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:18.065255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50ce8166-e486-418a-b1f4-66134f89521e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:18.095811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2f366614-f83c-4d37-a10b-02cb170c02b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:18.096582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2f366614-f83c-4d37-a10b-02cb170c02b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:18.104777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f366614-f83c-4d37-a10b-02cb170c02b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:18.105223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f366614-f83c-4d37-a10b-02cb170c02b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:18.106203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f366614-f83c-4d37-a10b-02cb170c02b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:18.109324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f366614-f83c-4d37-a10b-02cb170c02b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:18.131984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-50ce8166-e486-418a-b1f4-66134f89521e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:18.141011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50ce8166-e486-418a-b1f4-66134f89521e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090027 Jul 25 19:45:18.141631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 988/2148] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:45:18.254683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2f366614-f83c-4d37-a10b-02cb170c02b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:18.271796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2f366614-f83c-4d37-a10b-02cb170c02b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:18.273768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2f366614-f83c-4d37-a10b-02cb170c02b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:18.276300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2f366614-f83c-4d37-a10b-02cb170c02b9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.184255 Jul 25 19:45:18.277224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1161/2149] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:45:19.008800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:45:19.009121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:45:19.162999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51c10767-971e-4e63-a0a6-3759602ff4a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:19.163646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51c10767-971e-4e63-a0a6-3759602ff4a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:19.170694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c10767-971e-4e63-a0a6-3759602ff4a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:19.171148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c10767-971e-4e63-a0a6-3759602ff4a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:19.171967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c10767-971e-4e63-a0a6-3759602ff4a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:19.172410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c10767-971e-4e63-a0a6-3759602ff4a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:19.245464 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51c10767-971e-4e63-a0a6-3759602ff4a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:19.253820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51c10767-971e-4e63-a0a6-3759602ff4a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094883 Jul 25 19:45:19.254408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 989/2150] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:19.300300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6130fc4b-2d59-4de7-a4b6-4ea2214a3f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:19.300975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6130fc4b-2d59-4de7-a4b6-4ea2214a3f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:19.308585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6130fc4b-2d59-4de7-a4b6-4ea2214a3f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:19.309029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6130fc4b-2d59-4de7-a4b6-4ea2214a3f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:19.309846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6130fc4b-2d59-4de7-a4b6-4ea2214a3f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:19.310280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6130fc4b-2d59-4de7-a4b6-4ea2214a3f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:19.443852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6130fc4b-2d59-4de7-a4b6-4ea2214a3f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:19.453195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6130fc4b-2d59-4de7-a4b6-4ea2214a3f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:19.454687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6130fc4b-2d59-4de7-a4b6-4ea2214a3f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:19.455882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6130fc4b-2d59-4de7-a4b6-4ea2214a3f6f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.159703 Jul 25 19:45:19.456442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1162/2151] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:20.276153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ba10f17-d965-40f2-9c06-e1ea049053ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:20.276762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2ba10f17-d965-40f2-9c06-e1ea049053ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:20.283328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ba10f17-d965-40f2-9c06-e1ea049053ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:20.283814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ba10f17-d965-40f2-9c06-e1ea049053ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:20.284574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ba10f17-d965-40f2-9c06-e1ea049053ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:20.285021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ba10f17-d965-40f2-9c06-e1ea049053ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:20.348215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2ba10f17-d965-40f2-9c06-e1ea049053ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:20.357696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2ba10f17-d965-40f2-9c06-e1ea049053ae tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085772 Jul 25 19:45:20.358784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 990/2152] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:20.480758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-57bef049-7019-44a9-8290-d8be24671f34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:20.481342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-57bef049-7019-44a9-8290-d8be24671f34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:20.488810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57bef049-7019-44a9-8290-d8be24671f34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:20.489257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57bef049-7019-44a9-8290-d8be24671f34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:20.490047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57bef049-7019-44a9-8290-d8be24671f34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:20.490477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-57bef049-7019-44a9-8290-d8be24671f34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:20.634895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-57bef049-7019-44a9-8290-d8be24671f34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:20.643357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-57bef049-7019-44a9-8290-d8be24671f34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:20.644873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-57bef049-7019-44a9-8290-d8be24671f34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:20.646032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-57bef049-7019-44a9-8290-d8be24671f34 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.169664 Jul 25 19:45:20.646594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1163/2153] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:21.382722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ba30c67c-aa70-491e-9ea4-545d396e655d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:21.384130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ba30c67c-aa70-491e-9ea4-545d396e655d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:21.390847 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba30c67c-aa70-491e-9ea4-545d396e655d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:21.391288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba30c67c-aa70-491e-9ea4-545d396e655d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:21.392093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba30c67c-aa70-491e-9ea4-545d396e655d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:21.392528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba30c67c-aa70-491e-9ea4-545d396e655d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:21.459435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba30c67c-aa70-491e-9ea4-545d396e655d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:21.468373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ba30c67c-aa70-491e-9ea4-545d396e655d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089437 Jul 25 19:45:21.468964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 991/2154] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:21.671136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cfffdf4f-039e-42e7-b513-554200ff4ffa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:21.671787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cfffdf4f-039e-42e7-b513-554200ff4ffa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:21.678550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cfffdf4f-039e-42e7-b513-554200ff4ffa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:21.678996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cfffdf4f-039e-42e7-b513-554200ff4ffa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:21.679805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cfffdf4f-039e-42e7-b513-554200ff4ffa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:21.680517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cfffdf4f-039e-42e7-b513-554200ff4ffa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:21.685017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:21.828638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cfffdf4f-039e-42e7-b513-554200ff4ffa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:21.838860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cfffdf4f-039e-42e7-b513-554200ff4ffa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:21.840494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cfffdf4f-039e-42e7-b513-554200ff4ffa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:21.842172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cfffdf4f-039e-42e7-b513-554200ff4ffa tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.175202 Jul 25 19:45:21.842764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1164/2155] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:45:22.490974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8fd4dab3-178d-4d94-ad0b-4d932904b65c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:22.491576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8fd4dab3-178d-4d94-ad0b-4d932904b65c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:22.498477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fd4dab3-178d-4d94-ad0b-4d932904b65c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:22.498975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fd4dab3-178d-4d94-ad0b-4d932904b65c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:22.499764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fd4dab3-178d-4d94-ad0b-4d932904b65c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:22.500167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fd4dab3-178d-4d94-ad0b-4d932904b65c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:22.520434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:22.568955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8fd4dab3-178d-4d94-ad0b-4d932904b65c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:22.577775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8fd4dab3-178d-4d94-ad0b-4d932904b65c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090750 Jul 25 19:45:22.578359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 992/2156] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:22.869551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b448b678-1208-4fea-9339-88966402aeb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:22.870162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b448b678-1208-4fea-9339-88966402aeb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:22.876925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b448b678-1208-4fea-9339-88966402aeb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:22.877369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b448b678-1208-4fea-9339-88966402aeb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:22.878138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b448b678-1208-4fea-9339-88966402aeb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:22.878575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b448b678-1208-4fea-9339-88966402aeb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:23.019890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b448b678-1208-4fea-9339-88966402aeb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:23.029217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b448b678-1208-4fea-9339-88966402aeb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:23.030692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b448b678-1208-4fea-9339-88966402aeb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:23.031875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b448b678-1208-4fea-9339-88966402aeb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.166906 Jul 25 19:45:23.032437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1165/2157] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:23.598303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f2fffe7e-184a-496e-8684-91512e33859f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:23.598953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f2fffe7e-184a-496e-8684-91512e33859f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:23.606520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2fffe7e-184a-496e-8684-91512e33859f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:23.606968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2fffe7e-184a-496e-8684-91512e33859f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:23.607774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2fffe7e-184a-496e-8684-91512e33859f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:23.608218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2fffe7e-184a-496e-8684-91512e33859f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:23.674701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2fffe7e-184a-496e-8684-91512e33859f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:23.682577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f2fffe7e-184a-496e-8684-91512e33859f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088179 Jul 25 19:45:23.683137 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 993/2158] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:24.057429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7ffbb1df-17cc-4843-8551-c17fb2480742 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:24.058050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7ffbb1df-17cc-4843-8551-c17fb2480742 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:24.064773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ffbb1df-17cc-4843-8551-c17fb2480742 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:24.065223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ffbb1df-17cc-4843-8551-c17fb2480742 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:24.066002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ffbb1df-17cc-4843-8551-c17fb2480742 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:24.066442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7ffbb1df-17cc-4843-8551-c17fb2480742 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:24.224095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7ffbb1df-17cc-4843-8551-c17fb2480742 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:24.233559 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7ffbb1df-17cc-4843-8551-c17fb2480742 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:24.235049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7ffbb1df-17cc-4843-8551-c17fb2480742 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:24.236716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7ffbb1df-17cc-4843-8551-c17fb2480742 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.183999 Jul 25 19:45:24.237397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1166/2159] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:24.702863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b0e5e45e-7ac7-42fc-9cfe-0cdbb2addff7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:24.703454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b0e5e45e-7ac7-42fc-9cfe-0cdbb2addff7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:24.710066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0e5e45e-7ac7-42fc-9cfe-0cdbb2addff7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:24.710518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0e5e45e-7ac7-42fc-9cfe-0cdbb2addff7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:24.711884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0e5e45e-7ac7-42fc-9cfe-0cdbb2addff7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:24.712339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b0e5e45e-7ac7-42fc-9cfe-0cdbb2addff7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:24.776100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b0e5e45e-7ac7-42fc-9cfe-0cdbb2addff7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:24.785399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b0e5e45e-7ac7-42fc-9cfe-0cdbb2addff7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086020 Jul 25 19:45:24.786440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 994/2160] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:25.262166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c47ce1da-9f0e-4c7b-9871-9def7b9a329f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:25.262765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c47ce1da-9f0e-4c7b-9871-9def7b9a329f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:25.269419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47ce1da-9f0e-4c7b-9871-9def7b9a329f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:25.269862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47ce1da-9f0e-4c7b-9871-9def7b9a329f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:25.270660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47ce1da-9f0e-4c7b-9871-9def7b9a329f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:25.271100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c47ce1da-9f0e-4c7b-9871-9def7b9a329f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:25.405983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c47ce1da-9f0e-4c7b-9871-9def7b9a329f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:25.414988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c47ce1da-9f0e-4c7b-9871-9def7b9a329f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:25.416893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c47ce1da-9f0e-4c7b-9871-9def7b9a329f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:25.418062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c47ce1da-9f0e-4c7b-9871-9def7b9a329f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.160583 Jul 25 19:45:25.418622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1167/2161] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:25.808644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc93b00b-d500-4ab3-94e4-b0f310975171 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:25.809263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc93b00b-d500-4ab3-94e4-b0f310975171 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:25.815838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc93b00b-d500-4ab3-94e4-b0f310975171 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:25.816285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc93b00b-d500-4ab3-94e4-b0f310975171 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:25.817052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc93b00b-d500-4ab3-94e4-b0f310975171 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:25.817495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc93b00b-d500-4ab3-94e4-b0f310975171 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:25.889347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc93b00b-d500-4ab3-94e4-b0f310975171 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:25.897834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc93b00b-d500-4ab3-94e4-b0f310975171 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094205 Jul 25 19:45:25.898342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 995/2162] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:26.446422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-86fcf9a8-b114-46ad-af6e-b04b12f30655 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:26.447080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-86fcf9a8-b114-46ad-af6e-b04b12f30655 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:26.454323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86fcf9a8-b114-46ad-af6e-b04b12f30655 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:26.454781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86fcf9a8-b114-46ad-af6e-b04b12f30655 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:26.455577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86fcf9a8-b114-46ad-af6e-b04b12f30655 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:26.456020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86fcf9a8-b114-46ad-af6e-b04b12f30655 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:26.626681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86fcf9a8-b114-46ad-af6e-b04b12f30655 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:26.636634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86fcf9a8-b114-46ad-af6e-b04b12f30655 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:26.638140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86fcf9a8-b114-46ad-af6e-b04b12f30655 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:26.639320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-86fcf9a8-b114-46ad-af6e-b04b12f30655 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.197968 Jul 25 19:45:26.639919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1168/2163] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:26.921448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3cb72d4b-fee5-4d99-b25b-9d73dc8f41b6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:26.922168 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3cb72d4b-fee5-4d99-b25b-9d73dc8f41b6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:26.928563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3cb72d4b-fee5-4d99-b25b-9d73dc8f41b6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:26.929002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3cb72d4b-fee5-4d99-b25b-9d73dc8f41b6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:26.929770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3cb72d4b-fee5-4d99-b25b-9d73dc8f41b6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:26.930885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3cb72d4b-fee5-4d99-b25b-9d73dc8f41b6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:26.996024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3cb72d4b-fee5-4d99-b25b-9d73dc8f41b6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:27.004425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3cb72d4b-fee5-4d99-b25b-9d73dc8f41b6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087758 Jul 25 19:45:27.005017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 996/2164] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:27.664962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-03a6760c-749b-4752-b41f-5b58b3b36ed4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:27.665599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-03a6760c-749b-4752-b41f-5b58b3b36ed4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:27.673481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03a6760c-749b-4752-b41f-5b58b3b36ed4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:27.673929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03a6760c-749b-4752-b41f-5b58b3b36ed4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:27.674797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03a6760c-749b-4752-b41f-5b58b3b36ed4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:27.675248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03a6760c-749b-4752-b41f-5b58b3b36ed4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:27.810200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-03a6760c-749b-4752-b41f-5b58b3b36ed4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:27.818545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-03a6760c-749b-4752-b41f-5b58b3b36ed4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:27.820057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-03a6760c-749b-4752-b41f-5b58b3b36ed4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:27.822041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-03a6760c-749b-4752-b41f-5b58b3b36ed4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.160619 Jul 25 19:45:27.822430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1169/2165] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:28.027299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7a7a7e1f-a63f-4de9-a8e0-5136e6628d83 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:28.027863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7a7a7e1f-a63f-4de9-a8e0-5136e6628d83 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:28.034583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a7a7e1f-a63f-4de9-a8e0-5136e6628d83 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:28.035168 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a7a7e1f-a63f-4de9-a8e0-5136e6628d83 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:28.035967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a7a7e1f-a63f-4de9-a8e0-5136e6628d83 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:28.036400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a7a7e1f-a63f-4de9-a8e0-5136e6628d83 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:28.101409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7a7a7e1f-a63f-4de9-a8e0-5136e6628d83 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:28.110156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7a7a7e1f-a63f-4de9-a8e0-5136e6628d83 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087870 Jul 25 19:45:28.110999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 997/2166] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:28.845077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e763b982-16a3-48ba-8eb2-21b75f590ca6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:28.845688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e763b982-16a3-48ba-8eb2-21b75f590ca6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:28.853227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e763b982-16a3-48ba-8eb2-21b75f590ca6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:28.853673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e763b982-16a3-48ba-8eb2-21b75f590ca6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:28.854449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e763b982-16a3-48ba-8eb2-21b75f590ca6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:28.854889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e763b982-16a3-48ba-8eb2-21b75f590ca6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:28.997818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e763b982-16a3-48ba-8eb2-21b75f590ca6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:29.006373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e763b982-16a3-48ba-8eb2-21b75f590ca6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:29.007952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e763b982-16a3-48ba-8eb2-21b75f590ca6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:29.009423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e763b982-16a3-48ba-8eb2-21b75f590ca6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.168163 Jul 25 19:45:29.009993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1170/2167] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:29.131887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3e2ed201-2141-431e-8731-5a5e1a9c895a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:29.132496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3e2ed201-2141-431e-8731-5a5e1a9c895a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:29.140970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e2ed201-2141-431e-8731-5a5e1a9c895a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:29.141533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e2ed201-2141-431e-8731-5a5e1a9c895a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:29.142390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e2ed201-2141-431e-8731-5a5e1a9c895a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:29.142919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e2ed201-2141-431e-8731-5a5e1a9c895a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:29.225895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3e2ed201-2141-431e-8731-5a5e1a9c895a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:29.236015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3e2ed201-2141-431e-8731-5a5e1a9c895a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.107766 Jul 25 19:45:29.236603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 998/2168] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:29 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:30.035631 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b7fcf818-ea27-4f6f-a629-0c83ecffe331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:30.036253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b7fcf818-ea27-4f6f-a629-0c83ecffe331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:30.043812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7fcf818-ea27-4f6f-a629-0c83ecffe331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:30.044265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7fcf818-ea27-4f6f-a629-0c83ecffe331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:30.045049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7fcf818-ea27-4f6f-a629-0c83ecffe331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:30.045486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7fcf818-ea27-4f6f-a629-0c83ecffe331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:30.194508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b7fcf818-ea27-4f6f-a629-0c83ecffe331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:30.207074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b7fcf818-ea27-4f6f-a629-0c83ecffe331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:30.208636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b7fcf818-ea27-4f6f-a629-0c83ecffe331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:30.209855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b7fcf818-ea27-4f6f-a629-0c83ecffe331 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.178202 Jul 25 19:45:30.210427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1171/2169] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:30.258412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9caac115-a6ff-45dd-b691-35bd33e7c516 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:30.259175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9caac115-a6ff-45dd-b691-35bd33e7c516 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:30.267958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9caac115-a6ff-45dd-b691-35bd33e7c516 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:30.268406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9caac115-a6ff-45dd-b691-35bd33e7c516 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:30.269197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9caac115-a6ff-45dd-b691-35bd33e7c516 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:30.269635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9caac115-a6ff-45dd-b691-35bd33e7c516 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:30.342150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9caac115-a6ff-45dd-b691-35bd33e7c516 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:30.351246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9caac115-a6ff-45dd-b691-35bd33e7c516 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.096728 Jul 25 19:45:30.352666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 999/2170] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:45:31.235875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-32843afb-1ad8-498f-9d70-1948c8a25408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:31.236530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-32843afb-1ad8-498f-9d70-1948c8a25408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:31.243367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32843afb-1ad8-498f-9d70-1948c8a25408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:31.243917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32843afb-1ad8-498f-9d70-1948c8a25408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:31.244759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32843afb-1ad8-498f-9d70-1948c8a25408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:31.245209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32843afb-1ad8-498f-9d70-1948c8a25408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:31.375089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c3783ab2-a796-49dc-9bb4-9812b96a75f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:31.375804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c3783ab2-a796-49dc-9bb4-9812b96a75f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:31.383690 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3783ab2-a796-49dc-9bb4-9812b96a75f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:31.384436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3783ab2-a796-49dc-9bb4-9812b96a75f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:31.385504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3783ab2-a796-49dc-9bb4-9812b96a75f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:31.385944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3783ab2-a796-49dc-9bb4-9812b96a75f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:31.389671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-32843afb-1ad8-498f-9d70-1948c8a25408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:31.399136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-32843afb-1ad8-498f-9d70-1948c8a25408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:31.401299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-32843afb-1ad8-498f-9d70-1948c8a25408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:31.402902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-32843afb-1ad8-498f-9d70-1948c8a25408 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.171153 Jul 25 19:45:31.404017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1172/2171] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:31.463272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c3783ab2-a796-49dc-9bb4-9812b96a75f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:31.471844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c3783ab2-a796-49dc-9bb4-9812b96a75f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.100548 Jul 25 19:45:31.472426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1000/2172] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:32.427067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ffd1168b-43b5-49e6-83b3-150e7319ef2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:32.427650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ffd1168b-43b5-49e6-83b3-150e7319ef2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:32.434860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd1168b-43b5-49e6-83b3-150e7319ef2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:32.435311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd1168b-43b5-49e6-83b3-150e7319ef2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:32.436128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd1168b-43b5-49e6-83b3-150e7319ef2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:32.436568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ffd1168b-43b5-49e6-83b3-150e7319ef2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:32.493666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-19d0e84b-00e8-4b52-80f9-c66224eb9bd6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:32.494274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-19d0e84b-00e8-4b52-80f9-c66224eb9bd6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:32.501312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19d0e84b-00e8-4b52-80f9-c66224eb9bd6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:32.501839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19d0e84b-00e8-4b52-80f9-c66224eb9bd6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:32.502612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19d0e84b-00e8-4b52-80f9-c66224eb9bd6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:32.503044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19d0e84b-00e8-4b52-80f9-c66224eb9bd6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:32.576466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-19d0e84b-00e8-4b52-80f9-c66224eb9bd6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:32.585115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-19d0e84b-00e8-4b52-80f9-c66224eb9bd6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095922 Jul 25 19:45:32.585726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1001/2173] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:45:32.598678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ffd1168b-43b5-49e6-83b3-150e7319ef2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:32.607363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ffd1168b-43b5-49e6-83b3-150e7319ef2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:32.608890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ffd1168b-43b5-49e6-83b3-150e7319ef2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:32.610042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ffd1168b-43b5-49e6-83b3-150e7319ef2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.186951 Jul 25 19:45:32.610870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1173/2174] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:32 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:33.607049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b8f2b0ec-5996-4ff8-96af-a846c636e8ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:33.607721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b8f2b0ec-5996-4ff8-96af-a846c636e8ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:33.614226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8f2b0ec-5996-4ff8-96af-a846c636e8ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:33.614668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8f2b0ec-5996-4ff8-96af-a846c636e8ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:33.615455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8f2b0ec-5996-4ff8-96af-a846c636e8ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:33.615909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8f2b0ec-5996-4ff8-96af-a846c636e8ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:33.639883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f3d99dae-1990-43e8-ba1a-f0eb9b366eaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:33.640497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f3d99dae-1990-43e8-ba1a-f0eb9b366eaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:33.647087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3d99dae-1990-43e8-ba1a-f0eb9b366eaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:33.647562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3d99dae-1990-43e8-ba1a-f0eb9b366eaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:33.648334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3d99dae-1990-43e8-ba1a-f0eb9b366eaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:33.649537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3d99dae-1990-43e8-ba1a-f0eb9b366eaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:33.706124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b8f2b0ec-5996-4ff8-96af-a846c636e8ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:33.714499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b8f2b0ec-5996-4ff8-96af-a846c636e8ac tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.111586 Jul 25 19:45:33.715085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1002/2175] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:33.807385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3d99dae-1990-43e8-ba1a-f0eb9b366eaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:33.815905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3d99dae-1990-43e8-ba1a-f0eb9b366eaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:33.817401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3d99dae-1990-43e8-ba1a-f0eb9b366eaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:33.818551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f3d99dae-1990-43e8-ba1a-f0eb9b366eaf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.185411 Jul 25 19:45:33.819119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1174/2176] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:45:34.736778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b1e4c528-b621-4630-8a70-0eb42f178840 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:34.737407 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b1e4c528-b621-4630-8a70-0eb42f178840 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:34.745433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1e4c528-b621-4630-8a70-0eb42f178840 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:34.745868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1e4c528-b621-4630-8a70-0eb42f178840 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:34.746639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1e4c528-b621-4630-8a70-0eb42f178840 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:34.747068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1e4c528-b621-4630-8a70-0eb42f178840 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:34.811016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1e4c528-b621-4630-8a70-0eb42f178840 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:34.819398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b1e4c528-b621-4630-8a70-0eb42f178840 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086776 Jul 25 19:45:34.820007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1003/2177] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:34.842584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ce4fd196-7760-4d8e-a11b-90c7f293bea9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:34.843179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ce4fd196-7760-4d8e-a11b-90c7f293bea9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:34.850003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce4fd196-7760-4d8e-a11b-90c7f293bea9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:34.850422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce4fd196-7760-4d8e-a11b-90c7f293bea9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:34.851377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce4fd196-7760-4d8e-a11b-90c7f293bea9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:34.852476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ce4fd196-7760-4d8e-a11b-90c7f293bea9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:34.989344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ce4fd196-7760-4d8e-a11b-90c7f293bea9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:35.004383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ce4fd196-7760-4d8e-a11b-90c7f293bea9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:35.007264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ce4fd196-7760-4d8e-a11b-90c7f293bea9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:35.009417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ce4fd196-7760-4d8e-a11b-90c7f293bea9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.170404 Jul 25 19:45:35.010310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1175/2178] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:35.841928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f65dcc54-1ef3-4745-9ed8-cbae40a0eb68 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:35.842602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f65dcc54-1ef3-4745-9ed8-cbae40a0eb68 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:35.849422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f65dcc54-1ef3-4745-9ed8-cbae40a0eb68 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:35.849859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f65dcc54-1ef3-4745-9ed8-cbae40a0eb68 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:35.850622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f65dcc54-1ef3-4745-9ed8-cbae40a0eb68 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:35.851046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f65dcc54-1ef3-4745-9ed8-cbae40a0eb68 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:35.917938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f65dcc54-1ef3-4745-9ed8-cbae40a0eb68 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:35.925952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f65dcc54-1ef3-4745-9ed8-cbae40a0eb68 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087907 Jul 25 19:45:35.926521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1004/2179] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:35 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:36.048938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b361bc81-cbb1-413b-b446-92e29db51631 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:36.049553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b361bc81-cbb1-413b-b446-92e29db51631 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:36.056988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b361bc81-cbb1-413b-b446-92e29db51631 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:36.057450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b361bc81-cbb1-413b-b446-92e29db51631 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:36.058219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b361bc81-cbb1-413b-b446-92e29db51631 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:36.058649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b361bc81-cbb1-413b-b446-92e29db51631 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:36.200580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b361bc81-cbb1-413b-b446-92e29db51631 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:36.209788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b361bc81-cbb1-413b-b446-92e29db51631 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:36.211886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b361bc81-cbb1-413b-b446-92e29db51631 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:36.213079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b361bc81-cbb1-413b-b446-92e29db51631 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.168056 Jul 25 19:45:36.213642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1176/2180] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:45:36.949317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f182e8f6-6b7d-4759-af0c-29a6f9e78d1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:36.949933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f182e8f6-6b7d-4759-af0c-29a6f9e78d1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:36.956903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f182e8f6-6b7d-4759-af0c-29a6f9e78d1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:36.957345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f182e8f6-6b7d-4759-af0c-29a6f9e78d1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:36.958115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f182e8f6-6b7d-4759-af0c-29a6f9e78d1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:36.958545 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f182e8f6-6b7d-4759-af0c-29a6f9e78d1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:37.028263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f182e8f6-6b7d-4759-af0c-29a6f9e78d1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:37.036590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f182e8f6-6b7d-4759-af0c-29a6f9e78d1f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092030 Jul 25 19:45:37.037181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1005/2181] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:37.237943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f26ebd11-1ce6-4091-91bf-0ba0d147ca46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:37.238538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f26ebd11-1ce6-4091-91bf-0ba0d147ca46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:37.241075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=52 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:37.247390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f26ebd11-1ce6-4091-91bf-0ba0d147ca46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:37.247865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f26ebd11-1ce6-4091-91bf-0ba0d147ca46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:37.248649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f26ebd11-1ce6-4091-91bf-0ba0d147ca46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:37.249091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f26ebd11-1ce6-4091-91bf-0ba0d147ca46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:37.393209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f26ebd11-1ce6-4091-91bf-0ba0d147ca46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:37.402819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f26ebd11-1ce6-4091-91bf-0ba0d147ca46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:37.404409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f26ebd11-1ce6-4091-91bf-0ba0d147ca46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:37.405583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f26ebd11-1ce6-4091-91bf-0ba0d147ca46 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.171965 Jul 25 19:45:37.406150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1177/2182] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:38.058451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-154f8d1f-2bf3-41ee-88e7-6149ca536ea5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:38.059070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-154f8d1f-2bf3-41ee-88e7-6149ca536ea5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:38.061378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=54 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:38.067224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-154f8d1f-2bf3-41ee-88e7-6149ca536ea5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:38.067706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-154f8d1f-2bf3-41ee-88e7-6149ca536ea5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:38.068471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-154f8d1f-2bf3-41ee-88e7-6149ca536ea5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:38.068903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-154f8d1f-2bf3-41ee-88e7-6149ca536ea5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:38.138597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-154f8d1f-2bf3-41ee-88e7-6149ca536ea5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:38.146701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-154f8d1f-2bf3-41ee-88e7-6149ca536ea5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092588 Jul 25 19:45:38.147280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1006/2183] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:38.431347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1cd3b55b-90ab-4b04-881e-ef8a8b90fa7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:38.432729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1cd3b55b-90ab-4b04-881e-ef8a8b90fa7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:38.438785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cd3b55b-90ab-4b04-881e-ef8a8b90fa7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:38.439208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cd3b55b-90ab-4b04-881e-ef8a8b90fa7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:38.439996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cd3b55b-90ab-4b04-881e-ef8a8b90fa7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:38.440424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cd3b55b-90ab-4b04-881e-ef8a8b90fa7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:38.580877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1cd3b55b-90ab-4b04-881e-ef8a8b90fa7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:38.590935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1cd3b55b-90ab-4b04-881e-ef8a8b90fa7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:38.592455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1cd3b55b-90ab-4b04-881e-ef8a8b90fa7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:38.593695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1cd3b55b-90ab-4b04-881e-ef8a8b90fa7d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.166918 Jul 25 19:45:38.594340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1178/2184] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:38 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:39.168512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-03b7345b-d192-4591-838c-7a925d96c970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:39.169120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-03b7345b-d192-4591-838c-7a925d96c970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:39.175851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03b7345b-d192-4591-838c-7a925d96c970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:39.176295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03b7345b-d192-4591-838c-7a925d96c970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:39.177065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03b7345b-d192-4591-838c-7a925d96c970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:39.177498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03b7345b-d192-4591-838c-7a925d96c970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:39.241739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-03b7345b-d192-4591-838c-7a925d96c970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:39.251225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-03b7345b-d192-4591-838c-7a925d96c970 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086540 Jul 25 19:45:39.251856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1007/2185] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:39.619093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-da7cd993-0528-4f95-acf9-c428c40810d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:39.619765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-da7cd993-0528-4f95-acf9-c428c40810d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:39.626857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da7cd993-0528-4f95-acf9-c428c40810d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:39.627298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da7cd993-0528-4f95-acf9-c428c40810d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:39.628104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da7cd993-0528-4f95-acf9-c428c40810d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:39.628553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da7cd993-0528-4f95-acf9-c428c40810d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:39.802271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da7cd993-0528-4f95-acf9-c428c40810d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:39.813800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da7cd993-0528-4f95-acf9-c428c40810d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:39.815290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da7cd993-0528-4f95-acf9-c428c40810d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:39.816487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-da7cd993-0528-4f95-acf9-c428c40810d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.201794 Jul 25 19:45:39.817132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1179/2186] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:40.273081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-08757320-3f55-4edc-a6a0-2d7d4d19bae0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:40.274986 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-08757320-3f55-4edc-a6a0-2d7d4d19bae0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:40.282527 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08757320-3f55-4edc-a6a0-2d7d4d19bae0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:40.282967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08757320-3f55-4edc-a6a0-2d7d4d19bae0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:40.283778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08757320-3f55-4edc-a6a0-2d7d4d19bae0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:40.284220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08757320-3f55-4edc-a6a0-2d7d4d19bae0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:40.352186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08757320-3f55-4edc-a6a0-2d7d4d19bae0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:40.360830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-08757320-3f55-4edc-a6a0-2d7d4d19bae0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.091258 Jul 25 19:45:40.361415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1008/2187] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:40.841690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f142be7c-529b-4b61-91ea-19161d24a24c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:40.842275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f142be7c-529b-4b61-91ea-19161d24a24c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:40.849075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f142be7c-529b-4b61-91ea-19161d24a24c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:40.849567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f142be7c-529b-4b61-91ea-19161d24a24c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:40.850288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f142be7c-529b-4b61-91ea-19161d24a24c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:40.850721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f142be7c-529b-4b61-91ea-19161d24a24c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:40.988431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f142be7c-529b-4b61-91ea-19161d24a24c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:40.991837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:40.999380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f142be7c-529b-4b61-91ea-19161d24a24c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:41.000921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f142be7c-529b-4b61-91ea-19161d24a24c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:41.002109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f142be7c-529b-4b61-91ea-19161d24a24c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.164369 Jul 25 19:45:41.002672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1180/2188] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:41.381940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-58aa0ac2-aedd-40b7-a65b-ed832f30539f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:41.382807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-58aa0ac2-aedd-40b7-a65b-ed832f30539f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:41.389822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58aa0ac2-aedd-40b7-a65b-ed832f30539f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:41.390268 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58aa0ac2-aedd-40b7-a65b-ed832f30539f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:41.391034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58aa0ac2-aedd-40b7-a65b-ed832f30539f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:41.391487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58aa0ac2-aedd-40b7-a65b-ed832f30539f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:41.395634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:41.457525 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-58aa0ac2-aedd-40b7-a65b-ed832f30539f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:41.466427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-58aa0ac2-aedd-40b7-a65b-ed832f30539f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088302 Jul 25 19:45:41.467007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1009/2189] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:42.029223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a66010b8-e037-45ba-8ef9-e551e0c0b3b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:42.030013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a66010b8-e037-45ba-8ef9-e551e0c0b3b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:42.037781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a66010b8-e037-45ba-8ef9-e551e0c0b3b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:42.038237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a66010b8-e037-45ba-8ef9-e551e0c0b3b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:42.039705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a66010b8-e037-45ba-8ef9-e551e0c0b3b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:42.040455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a66010b8-e037-45ba-8ef9-e551e0c0b3b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:42.191122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a66010b8-e037-45ba-8ef9-e551e0c0b3b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:42.200552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a66010b8-e037-45ba-8ef9-e551e0c0b3b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:42.202060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a66010b8-e037-45ba-8ef9-e551e0c0b3b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:42.203267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a66010b8-e037-45ba-8ef9-e551e0c0b3b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.179983 Jul 25 19:45:42.204105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1181/2190] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:42.487867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5ad4d483-e348-4b4e-b784-58fbf8dfc2a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:42.488503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5ad4d483-e348-4b4e-b784-58fbf8dfc2a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:42.495995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ad4d483-e348-4b4e-b784-58fbf8dfc2a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:42.496444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ad4d483-e348-4b4e-b784-58fbf8dfc2a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:42.497233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ad4d483-e348-4b4e-b784-58fbf8dfc2a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:42.497672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ad4d483-e348-4b4e-b784-58fbf8dfc2a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:42.565183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5ad4d483-e348-4b4e-b784-58fbf8dfc2a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:42.574067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5ad4d483-e348-4b4e-b784-58fbf8dfc2a9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090401 Jul 25 19:45:42.574645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1010/2191] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:42 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:43.228712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c4f81694-a1fc-493d-8ffc-baa09d3291b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:43.229381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c4f81694-a1fc-493d-8ffc-baa09d3291b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:43.236308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4f81694-a1fc-493d-8ffc-baa09d3291b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:43.236757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4f81694-a1fc-493d-8ffc-baa09d3291b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:43.237522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4f81694-a1fc-493d-8ffc-baa09d3291b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:43.237956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4f81694-a1fc-493d-8ffc-baa09d3291b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:43.387331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c4f81694-a1fc-493d-8ffc-baa09d3291b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:43.396713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c4f81694-a1fc-493d-8ffc-baa09d3291b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:43.398267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c4f81694-a1fc-493d-8ffc-baa09d3291b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:43.400136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c4f81694-a1fc-493d-8ffc-baa09d3291b1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.176321 Jul 25 19:45:43.400765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1182/2192] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:43.596512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e7a1a0f-c636-411a-ab32-0586889e72e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:43.597283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e7a1a0f-c636-411a-ab32-0586889e72e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:43.605156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e7a1a0f-c636-411a-ab32-0586889e72e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:43.605597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e7a1a0f-c636-411a-ab32-0586889e72e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:43.606365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e7a1a0f-c636-411a-ab32-0586889e72e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:43.606793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e7a1a0f-c636-411a-ab32-0586889e72e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:43.672924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1e7a1a0f-c636-411a-ab32-0586889e72e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:43.684306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e7a1a0f-c636-411a-ab32-0586889e72e9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.091522 Jul 25 19:45:43.684896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1011/2193] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:45:44.425483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-72660d3b-9b07-4697-8a12-18f34ed35493 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:44.426056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-72660d3b-9b07-4697-8a12-18f34ed35493 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:44.433324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72660d3b-9b07-4697-8a12-18f34ed35493 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:44.433770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72660d3b-9b07-4697-8a12-18f34ed35493 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:44.434552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72660d3b-9b07-4697-8a12-18f34ed35493 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:44.434989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72660d3b-9b07-4697-8a12-18f34ed35493 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:44.574011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-72660d3b-9b07-4697-8a12-18f34ed35493 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:44.582493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-72660d3b-9b07-4697-8a12-18f34ed35493 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:44.584009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-72660d3b-9b07-4697-8a12-18f34ed35493 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:44.585155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-72660d3b-9b07-4697-8a12-18f34ed35493 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.163727 Jul 25 19:45:44.586228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1183/2194] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:44.706848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-455156e0-09d2-4b13-ac16-94da0349422f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:44.707456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-455156e0-09d2-4b13-ac16-94da0349422f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:44.714982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-455156e0-09d2-4b13-ac16-94da0349422f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:44.715457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-455156e0-09d2-4b13-ac16-94da0349422f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:44.716262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-455156e0-09d2-4b13-ac16-94da0349422f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:44.716691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-455156e0-09d2-4b13-ac16-94da0349422f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:44.783828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-455156e0-09d2-4b13-ac16-94da0349422f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:44.793025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-455156e0-09d2-4b13-ac16-94da0349422f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090091 Jul 25 19:45:44.793625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1012/2195] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:45.611019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-86fa5c77-f4b7-4f79-8f22-688d2c387333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:45.611688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-86fa5c77-f4b7-4f79-8f22-688d2c387333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:45.617929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86fa5c77-f4b7-4f79-8f22-688d2c387333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:45.618383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86fa5c77-f4b7-4f79-8f22-688d2c387333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:45.619211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86fa5c77-f4b7-4f79-8f22-688d2c387333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:45.619679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86fa5c77-f4b7-4f79-8f22-688d2c387333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:45.776200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86fa5c77-f4b7-4f79-8f22-688d2c387333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:45.785361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86fa5c77-f4b7-4f79-8f22-688d2c387333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:45.786911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86fa5c77-f4b7-4f79-8f22-688d2c387333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:45.788206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-86fa5c77-f4b7-4f79-8f22-688d2c387333 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.181600 Jul 25 19:45:45.789472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1184/2196] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:45.816999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-25295916-61ac-45f2-a164-b944781772fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:45.817612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-25295916-61ac-45f2-a164-b944781772fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:45.824343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25295916-61ac-45f2-a164-b944781772fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:45.824784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25295916-61ac-45f2-a164-b944781772fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:45.825555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25295916-61ac-45f2-a164-b944781772fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:45.825986 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25295916-61ac-45f2-a164-b944781772fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:45.899425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-25295916-61ac-45f2-a164-b944781772fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:45.908470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-25295916-61ac-45f2-a164-b944781772fb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095603 Jul 25 19:45:45.909068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1013/2197] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:46.816656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fe57d5e5-4b11-4439-a22d-d8f0ca981c76 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:46.817707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fe57d5e5-4b11-4439-a22d-d8f0ca981c76 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:46.829549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fe57d5e5-4b11-4439-a22d-d8f0ca981c76 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:46.830246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fe57d5e5-4b11-4439-a22d-d8f0ca981c76 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:46.831119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fe57d5e5-4b11-4439-a22d-d8f0ca981c76 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:46.832011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fe57d5e5-4b11-4439-a22d-d8f0ca981c76 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:46.934881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c0f0b899-440c-489f-bd91-34791377983e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:46.937291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c0f0b899-440c-489f-bd91-34791377983e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:46.951278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0f0b899-440c-489f-bd91-34791377983e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:46.952486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0f0b899-440c-489f-bd91-34791377983e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:46.955903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0f0b899-440c-489f-bd91-34791377983e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:46.956981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0f0b899-440c-489f-bd91-34791377983e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:47.036744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fe57d5e5-4b11-4439-a22d-d8f0ca981c76 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:47.050468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fe57d5e5-4b11-4439-a22d-d8f0ca981c76 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:47.052413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fe57d5e5-4b11-4439-a22d-d8f0ca981c76 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:47.053770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fe57d5e5-4b11-4439-a22d-d8f0ca981c76 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.243939 Jul 25 19:45:47.055618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1185/2198] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:47.239384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c0f0b899-440c-489f-bd91-34791377983e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:47.254713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c0f0b899-440c-489f-bd91-34791377983e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.327281 Jul 25 19:45:47.255685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1014/2199] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:48.080068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-be05f502-e730-4958-a454-5f8f531b8c00 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:48.080675 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-be05f502-e730-4958-a454-5f8f531b8c00 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:48.089219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be05f502-e730-4958-a454-5f8f531b8c00 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:48.089667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be05f502-e730-4958-a454-5f8f531b8c00 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:48.090448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be05f502-e730-4958-a454-5f8f531b8c00 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:48.090889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be05f502-e730-4958-a454-5f8f531b8c00 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:48.269420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-be05f502-e730-4958-a454-5f8f531b8c00 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:48.278270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e2fa38e0-0b9f-40b0-9b4d-b1f966ff2f31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:48.278915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e2fa38e0-0b9f-40b0-9b4d-b1f966ff2f31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:48.282937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-be05f502-e730-4958-a454-5f8f531b8c00 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:48.286064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2fa38e0-0b9f-40b0-9b4d-b1f966ff2f31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:48.286326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-be05f502-e730-4958-a454-5f8f531b8c00 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:48.286501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2fa38e0-0b9f-40b0-9b4d-b1f966ff2f31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:48.287296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2fa38e0-0b9f-40b0-9b4d-b1f966ff2f31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:48.287768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2fa38e0-0b9f-40b0-9b4d-b1f966ff2f31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:48.288349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-be05f502-e730-4958-a454-5f8f531b8c00 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.211955 Jul 25 19:45:48.290264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1186/2200] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:48 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:48.372580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2fa38e0-0b9f-40b0-9b4d-b1f966ff2f31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:48.381360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e2fa38e0-0b9f-40b0-9b4d-b1f966ff2f31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.107017 Jul 25 19:45:48.381951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1015/2201] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:49.325954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-21e88a5c-925a-4710-9299-fbcede480113 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:49.326593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-21e88a5c-925a-4710-9299-fbcede480113 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:49.333696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21e88a5c-925a-4710-9299-fbcede480113 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:49.334146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21e88a5c-925a-4710-9299-fbcede480113 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:49.334955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21e88a5c-925a-4710-9299-fbcede480113 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:49.335402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-21e88a5c-925a-4710-9299-fbcede480113 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:49.408636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-182669b0-19cc-4b5e-a55e-236aee8f4b4c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:49.409842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-182669b0-19cc-4b5e-a55e-236aee8f4b4c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:49.422242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-182669b0-19cc-4b5e-a55e-236aee8f4b4c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:49.422910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-182669b0-19cc-4b5e-a55e-236aee8f4b4c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:49.424405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-182669b0-19cc-4b5e-a55e-236aee8f4b4c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:49.425177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-182669b0-19cc-4b5e-a55e-236aee8f4b4c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:49.545905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-182669b0-19cc-4b5e-a55e-236aee8f4b4c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:49.555956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-182669b0-19cc-4b5e-a55e-236aee8f4b4c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.153435 Jul 25 19:45:49.556464 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1016/2202] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:49.571695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-21e88a5c-925a-4710-9299-fbcede480113 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:49.581564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-21e88a5c-925a-4710-9299-fbcede480113 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:49.583212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-21e88a5c-925a-4710-9299-fbcede480113 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:49.584527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-21e88a5c-925a-4710-9299-fbcede480113 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.262671 Jul 25 19:45:49.585274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1187/2203] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:50.583624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-02c02825-7af9-4fcb-844b-6d91994db133 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:50.584333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-02c02825-7af9-4fcb-844b-6d91994db133 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:50.591710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02c02825-7af9-4fcb-844b-6d91994db133 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:50.592172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02c02825-7af9-4fcb-844b-6d91994db133 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:50.593051 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02c02825-7af9-4fcb-844b-6d91994db133 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:50.593541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02c02825-7af9-4fcb-844b-6d91994db133 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:50.609724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9658bdd8-d1e2-4290-8cea-9d1d643ad1db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:50.610909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9658bdd8-d1e2-4290-8cea-9d1d643ad1db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:50.619080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9658bdd8-d1e2-4290-8cea-9d1d643ad1db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:50.619558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9658bdd8-d1e2-4290-8cea-9d1d643ad1db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:50.620362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9658bdd8-d1e2-4290-8cea-9d1d643ad1db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:50.620804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9658bdd8-d1e2-4290-8cea-9d1d643ad1db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:50.690987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-02c02825-7af9-4fcb-844b-6d91994db133 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:50.701228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-02c02825-7af9-4fcb-844b-6d91994db133 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.121474 Jul 25 19:45:50.701826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1017/2204] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:50.799467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9658bdd8-d1e2-4290-8cea-9d1d643ad1db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:50.814939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9658bdd8-d1e2-4290-8cea-9d1d643ad1db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:50.818044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9658bdd8-d1e2-4290-8cea-9d1d643ad1db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:50.821528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9658bdd8-d1e2-4290-8cea-9d1d643ad1db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.214792 Jul 25 19:45:50.822588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1188/2205] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:45:51.723131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a22a12b4-4fd6-456f-b5b8-00a0b66d09e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:51.723844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a22a12b4-4fd6-456f-b5b8-00a0b66d09e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:51.730704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a22a12b4-4fd6-456f-b5b8-00a0b66d09e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:51.731142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a22a12b4-4fd6-456f-b5b8-00a0b66d09e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:51.731956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a22a12b4-4fd6-456f-b5b8-00a0b66d09e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:51.732387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a22a12b4-4fd6-456f-b5b8-00a0b66d09e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:51.809672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a22a12b4-4fd6-456f-b5b8-00a0b66d09e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:51.819340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a22a12b4-4fd6-456f-b5b8-00a0b66d09e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.100059 Jul 25 19:45:51.819959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1018/2206] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:51.847827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8c3cb750-9d64-4f33-8df3-b3c56118e284 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:51.848449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8c3cb750-9d64-4f33-8df3-b3c56118e284 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:51.856234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8c3cb750-9d64-4f33-8df3-b3c56118e284 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:51.856679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8c3cb750-9d64-4f33-8df3-b3c56118e284 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:51.857474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8c3cb750-9d64-4f33-8df3-b3c56118e284 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:51.857914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8c3cb750-9d64-4f33-8df3-b3c56118e284 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:52.033118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8c3cb750-9d64-4f33-8df3-b3c56118e284 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:52.043873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8c3cb750-9d64-4f33-8df3-b3c56118e284 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:52.045673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8c3cb750-9d64-4f33-8df3-b3c56118e284 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:52.047050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8c3cb750-9d64-4f33-8df3-b3c56118e284 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.203056 Jul 25 19:45:52.047807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1189/2207] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:52.840407 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de9cbaea-5cfe-4e67-9285-ed3498fccf10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:52.841017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de9cbaea-5cfe-4e67-9285-ed3498fccf10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:52.847679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de9cbaea-5cfe-4e67-9285-ed3498fccf10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:52.848131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de9cbaea-5cfe-4e67-9285-ed3498fccf10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:52.848910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de9cbaea-5cfe-4e67-9285-ed3498fccf10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:52.849339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de9cbaea-5cfe-4e67-9285-ed3498fccf10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:52.922783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de9cbaea-5cfe-4e67-9285-ed3498fccf10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:52.933029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de9cbaea-5cfe-4e67-9285-ed3498fccf10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.096367 Jul 25 19:45:52.933619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1019/2208] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:52 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:45:53.071575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-78200334-8c22-4e3c-b716-8803aeaaa0f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:53.072273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-78200334-8c22-4e3c-b716-8803aeaaa0f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:53.079671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78200334-8c22-4e3c-b716-8803aeaaa0f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:53.080111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78200334-8c22-4e3c-b716-8803aeaaa0f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:53.081006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78200334-8c22-4e3c-b716-8803aeaaa0f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:53.081615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78200334-8c22-4e3c-b716-8803aeaaa0f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:53.237763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78200334-8c22-4e3c-b716-8803aeaaa0f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:53.255912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78200334-8c22-4e3c-b716-8803aeaaa0f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:53.258052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78200334-8c22-4e3c-b716-8803aeaaa0f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:53.259721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-78200334-8c22-4e3c-b716-8803aeaaa0f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.193279 Jul 25 19:45:53.267075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1190/2209] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:53.955556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-adfc3799-587b-4ebb-856f-f6e11193bb11 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:53.956215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-adfc3799-587b-4ebb-856f-f6e11193bb11 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:53.963681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adfc3799-587b-4ebb-856f-f6e11193bb11 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:53.964128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adfc3799-587b-4ebb-856f-f6e11193bb11 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:53.964889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adfc3799-587b-4ebb-856f-f6e11193bb11 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:53.965317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adfc3799-587b-4ebb-856f-f6e11193bb11 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:54.028967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-adfc3799-587b-4ebb-856f-f6e11193bb11 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:54.036824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-adfc3799-587b-4ebb-856f-f6e11193bb11 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085251 Jul 25 19:45:54.037379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1020/2210] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:54.284026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3bf338be-3fff-4e3a-80b8-4fcdf5bd222e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:54.284581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3bf338be-3fff-4e3a-80b8-4fcdf5bd222e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:54.291859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3bf338be-3fff-4e3a-80b8-4fcdf5bd222e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:54.292304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3bf338be-3fff-4e3a-80b8-4fcdf5bd222e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:54.293060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3bf338be-3fff-4e3a-80b8-4fcdf5bd222e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:54.293494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3bf338be-3fff-4e3a-80b8-4fcdf5bd222e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:54.422757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3bf338be-3fff-4e3a-80b8-4fcdf5bd222e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:54.432205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3bf338be-3fff-4e3a-80b8-4fcdf5bd222e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:54.433699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3bf338be-3fff-4e3a-80b8-4fcdf5bd222e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:54.434846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3bf338be-3fff-4e3a-80b8-4fcdf5bd222e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.154797 Jul 25 19:45:54.435407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1191/2211] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:55.058922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-485e82d2-a459-4dff-a8ba-82f9d99da766 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:55.059550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-485e82d2-a459-4dff-a8ba-82f9d99da766 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:55.066434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-485e82d2-a459-4dff-a8ba-82f9d99da766 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:55.066595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-485e82d2-a459-4dff-a8ba-82f9d99da766 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:55.067285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-485e82d2-a459-4dff-a8ba-82f9d99da766 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:55.067745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-485e82d2-a459-4dff-a8ba-82f9d99da766 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:55.133821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-485e82d2-a459-4dff-a8ba-82f9d99da766 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:55.142096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-485e82d2-a459-4dff-a8ba-82f9d99da766 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087584 Jul 25 19:45:55.142662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1021/2212] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:55.459592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-965ebd59-caa6-465f-ad4f-f254338dba44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:55.460198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-965ebd59-caa6-465f-ad4f-f254338dba44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:55.467666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-965ebd59-caa6-465f-ad4f-f254338dba44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:55.468120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-965ebd59-caa6-465f-ad4f-f254338dba44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:55.468887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-965ebd59-caa6-465f-ad4f-f254338dba44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:55.469324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-965ebd59-caa6-465f-ad4f-f254338dba44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:55.609185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-965ebd59-caa6-465f-ad4f-f254338dba44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:55.618658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-965ebd59-caa6-465f-ad4f-f254338dba44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:55.620467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-965ebd59-caa6-465f-ad4f-f254338dba44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:55.621722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-965ebd59-caa6-465f-ad4f-f254338dba44 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.166188 Jul 25 19:45:55.622342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1192/2213] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:56.163797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b5d1e30e-0a51-4caf-b279-8bbe3aef1083 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:56.164615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b5d1e30e-0a51-4caf-b279-8bbe3aef1083 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:56.171193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5d1e30e-0a51-4caf-b279-8bbe3aef1083 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:56.171688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5d1e30e-0a51-4caf-b279-8bbe3aef1083 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:56.172471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5d1e30e-0a51-4caf-b279-8bbe3aef1083 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:56.172907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5d1e30e-0a51-4caf-b279-8bbe3aef1083 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:56.240453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b5d1e30e-0a51-4caf-b279-8bbe3aef1083 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:56.248627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b5d1e30e-0a51-4caf-b279-8bbe3aef1083 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088786 Jul 25 19:45:56.249196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1022/2214] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:56.645306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f0f0a0d0-01d2-41c8-b04e-d77d02443c8c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:56.645931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f0f0a0d0-01d2-41c8-b04e-d77d02443c8c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:56.653879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0f0a0d0-01d2-41c8-b04e-d77d02443c8c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:56.654356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0f0a0d0-01d2-41c8-b04e-d77d02443c8c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:56.655252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0f0a0d0-01d2-41c8-b04e-d77d02443c8c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:56.655779 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0f0a0d0-01d2-41c8-b04e-d77d02443c8c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:56.793571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f0f0a0d0-01d2-41c8-b04e-d77d02443c8c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:56.802126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f0f0a0d0-01d2-41c8-b04e-d77d02443c8c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:56.803828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f0f0a0d0-01d2-41c8-b04e-d77d02443c8c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:56.805126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f0f0a0d0-01d2-41c8-b04e-d77d02443c8c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.163721 Jul 25 19:45:56.805678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1193/2215] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:56 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:57.270951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-017c383c-3c0b-4eb9-b5e1-6a02e7bce838 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:57.271707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-017c383c-3c0b-4eb9-b5e1-6a02e7bce838 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:57.279385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-017c383c-3c0b-4eb9-b5e1-6a02e7bce838 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:57.279926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-017c383c-3c0b-4eb9-b5e1-6a02e7bce838 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:57.280659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-017c383c-3c0b-4eb9-b5e1-6a02e7bce838 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:57.281092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-017c383c-3c0b-4eb9-b5e1-6a02e7bce838 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:57.347124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-017c383c-3c0b-4eb9-b5e1-6a02e7bce838 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:57.355742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-017c383c-3c0b-4eb9-b5e1-6a02e7bce838 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089232 Jul 25 19:45:57.356321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1023/2216] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:57.828047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c1e8de61-f50e-4e8d-9967-582ef9b492a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:57.828651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c1e8de61-f50e-4e8d-9967-582ef9b492a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:57.835165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1e8de61-f50e-4e8d-9967-582ef9b492a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:57.836544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1e8de61-f50e-4e8d-9967-582ef9b492a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:57.837478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1e8de61-f50e-4e8d-9967-582ef9b492a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:57.837917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1e8de61-f50e-4e8d-9967-582ef9b492a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:57.969027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c1e8de61-f50e-4e8d-9967-582ef9b492a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:57.978183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c1e8de61-f50e-4e8d-9967-582ef9b492a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:57.979707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c1e8de61-f50e-4e8d-9967-582ef9b492a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:57.980856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c1e8de61-f50e-4e8d-9967-582ef9b492a1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.156651 Jul 25 19:45:57.981417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1194/2217] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:58.377723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a1cb906-8b11-47f2-b76c-2c0e8f0e2edf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:58.378331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6a1cb906-8b11-47f2-b76c-2c0e8f0e2edf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:58.386845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a1cb906-8b11-47f2-b76c-2c0e8f0e2edf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:58.387321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a1cb906-8b11-47f2-b76c-2c0e8f0e2edf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:58.388123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a1cb906-8b11-47f2-b76c-2c0e8f0e2edf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:58.388556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a1cb906-8b11-47f2-b76c-2c0e8f0e2edf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:58.456930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6a1cb906-8b11-47f2-b76c-2c0e8f0e2edf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:58.466290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6a1cb906-8b11-47f2-b76c-2c0e8f0e2edf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092371 Jul 25 19:45:58.466881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1024/2218] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:45:59.004153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0f5d2b77-2aea-4e36-a397-29dc6733fff7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:59.004756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0f5d2b77-2aea-4e36-a397-29dc6733fff7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:59.011870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f5d2b77-2aea-4e36-a397-29dc6733fff7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:59.012311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f5d2b77-2aea-4e36-a397-29dc6733fff7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:59.013071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f5d2b77-2aea-4e36-a397-29dc6733fff7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:59.013499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f5d2b77-2aea-4e36-a397-29dc6733fff7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:59.143932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0f5d2b77-2aea-4e36-a397-29dc6733fff7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:59.153207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0f5d2b77-2aea-4e36-a397-29dc6733fff7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:59.154696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0f5d2b77-2aea-4e36-a397-29dc6733fff7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:59.155908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0f5d2b77-2aea-4e36-a397-29dc6733fff7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.155587 Jul 25 19:45:59.156476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1195/2219] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:45:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:45:59.487660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-023dff37-4c95-42a0-a76a-e9fd8eb8ca5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:45:59.488495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-023dff37-4c95-42a0-a76a-e9fd8eb8ca5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:45:59.495691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-023dff37-4c95-42a0-a76a-e9fd8eb8ca5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:59.496177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-023dff37-4c95-42a0-a76a-e9fd8eb8ca5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:59.496948 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-023dff37-4c95-42a0-a76a-e9fd8eb8ca5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:45:59.497384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-023dff37-4c95-42a0-a76a-e9fd8eb8ca5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:45:59.564584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-023dff37-4c95-42a0-a76a-e9fd8eb8ca5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:45:59.568491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:45:59.575141 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-023dff37-4c95-42a0-a76a-e9fd8eb8ca5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.091583 Jul 25 19:45:59.575753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1025/2220] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:45:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:00.182114 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0d4d13fb-1005-42bc-9df3-5e2b20f0edc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:00.182803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0d4d13fb-1005-42bc-9df3-5e2b20f0edc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:00.189749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4d13fb-1005-42bc-9df3-5e2b20f0edc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:00.190326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4d13fb-1005-42bc-9df3-5e2b20f0edc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:00.191276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4d13fb-1005-42bc-9df3-5e2b20f0edc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:00.191752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0d4d13fb-1005-42bc-9df3-5e2b20f0edc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:00.329037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0d4d13fb-1005-42bc-9df3-5e2b20f0edc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:00.338157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0d4d13fb-1005-42bc-9df3-5e2b20f0edc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:00.339659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0d4d13fb-1005-42bc-9df3-5e2b20f0edc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:00.340794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0d4d13fb-1005-42bc-9df3-5e2b20f0edc3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.163386 Jul 25 19:46:00.341352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1196/2221] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:00.596128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8423dfbb-949f-48c9-977d-ad8e6d22da6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:00.596776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8423dfbb-949f-48c9-977d-ad8e6d22da6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:00.605105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8423dfbb-949f-48c9-977d-ad8e6d22da6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:00.605486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8423dfbb-949f-48c9-977d-ad8e6d22da6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:00.606288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8423dfbb-949f-48c9-977d-ad8e6d22da6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:00.606722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8423dfbb-949f-48c9-977d-ad8e6d22da6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:00.672402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8423dfbb-949f-48c9-977d-ad8e6d22da6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:00.680555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8423dfbb-949f-48c9-977d-ad8e6d22da6b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088321 Jul 25 19:46:00.681155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1026/2222] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:01.365271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1baefa03-315e-40a5-98bb-9e0fd17713cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:01.365875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1baefa03-315e-40a5-98bb-9e0fd17713cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:01.373106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1baefa03-315e-40a5-98bb-9e0fd17713cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:01.373546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1baefa03-315e-40a5-98bb-9e0fd17713cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:01.374305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1baefa03-315e-40a5-98bb-9e0fd17713cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:01.374739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1baefa03-315e-40a5-98bb-9e0fd17713cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:01.394063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:46:01.517584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1baefa03-315e-40a5-98bb-9e0fd17713cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:01.527681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1baefa03-315e-40a5-98bb-9e0fd17713cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:01.529245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1baefa03-315e-40a5-98bb-9e0fd17713cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:01.530435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1baefa03-315e-40a5-98bb-9e0fd17713cf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.169590 Jul 25 19:46:01.531422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1197/2223] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:01 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:01.702167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e9cb67a1-9690-445b-9560-1b1f26801ac2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:01.702941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e9cb67a1-9690-445b-9560-1b1f26801ac2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:01.709803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9cb67a1-9690-445b-9560-1b1f26801ac2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:01.710250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9cb67a1-9690-445b-9560-1b1f26801ac2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:01.711588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9cb67a1-9690-445b-9560-1b1f26801ac2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:01.711996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9cb67a1-9690-445b-9560-1b1f26801ac2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:01.783388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e9cb67a1-9690-445b-9560-1b1f26801ac2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:01.792349 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e9cb67a1-9690-445b-9560-1b1f26801ac2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094168 Jul 25 19:46:01.792936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1027/2224] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:02.571354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d9617ba8-5a6c-41bd-91a0-8abaa346b35c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:02.572040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d9617ba8-5a6c-41bd-91a0-8abaa346b35c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:02.578975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9617ba8-5a6c-41bd-91a0-8abaa346b35c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:02.579413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9617ba8-5a6c-41bd-91a0-8abaa346b35c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:02.580196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9617ba8-5a6c-41bd-91a0-8abaa346b35c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:02.580627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d9617ba8-5a6c-41bd-91a0-8abaa346b35c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:02.717098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d9617ba8-5a6c-41bd-91a0-8abaa346b35c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:02.725602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d9617ba8-5a6c-41bd-91a0-8abaa346b35c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:02.727989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d9617ba8-5a6c-41bd-91a0-8abaa346b35c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:02.729441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d9617ba8-5a6c-41bd-91a0-8abaa346b35c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.162477 Jul 25 19:46:02.729998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1198/2225] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:02.814136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3bb763e-9f45-47a6-a029-aa370a9b7ceb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:02.814735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e3bb763e-9f45-47a6-a029-aa370a9b7ceb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:02.821621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3bb763e-9f45-47a6-a029-aa370a9b7ceb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:02.822068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3bb763e-9f45-47a6-a029-aa370a9b7ceb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:02.822834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3bb763e-9f45-47a6-a029-aa370a9b7ceb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:02.823265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3bb763e-9f45-47a6-a029-aa370a9b7ceb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:02.891371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e3bb763e-9f45-47a6-a029-aa370a9b7ceb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:02.900629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e3bb763e-9f45-47a6-a029-aa370a9b7ceb tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090679 Jul 25 19:46:02.901213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1028/2226] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:03.753564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0e745efb-3792-4d70-b530-7d050a7f3927 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:03.754194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0e745efb-3792-4d70-b530-7d050a7f3927 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:03.763775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e745efb-3792-4d70-b530-7d050a7f3927 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:03.764239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e745efb-3792-4d70-b530-7d050a7f3927 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:03.764987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e745efb-3792-4d70-b530-7d050a7f3927 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:03.765416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e745efb-3792-4d70-b530-7d050a7f3927 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:03.924228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b31b9835-01be-499a-b56d-e49c48297dba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:03.925621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b31b9835-01be-499a-b56d-e49c48297dba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:03.936299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b31b9835-01be-499a-b56d-e49c48297dba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:03.936860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b31b9835-01be-499a-b56d-e49c48297dba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:03.938020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0e745efb-3792-4d70-b530-7d050a7f3927 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:03.938321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b31b9835-01be-499a-b56d-e49c48297dba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:03.938798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b31b9835-01be-499a-b56d-e49c48297dba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:03.949467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0e745efb-3792-4d70-b530-7d050a7f3927 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:03.951007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0e745efb-3792-4d70-b530-7d050a7f3927 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:03.952961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0e745efb-3792-4d70-b530-7d050a7f3927 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.203188 Jul 25 19:46:03.953533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1199/2227] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:04.011088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b31b9835-01be-499a-b56d-e49c48297dba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:04.021370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b31b9835-01be-499a-b56d-e49c48297dba tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.102939 Jul 25 19:46:04.021855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1029/2228] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:03 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:04.977054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-69dd9ce2-fcd6-4a19-908b-83fbf0df84e5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:04.977687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-69dd9ce2-fcd6-4a19-908b-83fbf0df84e5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:04.984297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69dd9ce2-fcd6-4a19-908b-83fbf0df84e5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:04.984737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69dd9ce2-fcd6-4a19-908b-83fbf0df84e5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:04.985493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69dd9ce2-fcd6-4a19-908b-83fbf0df84e5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:04.986190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69dd9ce2-fcd6-4a19-908b-83fbf0df84e5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:05.044978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6b3a047c-b5a2-4139-ae6f-16dca101a1f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:05.045631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6b3a047c-b5a2-4139-ae6f-16dca101a1f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:05.052807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b3a047c-b5a2-4139-ae6f-16dca101a1f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:05.053263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b3a047c-b5a2-4139-ae6f-16dca101a1f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:05.054070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b3a047c-b5a2-4139-ae6f-16dca101a1f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:05.055097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b3a047c-b5a2-4139-ae6f-16dca101a1f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:05.137365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6b3a047c-b5a2-4139-ae6f-16dca101a1f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:05.145491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6b3a047c-b5a2-4139-ae6f-16dca101a1f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.104622 Jul 25 19:46:05.146076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1030/2229] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:05.160640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-69dd9ce2-fcd6-4a19-908b-83fbf0df84e5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:05.169945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-69dd9ce2-fcd6-4a19-908b-83fbf0df84e5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:05.171458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-69dd9ce2-fcd6-4a19-908b-83fbf0df84e5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:05.172653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-69dd9ce2-fcd6-4a19-908b-83fbf0df84e5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.200049 Jul 25 19:46:05.173215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1200/2230] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:06.168543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2726c1a4-e9c1-40e3-bbb0-9f7c3bc1e770 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:06.169140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2726c1a4-e9c1-40e3-bbb0-9f7c3bc1e770 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:06.175877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2726c1a4-e9c1-40e3-bbb0-9f7c3bc1e770 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:06.176326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2726c1a4-e9c1-40e3-bbb0-9f7c3bc1e770 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:06.177103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2726c1a4-e9c1-40e3-bbb0-9f7c3bc1e770 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:06.177544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2726c1a4-e9c1-40e3-bbb0-9f7c3bc1e770 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:06.196321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-41e32a68-d751-44b8-9201-d9187a61246e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:06.197024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-41e32a68-d751-44b8-9201-d9187a61246e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:06.203890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41e32a68-d751-44b8-9201-d9187a61246e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:06.204428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41e32a68-d751-44b8-9201-d9187a61246e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:06.205217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41e32a68-d751-44b8-9201-d9187a61246e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:06.205659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41e32a68-d751-44b8-9201-d9187a61246e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:06.257701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2726c1a4-e9c1-40e3-bbb0-9f7c3bc1e770 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:06.265972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2726c1a4-e9c1-40e3-bbb0-9f7c3bc1e770 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.102049 Jul 25 19:46:06.266753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1031/2231] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:06.355133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-41e32a68-d751-44b8-9201-d9187a61246e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:06.364181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-41e32a68-d751-44b8-9201-d9187a61246e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:06.365656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-41e32a68-d751-44b8-9201-d9187a61246e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:06.366801 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-41e32a68-d751-44b8-9201-d9187a61246e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.174963 Jul 25 19:46:06.367367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1201/2232] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:46:07.287868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e37e0248-5d16-4505-be8a-275baa205dff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:07.288481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e37e0248-5d16-4505-be8a-275baa205dff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:07.295862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e37e0248-5d16-4505-be8a-275baa205dff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:07.296314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e37e0248-5d16-4505-be8a-275baa205dff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:07.297095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e37e0248-5d16-4505-be8a-275baa205dff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:07.297540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e37e0248-5d16-4505-be8a-275baa205dff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:07.363347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e37e0248-5d16-4505-be8a-275baa205dff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:07.372280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e37e0248-5d16-4505-be8a-275baa205dff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088183 Jul 25 19:46:07.372861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1032/2233] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:07.390089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9dd4a9e0-71df-44bf-a662-8aa57ee40a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:07.390690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9dd4a9e0-71df-44bf-a662-8aa57ee40a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:07.393041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=50 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:46:07.398243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9dd4a9e0-71df-44bf-a662-8aa57ee40a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:07.399328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9dd4a9e0-71df-44bf-a662-8aa57ee40a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:07.400227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9dd4a9e0-71df-44bf-a662-8aa57ee40a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:07.400662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9dd4a9e0-71df-44bf-a662-8aa57ee40a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:07.542743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9dd4a9e0-71df-44bf-a662-8aa57ee40a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:07.551639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9dd4a9e0-71df-44bf-a662-8aa57ee40a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:07.553154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9dd4a9e0-71df-44bf-a662-8aa57ee40a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:07.554322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9dd4a9e0-71df-44bf-a662-8aa57ee40a65 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.168067 Jul 25 19:46:07.555649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1202/2234] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:08.394979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5a3c203e-8da0-4dc3-8a65-411c87ad4ea4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:08.395609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5a3c203e-8da0-4dc3-8a65-411c87ad4ea4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:08.397944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=54 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:46:08.404083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a3c203e-8da0-4dc3-8a65-411c87ad4ea4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:08.404536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a3c203e-8da0-4dc3-8a65-411c87ad4ea4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:08.405303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a3c203e-8da0-4dc3-8a65-411c87ad4ea4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:08.405742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a3c203e-8da0-4dc3-8a65-411c87ad4ea4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:08.467836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5a3c203e-8da0-4dc3-8a65-411c87ad4ea4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:08.475840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5a3c203e-8da0-4dc3-8a65-411c87ad4ea4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.084737 Jul 25 19:46:08.476400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1033/2235] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:08.579325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9851770a-4980-4a2e-adc2-dd9e1d5d57f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:08.579953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9851770a-4980-4a2e-adc2-dd9e1d5d57f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:08.586419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9851770a-4980-4a2e-adc2-dd9e1d5d57f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:08.587447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9851770a-4980-4a2e-adc2-dd9e1d5d57f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:08.588235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9851770a-4980-4a2e-adc2-dd9e1d5d57f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:08.588672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9851770a-4980-4a2e-adc2-dd9e1d5d57f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:08.728311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9851770a-4980-4a2e-adc2-dd9e1d5d57f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:08.736825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9851770a-4980-4a2e-adc2-dd9e1d5d57f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:08.738313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9851770a-4980-4a2e-adc2-dd9e1d5d57f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:08.739442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9851770a-4980-4a2e-adc2-dd9e1d5d57f5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.164001 Jul 25 19:46:08.740032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1203/2236] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:09.498456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6149e505-ae2c-4389-962c-d9f717d20087 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:09.499001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6149e505-ae2c-4389-962c-d9f717d20087 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:09.505764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6149e505-ae2c-4389-962c-d9f717d20087 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:09.506205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6149e505-ae2c-4389-962c-d9f717d20087 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:09.507024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6149e505-ae2c-4389-962c-d9f717d20087 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:09.507457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6149e505-ae2c-4389-962c-d9f717d20087 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:09.573976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6149e505-ae2c-4389-962c-d9f717d20087 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:09.581901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6149e505-ae2c-4389-962c-d9f717d20087 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087463 Jul 25 19:46:09.582457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1034/2237] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:09.764036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-756f7975-ea41-4d82-8a9b-2b79c1e75fa1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:09.764582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-756f7975-ea41-4d82-8a9b-2b79c1e75fa1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:09.771108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-756f7975-ea41-4d82-8a9b-2b79c1e75fa1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:09.771574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-756f7975-ea41-4d82-8a9b-2b79c1e75fa1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:09.772343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-756f7975-ea41-4d82-8a9b-2b79c1e75fa1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:09.772780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-756f7975-ea41-4d82-8a9b-2b79c1e75fa1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:09.905576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-756f7975-ea41-4d82-8a9b-2b79c1e75fa1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:09.913939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-756f7975-ea41-4d82-8a9b-2b79c1e75fa1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:09.915439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-756f7975-ea41-4d82-8a9b-2b79c1e75fa1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:09.917279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-756f7975-ea41-4d82-8a9b-2b79c1e75fa1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.158043 Jul 25 19:46:09.917835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1204/2238] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:10.602882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f5f77ff3-8c20-41d5-a571-2f866d1368d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:10.604149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f5f77ff3-8c20-41d5-a571-2f866d1368d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:10.611028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5f77ff3-8c20-41d5-a571-2f866d1368d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:10.611471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5f77ff3-8c20-41d5-a571-2f866d1368d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:10.612255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5f77ff3-8c20-41d5-a571-2f866d1368d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:10.612686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5f77ff3-8c20-41d5-a571-2f866d1368d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:10.676108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f5f77ff3-8c20-41d5-a571-2f866d1368d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:10.683352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f5f77ff3-8c20-41d5-a571-2f866d1368d4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.084260 Jul 25 19:46:10.683974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1035/2239] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:10.941107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-768a73cf-f4f3-4144-b9c4-a0fd9b772ad5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:10.941765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-768a73cf-f4f3-4144-b9c4-a0fd9b772ad5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:10.949270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-768a73cf-f4f3-4144-b9c4-a0fd9b772ad5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:10.949716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-768a73cf-f4f3-4144-b9c4-a0fd9b772ad5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:10.950477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-768a73cf-f4f3-4144-b9c4-a0fd9b772ad5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:10.950913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-768a73cf-f4f3-4144-b9c4-a0fd9b772ad5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:11.087564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-768a73cf-f4f3-4144-b9c4-a0fd9b772ad5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:11.096657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-768a73cf-f4f3-4144-b9c4-a0fd9b772ad5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:11.098155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-768a73cf-f4f3-4144-b9c4-a0fd9b772ad5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:11.099300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-768a73cf-f4f3-4144-b9c4-a0fd9b772ad5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.162199 Jul 25 19:46:11.099989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1205/2240] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:11.704046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e4e3b5e-fab6-4915-8551-3edf017a9360 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:11.704662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e4e3b5e-fab6-4915-8551-3edf017a9360 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:11.711983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e4e3b5e-fab6-4915-8551-3edf017a9360 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:11.712616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e4e3b5e-fab6-4915-8551-3edf017a9360 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:11.713598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e4e3b5e-fab6-4915-8551-3edf017a9360 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:11.714028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e4e3b5e-fab6-4915-8551-3edf017a9360 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:11.777731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7e4e3b5e-fab6-4915-8551-3edf017a9360 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:11.785635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e4e3b5e-fab6-4915-8551-3edf017a9360 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085514 Jul 25 19:46:11.786389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1036/2241] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:11 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:12.124611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-517eef60-7633-4ec5-a068-dbff84780570 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:12.125262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-517eef60-7633-4ec5-a068-dbff84780570 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:12.131977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-517eef60-7633-4ec5-a068-dbff84780570 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:12.132431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-517eef60-7633-4ec5-a068-dbff84780570 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:12.133200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-517eef60-7633-4ec5-a068-dbff84780570 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:12.133636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-517eef60-7633-4ec5-a068-dbff84780570 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:12.265021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-517eef60-7633-4ec5-a068-dbff84780570 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:12.273753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-517eef60-7633-4ec5-a068-dbff84780570 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:12.275269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-517eef60-7633-4ec5-a068-dbff84780570 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:12.276448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-517eef60-7633-4ec5-a068-dbff84780570 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.156935 Jul 25 19:46:12.277024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1206/2242] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:12.806260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-faf3db37-e2ce-4dd3-ad9f-6d8bcdc029f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:12.806920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-faf3db37-e2ce-4dd3-ad9f-6d8bcdc029f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:12.814149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faf3db37-e2ce-4dd3-ad9f-6d8bcdc029f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:12.814624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faf3db37-e2ce-4dd3-ad9f-6d8bcdc029f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:12.815382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faf3db37-e2ce-4dd3-ad9f-6d8bcdc029f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:12.815848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-faf3db37-e2ce-4dd3-ad9f-6d8bcdc029f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:12.880732 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-faf3db37-e2ce-4dd3-ad9f-6d8bcdc029f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:12.889456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-faf3db37-e2ce-4dd3-ad9f-6d8bcdc029f6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087040 Jul 25 19:46:12.890015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1037/2243] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:13.299704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-829c045f-eaef-492e-a590-d881878dc530 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:13.300291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-829c045f-eaef-492e-a590-d881878dc530 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:13.307287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-829c045f-eaef-492e-a590-d881878dc530 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:13.307782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-829c045f-eaef-492e-a590-d881878dc530 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:13.308536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-829c045f-eaef-492e-a590-d881878dc530 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:13.308967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-829c045f-eaef-492e-a590-d881878dc530 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:13.441929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-829c045f-eaef-492e-a590-d881878dc530 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:13.451068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-829c045f-eaef-492e-a590-d881878dc530 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:13.452588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-829c045f-eaef-492e-a590-d881878dc530 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:13.453748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-829c045f-eaef-492e-a590-d881878dc530 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.158065 Jul 25 19:46:13.454298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1207/2244] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:13.910054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e2f32a78-e8ba-492c-96a6-e6858b787e9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:13.910656 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e2f32a78-e8ba-492c-96a6-e6858b787e9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:13.917603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2f32a78-e8ba-492c-96a6-e6858b787e9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:13.918044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2f32a78-e8ba-492c-96a6-e6858b787e9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:13.918798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2f32a78-e8ba-492c-96a6-e6858b787e9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:13.919229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2f32a78-e8ba-492c-96a6-e6858b787e9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:13.983175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2f32a78-e8ba-492c-96a6-e6858b787e9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:13.991483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e2f32a78-e8ba-492c-96a6-e6858b787e9d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085326 Jul 25 19:46:13.992087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1038/2245] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:14.478187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2f91a028-7d4f-43f1-9b4c-cf80605a4e6c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:14.478778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2f91a028-7d4f-43f1-9b4c-cf80605a4e6c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:14.486482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f91a028-7d4f-43f1-9b4c-cf80605a4e6c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:14.486920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f91a028-7d4f-43f1-9b4c-cf80605a4e6c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:14.487710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f91a028-7d4f-43f1-9b4c-cf80605a4e6c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:14.488142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2f91a028-7d4f-43f1-9b4c-cf80605a4e6c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:14.621701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2f91a028-7d4f-43f1-9b4c-cf80605a4e6c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:14.631155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2f91a028-7d4f-43f1-9b4c-cf80605a4e6c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:14.632693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2f91a028-7d4f-43f1-9b4c-cf80605a4e6c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:14.633933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2f91a028-7d4f-43f1-9b4c-cf80605a4e6c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.159779 Jul 25 19:46:14.634490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1208/2246] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:15.012928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fcf30872-3ff9-4b85-995b-75739d032806 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:15.013515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fcf30872-3ff9-4b85-995b-75739d032806 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:15.019938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcf30872-3ff9-4b85-995b-75739d032806 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:15.020381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcf30872-3ff9-4b85-995b-75739d032806 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:15.021141 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcf30872-3ff9-4b85-995b-75739d032806 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:15.021575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcf30872-3ff9-4b85-995b-75739d032806 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:15.086246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fcf30872-3ff9-4b85-995b-75739d032806 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:15.095004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fcf30872-3ff9-4b85-995b-75739d032806 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086026 Jul 25 19:46:15.095678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1039/2247] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:15.658778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cabd267f-3baf-4f85-a11b-8ed43d9e3cd3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:15.660032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cabd267f-3baf-4f85-a11b-8ed43d9e3cd3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:15.666125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cabd267f-3baf-4f85-a11b-8ed43d9e3cd3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:15.666697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cabd267f-3baf-4f85-a11b-8ed43d9e3cd3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:15.667378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cabd267f-3baf-4f85-a11b-8ed43d9e3cd3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:15.667846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cabd267f-3baf-4f85-a11b-8ed43d9e3cd3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:15.800468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cabd267f-3baf-4f85-a11b-8ed43d9e3cd3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:15.809513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cabd267f-3baf-4f85-a11b-8ed43d9e3cd3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:15.810991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cabd267f-3baf-4f85-a11b-8ed43d9e3cd3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:15.812156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cabd267f-3baf-4f85-a11b-8ed43d9e3cd3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.157745 Jul 25 19:46:15.812711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1209/2248] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:16.116862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3ed1b463-c169-4121-9394-59e3803a3b9a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:16.117463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3ed1b463-c169-4121-9394-59e3803a3b9a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:16.124280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ed1b463-c169-4121-9394-59e3803a3b9a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:16.124706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ed1b463-c169-4121-9394-59e3803a3b9a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:16.125477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ed1b463-c169-4121-9394-59e3803a3b9a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:16.125904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ed1b463-c169-4121-9394-59e3803a3b9a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:16.192878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3ed1b463-c169-4121-9394-59e3803a3b9a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:16.202116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3ed1b463-c169-4121-9394-59e3803a3b9a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089070 Jul 25 19:46:16.202679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1040/2249] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:16.836425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eeeb67be-314b-4730-8641-97416c0b55af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:16.837034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eeeb67be-314b-4730-8641-97416c0b55af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:16.843942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eeeb67be-314b-4730-8641-97416c0b55af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:16.844389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eeeb67be-314b-4730-8641-97416c0b55af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:16.845151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eeeb67be-314b-4730-8641-97416c0b55af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:16.845587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eeeb67be-314b-4730-8641-97416c0b55af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:16.976774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eeeb67be-314b-4730-8641-97416c0b55af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:16.986186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eeeb67be-314b-4730-8641-97416c0b55af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:16.987730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eeeb67be-314b-4730-8641-97416c0b55af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:16.988880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eeeb67be-314b-4730-8641-97416c0b55af tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.156356 Jul 25 19:46:16.989446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1210/2250] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:17.223461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7719a1a0-c62d-4796-b648-381bb40d3660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:17.224138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7719a1a0-c62d-4796-b648-381bb40d3660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:17.231312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7719a1a0-c62d-4796-b648-381bb40d3660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:17.231795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7719a1a0-c62d-4796-b648-381bb40d3660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:17.232574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7719a1a0-c62d-4796-b648-381bb40d3660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:17.233010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7719a1a0-c62d-4796-b648-381bb40d3660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:17.296779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7719a1a0-c62d-4796-b648-381bb40d3660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:17.306166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7719a1a0-c62d-4796-b648-381bb40d3660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086593 Jul 25 19:46:17.306850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1041/2251] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:18.012994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-05f9e0f8-f226-438b-8bfb-23bc1218a888 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:18.013586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-05f9e0f8-f226-438b-8bfb-23bc1218a888 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:18.020164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05f9e0f8-f226-438b-8bfb-23bc1218a888 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:18.020616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05f9e0f8-f226-438b-8bfb-23bc1218a888 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:18.021418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05f9e0f8-f226-438b-8bfb-23bc1218a888 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:18.021857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05f9e0f8-f226-438b-8bfb-23bc1218a888 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:18.158326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-05f9e0f8-f226-438b-8bfb-23bc1218a888 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:18.167744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-05f9e0f8-f226-438b-8bfb-23bc1218a888 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:18.169285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-05f9e0f8-f226-438b-8bfb-23bc1218a888 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:18.170609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-05f9e0f8-f226-438b-8bfb-23bc1218a888 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.161623 Jul 25 19:46:18.171005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1211/2252] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:18.326673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-012a041d-79fc-4bce-8a73-6188dcab734e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:18.327262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-012a041d-79fc-4bce-8a73-6188dcab734e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:18.333780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-012a041d-79fc-4bce-8a73-6188dcab734e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:18.334234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-012a041d-79fc-4bce-8a73-6188dcab734e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:18.335003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-012a041d-79fc-4bce-8a73-6188dcab734e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:18.335446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-012a041d-79fc-4bce-8a73-6188dcab734e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:18.354004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:46:18.401485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-012a041d-79fc-4bce-8a73-6188dcab734e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:18.410438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-012a041d-79fc-4bce-8a73-6188dcab734e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087602 Jul 25 19:46:18.411009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1042/2253] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:19.194688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0f7b8bee-5432-4ddd-bf83-f48b3a25dac5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:19.195291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0f7b8bee-5432-4ddd-bf83-f48b3a25dac5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:19.202515 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f7b8bee-5432-4ddd-bf83-f48b3a25dac5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:19.202956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f7b8bee-5432-4ddd-bf83-f48b3a25dac5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:19.203738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f7b8bee-5432-4ddd-bf83-f48b3a25dac5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:19.204170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0f7b8bee-5432-4ddd-bf83-f48b3a25dac5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:19.337745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0f7b8bee-5432-4ddd-bf83-f48b3a25dac5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:19.346943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0f7b8bee-5432-4ddd-bf83-f48b3a25dac5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:19.348495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0f7b8bee-5432-4ddd-bf83-f48b3a25dac5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:19.349640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0f7b8bee-5432-4ddd-bf83-f48b3a25dac5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.158825 Jul 25 19:46:19.350201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1212/2254] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:19.431865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ce8fd741-2e81-4e40-998a-aff5d17c311a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:19.432391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ce8fd741-2e81-4e40-998a-aff5d17c311a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:19.440003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce8fd741-2e81-4e40-998a-aff5d17c311a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:19.440453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce8fd741-2e81-4e40-998a-aff5d17c311a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:19.441215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce8fd741-2e81-4e40-998a-aff5d17c311a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:19.441654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce8fd741-2e81-4e40-998a-aff5d17c311a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:19.507540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ce8fd741-2e81-4e40-998a-aff5d17c311a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:19.516741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ce8fd741-2e81-4e40-998a-aff5d17c311a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088854 Jul 25 19:46:19.517309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1043/2255] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:20.374567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a5435bff-878e-46d1-bf2b-463150cc0f66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:20.375167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a5435bff-878e-46d1-bf2b-463150cc0f66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:20.382211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5435bff-878e-46d1-bf2b-463150cc0f66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:20.382654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5435bff-878e-46d1-bf2b-463150cc0f66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:20.383404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5435bff-878e-46d1-bf2b-463150cc0f66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:20.383890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5435bff-878e-46d1-bf2b-463150cc0f66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:20.528746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a5435bff-878e-46d1-bf2b-463150cc0f66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:20.537467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a5435bff-878e-46d1-bf2b-463150cc0f66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:20.538120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9d34e7df-a15a-411e-bc3a-9d5382fdde8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:20.538757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9d34e7df-a15a-411e-bc3a-9d5382fdde8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:20.539051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a5435bff-878e-46d1-bf2b-463150cc0f66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:20.540232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a5435bff-878e-46d1-bf2b-463150cc0f66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.170305 Jul 25 19:46:20.540791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1213/2256] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:20.545930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d34e7df-a15a-411e-bc3a-9d5382fdde8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:20.546377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d34e7df-a15a-411e-bc3a-9d5382fdde8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:20.547155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d34e7df-a15a-411e-bc3a-9d5382fdde8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:20.547955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d34e7df-a15a-411e-bc3a-9d5382fdde8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:20.612641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9d34e7df-a15a-411e-bc3a-9d5382fdde8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:20.620831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9d34e7df-a15a-411e-bc3a-9d5382fdde8d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086407 Jul 25 19:46:20.622692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1044/2257] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:21.563817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d0707604-d364-407b-956c-46ebbe77a6ea tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:21.564455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d0707604-d364-407b-956c-46ebbe77a6ea tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:21.570907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0707604-d364-407b-956c-46ebbe77a6ea tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:21.571351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0707604-d364-407b-956c-46ebbe77a6ea tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:21.572147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0707604-d364-407b-956c-46ebbe77a6ea tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:21.572578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0707604-d364-407b-956c-46ebbe77a6ea tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:21.577057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:46:21.644336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bb64a182-e234-4d19-8d9d-67745b364810 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:21.644928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bb64a182-e234-4d19-8d9d-67745b364810 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:21.651164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb64a182-e234-4d19-8d9d-67745b364810 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:21.651639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb64a182-e234-4d19-8d9d-67745b364810 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:21.652512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb64a182-e234-4d19-8d9d-67745b364810 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:21.652860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb64a182-e234-4d19-8d9d-67745b364810 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:21.734382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bb64a182-e234-4d19-8d9d-67745b364810 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:21.737813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d0707604-d364-407b-956c-46ebbe77a6ea tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:21.742800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bb64a182-e234-4d19-8d9d-67745b364810 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.102559 Jul 25 19:46:21.743583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1045/2258] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:21 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:21.746306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d0707604-d364-407b-956c-46ebbe77a6ea tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:21.748329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d0707604-d364-407b-956c-46ebbe77a6ea tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:21.749481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d0707604-d364-407b-956c-46ebbe77a6ea tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.189816 Jul 25 19:46:21.750156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1214/2259] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:22.766170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1933078-0013-4eee-8672-fe9a434f9a5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:22.766791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c1933078-0013-4eee-8672-fe9a434f9a5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:22.773159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d2ec4d68-0eaa-43a7-affa-95cc99af39f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:22.773768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d2ec4d68-0eaa-43a7-affa-95cc99af39f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:22.775195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1933078-0013-4eee-8672-fe9a434f9a5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:22.775757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1933078-0013-4eee-8672-fe9a434f9a5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:22.776529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1933078-0013-4eee-8672-fe9a434f9a5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:22.776970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1933078-0013-4eee-8672-fe9a434f9a5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:22.780633 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2ec4d68-0eaa-43a7-affa-95cc99af39f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:22.781078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2ec4d68-0eaa-43a7-affa-95cc99af39f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:22.781841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2ec4d68-0eaa-43a7-affa-95cc99af39f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:22.782269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d2ec4d68-0eaa-43a7-affa-95cc99af39f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:22.862497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c1933078-0013-4eee-8672-fe9a434f9a5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:22.870680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c1933078-0013-4eee-8672-fe9a434f9a5d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.109386 Jul 25 19:46:22.871258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1046/2260] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:22.930867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d2ec4d68-0eaa-43a7-affa-95cc99af39f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:22.940527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d2ec4d68-0eaa-43a7-affa-95cc99af39f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:22.942034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d2ec4d68-0eaa-43a7-affa-95cc99af39f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:22.943194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d2ec4d68-0eaa-43a7-affa-95cc99af39f3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.174145 Jul 25 19:46:22.943785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1215/2261] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:46:23.892161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1f7d2162-67c4-4bca-82dd-954a9bf319f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:23.892755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1f7d2162-67c4-4bca-82dd-954a9bf319f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:23.899225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f7d2162-67c4-4bca-82dd-954a9bf319f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:23.899704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f7d2162-67c4-4bca-82dd-954a9bf319f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:23.900466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f7d2162-67c4-4bca-82dd-954a9bf319f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:23.900905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f7d2162-67c4-4bca-82dd-954a9bf319f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:23.965333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1f7d2162-67c4-4bca-82dd-954a9bf319f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:23.966338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4667ad59-8a2e-4330-a673-cc003598f8ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:23.967747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4667ad59-8a2e-4330-a673-cc003598f8ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:23.973970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1f7d2162-67c4-4bca-82dd-954a9bf319f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085654 Jul 25 19:46:23.974436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4667ad59-8a2e-4330-a673-cc003598f8ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:23.974673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1047/2262] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:23.974902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4667ad59-8a2e-4330-a673-cc003598f8ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:23.975832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4667ad59-8a2e-4330-a673-cc003598f8ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:23.976278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4667ad59-8a2e-4330-a673-cc003598f8ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:24.105692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4667ad59-8a2e-4330-a673-cc003598f8ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:24.114996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4667ad59-8a2e-4330-a673-cc003598f8ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:24.116514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4667ad59-8a2e-4330-a673-cc003598f8ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:24.117664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4667ad59-8a2e-4330-a673-cc003598f8ad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.155287 Jul 25 19:46:24.118220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1216/2263] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:46:24.996343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-590e7ba3-d114-497e-a5ec-2976709e25c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:24.996930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-590e7ba3-d114-497e-a5ec-2976709e25c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:25.003555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-590e7ba3-d114-497e-a5ec-2976709e25c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:25.004006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-590e7ba3-d114-497e-a5ec-2976709e25c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:25.004768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-590e7ba3-d114-497e-a5ec-2976709e25c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:25.005212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-590e7ba3-d114-497e-a5ec-2976709e25c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:25.067133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-590e7ba3-d114-497e-a5ec-2976709e25c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:25.075713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-590e7ba3-d114-497e-a5ec-2976709e25c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.083005 Jul 25 19:46:25.076972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1048/2264] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:25.143711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e9faabef-287b-40d0-96a0-06a10e40eaad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:25.144332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e9faabef-287b-40d0-96a0-06a10e40eaad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:25.150815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e9faabef-287b-40d0-96a0-06a10e40eaad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:25.151259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e9faabef-287b-40d0-96a0-06a10e40eaad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:25.152052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e9faabef-287b-40d0-96a0-06a10e40eaad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:25.152506 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e9faabef-287b-40d0-96a0-06a10e40eaad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:25.290686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e9faabef-287b-40d0-96a0-06a10e40eaad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:25.299938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e9faabef-287b-40d0-96a0-06a10e40eaad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:25.301522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e9faabef-287b-40d0-96a0-06a10e40eaad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:25.302699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e9faabef-287b-40d0-96a0-06a10e40eaad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.164091 Jul 25 19:46:25.303264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1217/2265] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:26.097634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13461a65-d3a8-47ed-964b-f2a40690d049 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:26.098241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-13461a65-d3a8-47ed-964b-f2a40690d049 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:26.104813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13461a65-d3a8-47ed-964b-f2a40690d049 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:26.105254 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13461a65-d3a8-47ed-964b-f2a40690d049 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:26.106012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13461a65-d3a8-47ed-964b-f2a40690d049 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:26.106448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13461a65-d3a8-47ed-964b-f2a40690d049 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:26.170556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-13461a65-d3a8-47ed-964b-f2a40690d049 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:26.178674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13461a65-d3a8-47ed-964b-f2a40690d049 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.084887 Jul 25 19:46:26.179249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1049/2266] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:26.328242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-501f3770-00df-4cbb-91fe-8fabba39de32 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:26.328948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-501f3770-00df-4cbb-91fe-8fabba39de32 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:26.335752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-501f3770-00df-4cbb-91fe-8fabba39de32 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:26.336204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-501f3770-00df-4cbb-91fe-8fabba39de32 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:26.336962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-501f3770-00df-4cbb-91fe-8fabba39de32 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:26.337390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-501f3770-00df-4cbb-91fe-8fabba39de32 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:26.467713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-501f3770-00df-4cbb-91fe-8fabba39de32 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:26.477229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-501f3770-00df-4cbb-91fe-8fabba39de32 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:26.478715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-501f3770-00df-4cbb-91fe-8fabba39de32 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:26.480037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-501f3770-00df-4cbb-91fe-8fabba39de32 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.157212 Jul 25 19:46:26.480595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1218/2267] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:27.199490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-22573925-fcd3-4d17-976b-42026ba6fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:27.200115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-22573925-fcd3-4d17-976b-42026ba6fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:27.206629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22573925-fcd3-4d17-976b-42026ba6fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:27.207069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22573925-fcd3-4d17-976b-42026ba6fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:27.207867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22573925-fcd3-4d17-976b-42026ba6fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:27.208306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22573925-fcd3-4d17-976b-42026ba6fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:27.278689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-22573925-fcd3-4d17-976b-42026ba6fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:27.288463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-22573925-fcd3-4d17-976b-42026ba6fc76 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092824 Jul 25 19:46:27.289045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1050/2268] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:27.504663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b60661dd-e298-4bfd-b600-a3c7caf6d624 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:27.505195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b60661dd-e298-4bfd-b600-a3c7caf6d624 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:27.511980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b60661dd-e298-4bfd-b600-a3c7caf6d624 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:27.512454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b60661dd-e298-4bfd-b600-a3c7caf6d624 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:27.513180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b60661dd-e298-4bfd-b600-a3c7caf6d624 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:27.513841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b60661dd-e298-4bfd-b600-a3c7caf6d624 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:27.647928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b60661dd-e298-4bfd-b600-a3c7caf6d624 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:27.657510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b60661dd-e298-4bfd-b600-a3c7caf6d624 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:27.659008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b60661dd-e298-4bfd-b600-a3c7caf6d624 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:27.660318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b60661dd-e298-4bfd-b600-a3c7caf6d624 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.159615 Jul 25 19:46:27.660886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1219/2269] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:28.309238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-782bd720-a1b5-477c-829a-f54a62b68247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:28.309848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-782bd720-a1b5-477c-829a-f54a62b68247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:28.317192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-782bd720-a1b5-477c-829a-f54a62b68247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:28.317639 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-782bd720-a1b5-477c-829a-f54a62b68247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:28.318398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-782bd720-a1b5-477c-829a-f54a62b68247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:28.318837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-782bd720-a1b5-477c-829a-f54a62b68247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:28.382933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-782bd720-a1b5-477c-829a-f54a62b68247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:28.390832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-782bd720-a1b5-477c-829a-f54a62b68247 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085444 Jul 25 19:46:28.391393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1051/2270] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:28.684803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-05202ea1-df04-49c8-8086-15460a5a294b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:28.685466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-05202ea1-df04-49c8-8086-15460a5a294b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:28.692942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05202ea1-df04-49c8-8086-15460a5a294b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:28.693448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05202ea1-df04-49c8-8086-15460a5a294b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:28.694152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05202ea1-df04-49c8-8086-15460a5a294b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:28.694628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05202ea1-df04-49c8-8086-15460a5a294b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:28.832390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-05202ea1-df04-49c8-8086-15460a5a294b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:28.840763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-05202ea1-df04-49c8-8086-15460a5a294b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:28.842395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-05202ea1-df04-49c8-8086-15460a5a294b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:28.843562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-05202ea1-df04-49c8-8086-15460a5a294b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.162605 Jul 25 19:46:28.844127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1220/2271] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:29.411903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2e2f8a6e-2859-4e29-a926-740088762836 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:29.412539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2e2f8a6e-2859-4e29-a926-740088762836 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:29.418941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a6e-2859-4e29-a926-740088762836 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:29.419446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a6e-2859-4e29-a926-740088762836 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:29.420173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a6e-2859-4e29-a926-740088762836 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:29.420609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a6e-2859-4e29-a926-740088762836 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:29.482019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2e2f8a6e-2859-4e29-a926-740088762836 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:29.490308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2e2f8a6e-2859-4e29-a926-740088762836 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.082881 Jul 25 19:46:29.490865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1052/2272] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:29 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:29.867958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9e64dce9-c086-408f-8cbe-6fb51a15428d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:29.868609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9e64dce9-c086-408f-8cbe-6fb51a15428d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:29.875354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e64dce9-c086-408f-8cbe-6fb51a15428d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:29.875829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e64dce9-c086-408f-8cbe-6fb51a15428d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:29.877325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e64dce9-c086-408f-8cbe-6fb51a15428d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:29.877620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e64dce9-c086-408f-8cbe-6fb51a15428d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:30.045512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9e64dce9-c086-408f-8cbe-6fb51a15428d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:30.054581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9e64dce9-c086-408f-8cbe-6fb51a15428d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:30.056128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9e64dce9-c086-408f-8cbe-6fb51a15428d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:30.057290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9e64dce9-c086-408f-8cbe-6fb51a15428d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.193260 Jul 25 19:46:30.058234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1221/2273] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:29 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:30.514930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb171a9a-079e-4be5-9ee0-1bc24ccd7a70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:30.515893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb171a9a-079e-4be5-9ee0-1bc24ccd7a70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:30.523818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb171a9a-079e-4be5-9ee0-1bc24ccd7a70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:30.524358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb171a9a-079e-4be5-9ee0-1bc24ccd7a70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:30.525153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb171a9a-079e-4be5-9ee0-1bc24ccd7a70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:30.525569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb171a9a-079e-4be5-9ee0-1bc24ccd7a70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:30.606665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fb171a9a-079e-4be5-9ee0-1bc24ccd7a70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:30.616257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb171a9a-079e-4be5-9ee0-1bc24ccd7a70 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.106722 Jul 25 19:46:30.631541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1053/2274] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:31.082817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d22de9dc-d86f-4a89-b6fd-6e37c5f22acd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:31.083422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d22de9dc-d86f-4a89-b6fd-6e37c5f22acd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:31.090031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d22de9dc-d86f-4a89-b6fd-6e37c5f22acd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:31.090480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d22de9dc-d86f-4a89-b6fd-6e37c5f22acd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:31.091253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d22de9dc-d86f-4a89-b6fd-6e37c5f22acd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:31.091736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d22de9dc-d86f-4a89-b6fd-6e37c5f22acd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:31.253629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d22de9dc-d86f-4a89-b6fd-6e37c5f22acd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:31.263400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d22de9dc-d86f-4a89-b6fd-6e37c5f22acd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:31.264980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d22de9dc-d86f-4a89-b6fd-6e37c5f22acd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:31.266307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d22de9dc-d86f-4a89-b6fd-6e37c5f22acd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.188252 Jul 25 19:46:31.267128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1222/2275] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:46:31.650993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a6187a70-cf06-4ded-9e30-4de495879b0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:31.651638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a6187a70-cf06-4ded-9e30-4de495879b0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:31.658811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6187a70-cf06-4ded-9e30-4de495879b0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:31.659262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6187a70-cf06-4ded-9e30-4de495879b0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:31.660076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6187a70-cf06-4ded-9e30-4de495879b0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:31.660528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6187a70-cf06-4ded-9e30-4de495879b0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:31.724857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a6187a70-cf06-4ded-9e30-4de495879b0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:31.733061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a6187a70-cf06-4ded-9e30-4de495879b0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085940 Jul 25 19:46:31.733628 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1054/2276] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:31 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:32.289830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-310056a6-c7d5-499b-9756-64f66bf38c2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:32.290461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-310056a6-c7d5-499b-9756-64f66bf38c2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:32.297068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-310056a6-c7d5-499b-9756-64f66bf38c2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:32.297521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-310056a6-c7d5-499b-9756-64f66bf38c2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:32.298997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-310056a6-c7d5-499b-9756-64f66bf38c2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:32.299432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-310056a6-c7d5-499b-9756-64f66bf38c2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:32.437752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-310056a6-c7d5-499b-9756-64f66bf38c2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:32.446926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-310056a6-c7d5-499b-9756-64f66bf38c2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:32.448443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-310056a6-c7d5-499b-9756-64f66bf38c2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:32.449607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-310056a6-c7d5-499b-9756-64f66bf38c2d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.163668 Jul 25 19:46:32.450163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1223/2277] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:32 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:46:32.754421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8777cc50-742c-431b-91e6-08fadc5c8652 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:32.754978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8777cc50-742c-431b-91e6-08fadc5c8652 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:32.761585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8777cc50-742c-431b-91e6-08fadc5c8652 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:32.762035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8777cc50-742c-431b-91e6-08fadc5c8652 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:32.762797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8777cc50-742c-431b-91e6-08fadc5c8652 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:32.763235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8777cc50-742c-431b-91e6-08fadc5c8652 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:32.827972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8777cc50-742c-431b-91e6-08fadc5c8652 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:32.836866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8777cc50-742c-431b-91e6-08fadc5c8652 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086389 Jul 25 19:46:32.837460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1055/2278] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:33.474155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-83e30bdd-0961-428a-8c9f-5c750fa2d680 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:33.474763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-83e30bdd-0961-428a-8c9f-5c750fa2d680 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:33.481510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83e30bdd-0961-428a-8c9f-5c750fa2d680 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:33.482000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83e30bdd-0961-428a-8c9f-5c750fa2d680 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:33.482766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83e30bdd-0961-428a-8c9f-5c750fa2d680 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:33.483209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83e30bdd-0961-428a-8c9f-5c750fa2d680 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:33.627269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-83e30bdd-0961-428a-8c9f-5c750fa2d680 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:33.636019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-83e30bdd-0961-428a-8c9f-5c750fa2d680 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:33.637522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-83e30bdd-0961-428a-8c9f-5c750fa2d680 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:33.638688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-83e30bdd-0961-428a-8c9f-5c750fa2d680 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.169102 Jul 25 19:46:33.639255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1224/2279] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:33.859045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b57e513-6d1c-41dd-bdb5-ad68ad7eb362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:33.859692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2b57e513-6d1c-41dd-bdb5-ad68ad7eb362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:33.866808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b57e513-6d1c-41dd-bdb5-ad68ad7eb362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:33.867257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b57e513-6d1c-41dd-bdb5-ad68ad7eb362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:33.868159 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b57e513-6d1c-41dd-bdb5-ad68ad7eb362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:33.868506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b57e513-6d1c-41dd-bdb5-ad68ad7eb362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:33.933498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2b57e513-6d1c-41dd-bdb5-ad68ad7eb362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:33.942580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2b57e513-6d1c-41dd-bdb5-ad68ad7eb362 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087575 Jul 25 19:46:33.943182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1056/2280] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:34.662545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-49002b78-8cc1-413d-955f-a2d510309e31 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:34.663215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-49002b78-8cc1-413d-955f-a2d510309e31 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:34.670108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49002b78-8cc1-413d-955f-a2d510309e31 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:34.670556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49002b78-8cc1-413d-955f-a2d510309e31 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:34.671362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49002b78-8cc1-413d-955f-a2d510309e31 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:34.671822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49002b78-8cc1-413d-955f-a2d510309e31 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:34.836995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-49002b78-8cc1-413d-955f-a2d510309e31 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:34.853155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-49002b78-8cc1-413d-955f-a2d510309e31 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:34.856117 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-49002b78-8cc1-413d-955f-a2d510309e31 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:34.858346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-49002b78-8cc1-413d-955f-a2d510309e31 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.199482 Jul 25 19:46:34.859336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1225/2281] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:46:34.964406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d3d83416-056d-42e8-9774-e46001871b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:34.965173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d3d83416-056d-42e8-9774-e46001871b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:34.972644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3d83416-056d-42e8-9774-e46001871b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:34.973095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3d83416-056d-42e8-9774-e46001871b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:34.973902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3d83416-056d-42e8-9774-e46001871b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:34.974415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3d83416-056d-42e8-9774-e46001871b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:35.044518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d3d83416-056d-42e8-9774-e46001871b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:35.055299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d3d83416-056d-42e8-9774-e46001871b6e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094793 Jul 25 19:46:35.055907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1057/2282] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:35.900501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-01d05491-24e1-4403-9dc9-0d67d275c059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:35.901119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-01d05491-24e1-4403-9dc9-0d67d275c059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:35.909272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-01d05491-24e1-4403-9dc9-0d67d275c059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:35.909576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-01d05491-24e1-4403-9dc9-0d67d275c059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:35.910343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-01d05491-24e1-4403-9dc9-0d67d275c059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:35.910779 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-01d05491-24e1-4403-9dc9-0d67d275c059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:36.056162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-01d05491-24e1-4403-9dc9-0d67d275c059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:36.065150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-01d05491-24e1-4403-9dc9-0d67d275c059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:36.066766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-01d05491-24e1-4403-9dc9-0d67d275c059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:36.067939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-01d05491-24e1-4403-9dc9-0d67d275c059 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.171383 Jul 25 19:46:36.068500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1226/2283] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:36.081022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e1d3fd3-3e83-45c9-b91e-04da136a62aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:36.081709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e1d3fd3-3e83-45c9-b91e-04da136a62aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:36.088476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e1d3fd3-3e83-45c9-b91e-04da136a62aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:36.088918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e1d3fd3-3e83-45c9-b91e-04da136a62aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:36.090195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e1d3fd3-3e83-45c9-b91e-04da136a62aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:36.090195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e1d3fd3-3e83-45c9-b91e-04da136a62aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:36.164712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1e1d3fd3-3e83-45c9-b91e-04da136a62aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:36.174342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e1d3fd3-3e83-45c9-b91e-04da136a62aa tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.097376 Jul 25 19:46:36.174927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1058/2284] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:37.092397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b18ca3fe-2937-42b1-a705-34327e5aae1b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:37.093197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b18ca3fe-2937-42b1-a705-34327e5aae1b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:37.100266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b18ca3fe-2937-42b1-a705-34327e5aae1b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:37.100728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b18ca3fe-2937-42b1-a705-34327e5aae1b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:37.101518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b18ca3fe-2937-42b1-a705-34327e5aae1b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:37.101961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b18ca3fe-2937-42b1-a705-34327e5aae1b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:37.195608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad0b4bb7-f036-4648-b8ff-553d50e9bd23 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:37.196286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad0b4bb7-f036-4648-b8ff-553d50e9bd23 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:37.205770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad0b4bb7-f036-4648-b8ff-553d50e9bd23 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:37.206094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad0b4bb7-f036-4648-b8ff-553d50e9bd23 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:37.207076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad0b4bb7-f036-4648-b8ff-553d50e9bd23 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:37.207663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad0b4bb7-f036-4648-b8ff-553d50e9bd23 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:37.212612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:46:37.268375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b18ca3fe-2937-42b1-a705-34327e5aae1b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:37.278279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b18ca3fe-2937-42b1-a705-34327e5aae1b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:37.279960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b18ca3fe-2937-42b1-a705-34327e5aae1b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:37.281157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b18ca3fe-2937-42b1-a705-34327e5aae1b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.192713 Jul 25 19:46:37.283568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1227/2285] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:37.304905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad0b4bb7-f036-4648-b8ff-553d50e9bd23 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:37.315231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad0b4bb7-f036-4648-b8ff-553d50e9bd23 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.123413 Jul 25 19:46:37.315858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1059/2286] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:38.312101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-63159216-3173-4ebe-92c3-5d60e64fd51d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:38.313790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-63159216-3173-4ebe-92c3-5d60e64fd51d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:38.317949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=52 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:46:38.327740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63159216-3173-4ebe-92c3-5d60e64fd51d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:38.328277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63159216-3173-4ebe-92c3-5d60e64fd51d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:38.330023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63159216-3173-4ebe-92c3-5d60e64fd51d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:38.330469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-63159216-3173-4ebe-92c3-5d60e64fd51d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:38.353274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-88b89153-899b-48ea-b4ed-086b53106d75 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:38.354279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-88b89153-899b-48ea-b4ed-086b53106d75 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:38.365230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88b89153-899b-48ea-b4ed-086b53106d75 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:38.366344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88b89153-899b-48ea-b4ed-086b53106d75 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:38.367633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88b89153-899b-48ea-b4ed-086b53106d75 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:38.368318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88b89153-899b-48ea-b4ed-086b53106d75 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:38.470699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-88b89153-899b-48ea-b4ed-086b53106d75 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:38.482296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-88b89153-899b-48ea-b4ed-086b53106d75 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.135578 Jul 25 19:46:38.483055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1060/2287] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:38.559722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-63159216-3173-4ebe-92c3-5d60e64fd51d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:38.572380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-63159216-3173-4ebe-92c3-5d60e64fd51d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:38.573883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-63159216-3173-4ebe-92c3-5d60e64fd51d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:38.575059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-63159216-3173-4ebe-92c3-5d60e64fd51d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.270644 Jul 25 19:46:38.575723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1228/2288] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:38 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:39.507547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-33317783-db95-4454-9eea-34f0076dc073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:39.508525 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-33317783-db95-4454-9eea-34f0076dc073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:39.511975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=56 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:46:39.520188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33317783-db95-4454-9eea-34f0076dc073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:39.520739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33317783-db95-4454-9eea-34f0076dc073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:39.521589 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33317783-db95-4454-9eea-34f0076dc073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:39.522028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33317783-db95-4454-9eea-34f0076dc073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:39.599678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1946bc06-27c3-43ea-bab7-ad56b56da896 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:39.600660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1946bc06-27c3-43ea-bab7-ad56b56da896 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:39.608410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1946bc06-27c3-43ea-bab7-ad56b56da896 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:39.608855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1946bc06-27c3-43ea-bab7-ad56b56da896 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:39.609676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1946bc06-27c3-43ea-bab7-ad56b56da896 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:39.610151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1946bc06-27c3-43ea-bab7-ad56b56da896 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:39.620392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-33317783-db95-4454-9eea-34f0076dc073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:39.639153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-33317783-db95-4454-9eea-34f0076dc073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.136005 Jul 25 19:46:39.640167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1061/2289] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:39.797270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1946bc06-27c3-43ea-bab7-ad56b56da896 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:39.810287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1946bc06-27c3-43ea-bab7-ad56b56da896 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:39.811885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1946bc06-27c3-43ea-bab7-ad56b56da896 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:39.813063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1946bc06-27c3-43ea-bab7-ad56b56da896 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.218342 Jul 25 19:46:39.814087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1229/2290] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:46:40.663038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9fded3a6-1494-4f0a-b4aa-77d839eef1b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:40.663683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9fded3a6-1494-4f0a-b4aa-77d839eef1b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:40.670477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9fded3a6-1494-4f0a-b4aa-77d839eef1b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:40.670916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9fded3a6-1494-4f0a-b4aa-77d839eef1b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:40.671719 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9fded3a6-1494-4f0a-b4aa-77d839eef1b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:40.672160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9fded3a6-1494-4f0a-b4aa-77d839eef1b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:40.742696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9fded3a6-1494-4f0a-b4aa-77d839eef1b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:40.751205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9fded3a6-1494-4f0a-b4aa-77d839eef1b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092070 Jul 25 19:46:40.751843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1062/2291] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:40.838761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c4904dca-1ad6-4b18-bf2b-1164a20553f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:40.839392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c4904dca-1ad6-4b18-bf2b-1164a20553f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:40.848002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4904dca-1ad6-4b18-bf2b-1164a20553f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:40.848599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4904dca-1ad6-4b18-bf2b-1164a20553f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:40.849492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4904dca-1ad6-4b18-bf2b-1164a20553f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:40.850141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4904dca-1ad6-4b18-bf2b-1164a20553f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:41.010698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c4904dca-1ad6-4b18-bf2b-1164a20553f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:41.015692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:46:41.025927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c4904dca-1ad6-4b18-bf2b-1164a20553f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:41.027846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c4904dca-1ad6-4b18-bf2b-1164a20553f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:41.029038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c4904dca-1ad6-4b18-bf2b-1164a20553f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.194444 Jul 25 19:46:41.029606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1230/2292] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:46:41.784661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3beb6902-d23f-4b12-b76a-f0c5c15952ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:41.785371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3beb6902-d23f-4b12-b76a-f0c5c15952ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:41.793023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3beb6902-d23f-4b12-b76a-f0c5c15952ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:41.793528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3beb6902-d23f-4b12-b76a-f0c5c15952ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:41.794431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3beb6902-d23f-4b12-b76a-f0c5c15952ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:41.794918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3beb6902-d23f-4b12-b76a-f0c5c15952ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:41.868841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3beb6902-d23f-4b12-b76a-f0c5c15952ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:41.879484 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3beb6902-d23f-4b12-b76a-f0c5c15952ec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.098639 Jul 25 19:46:41.880106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1063/2293] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:42.065843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8aeae43a-10a8-45b6-a779-5b6aa8c4d483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:42.066546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8aeae43a-10a8-45b6-a779-5b6aa8c4d483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:42.073714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8aeae43a-10a8-45b6-a779-5b6aa8c4d483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:42.074288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8aeae43a-10a8-45b6-a779-5b6aa8c4d483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:42.075106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8aeae43a-10a8-45b6-a779-5b6aa8c4d483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:42.075721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8aeae43a-10a8-45b6-a779-5b6aa8c4d483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:42.256990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8aeae43a-10a8-45b6-a779-5b6aa8c4d483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:42.275658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8aeae43a-10a8-45b6-a779-5b6aa8c4d483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:42.278554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8aeae43a-10a8-45b6-a779-5b6aa8c4d483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:42.280774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8aeae43a-10a8-45b6-a779-5b6aa8c4d483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.221098 Jul 25 19:46:42.281798 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1231/2294] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:46:42.905669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e8efa73a-a8c8-464b-8868-6f4434461e53 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:42.906276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e8efa73a-a8c8-464b-8868-6f4434461e53 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:42.913854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8efa73a-a8c8-464b-8868-6f4434461e53 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:42.914306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8efa73a-a8c8-464b-8868-6f4434461e53 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:42.915065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8efa73a-a8c8-464b-8868-6f4434461e53 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:42.915501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8efa73a-a8c8-464b-8868-6f4434461e53 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:42.982173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e8efa73a-a8c8-464b-8868-6f4434461e53 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:42.991870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e8efa73a-a8c8-464b-8868-6f4434461e53 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090074 Jul 25 19:46:42.992442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1064/2295] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:42 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:43.309544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5b22147a-7314-41b4-911a-f290cf9c5f3f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:43.310365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5b22147a-7314-41b4-911a-f290cf9c5f3f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:43.317773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b22147a-7314-41b4-911a-f290cf9c5f3f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:43.318255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b22147a-7314-41b4-911a-f290cf9c5f3f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:43.319199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b22147a-7314-41b4-911a-f290cf9c5f3f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:43.319743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b22147a-7314-41b4-911a-f290cf9c5f3f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:43.771391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5b22147a-7314-41b4-911a-f290cf9c5f3f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:43.781487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5b22147a-7314-41b4-911a-f290cf9c5f3f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:43.783856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5b22147a-7314-41b4-911a-f290cf9c5f3f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:43.785038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5b22147a-7314-41b4-911a-f290cf9c5f3f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.480238 Jul 25 19:46:43.785598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1232/2296] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:44.015805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3052cdc7-d14e-41e3-a3dc-b9b6b570ef5c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:44.017508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3052cdc7-d14e-41e3-a3dc-b9b6b570ef5c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:44.025072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3052cdc7-d14e-41e3-a3dc-b9b6b570ef5c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:44.025622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3052cdc7-d14e-41e3-a3dc-b9b6b570ef5c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:44.026572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3052cdc7-d14e-41e3-a3dc-b9b6b570ef5c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:44.027054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3052cdc7-d14e-41e3-a3dc-b9b6b570ef5c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:44.108993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3052cdc7-d14e-41e3-a3dc-b9b6b570ef5c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:44.123275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3052cdc7-d14e-41e3-a3dc-b9b6b570ef5c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.111822 Jul 25 19:46:44.124325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1065/2297] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:44.822945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c9f62102-7179-4c06-936b-2752ed37f006 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:44.823820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c9f62102-7179-4c06-936b-2752ed37f006 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:44.834759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9f62102-7179-4c06-936b-2752ed37f006 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:44.835417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9f62102-7179-4c06-936b-2752ed37f006 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:44.836632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9f62102-7179-4c06-936b-2752ed37f006 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:44.837316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9f62102-7179-4c06-936b-2752ed37f006 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:45.021394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c9f62102-7179-4c06-936b-2752ed37f006 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:45.031669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c9f62102-7179-4c06-936b-2752ed37f006 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:45.034203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c9f62102-7179-4c06-936b-2752ed37f006 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:45.036497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c9f62102-7179-4c06-936b-2752ed37f006 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.219885 Jul 25 19:46:45.037508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1233/2298] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:45.159711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62b7469e-86a2-479a-a5d0-caf79b42413e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:45.160552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62b7469e-86a2-479a-a5d0-caf79b42413e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:45.171115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62b7469e-86a2-479a-a5d0-caf79b42413e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:45.172254 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62b7469e-86a2-479a-a5d0-caf79b42413e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:45.173674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62b7469e-86a2-479a-a5d0-caf79b42413e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:45.174335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62b7469e-86a2-479a-a5d0-caf79b42413e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:45.268931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62b7469e-86a2-479a-a5d0-caf79b42413e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:45.280092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62b7469e-86a2-479a-a5d0-caf79b42413e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.127035 Jul 25 19:46:45.280833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1066/2299] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:46.081324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3efbc6e6-4fde-454c-bd50-b8511de34d74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:46.082252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3efbc6e6-4fde-454c-bd50-b8511de34d74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:46.091603 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3efbc6e6-4fde-454c-bd50-b8511de34d74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:46.092276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3efbc6e6-4fde-454c-bd50-b8511de34d74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:46.093452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3efbc6e6-4fde-454c-bd50-b8511de34d74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:46.094106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3efbc6e6-4fde-454c-bd50-b8511de34d74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:46.248281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3efbc6e6-4fde-454c-bd50-b8511de34d74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:46.257383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3efbc6e6-4fde-454c-bd50-b8511de34d74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:46.259046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3efbc6e6-4fde-454c-bd50-b8511de34d74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:46.260251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3efbc6e6-4fde-454c-bd50-b8511de34d74 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.186152 Jul 25 19:46:46.260814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1234/2300] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:46.308114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ae3af34-fe8f-4f2a-b882-adc7ea72b43a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:46.308743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2ae3af34-fe8f-4f2a-b882-adc7ea72b43a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:46.316319 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ae3af34-fe8f-4f2a-b882-adc7ea72b43a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:46.316763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ae3af34-fe8f-4f2a-b882-adc7ea72b43a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:46.317530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ae3af34-fe8f-4f2a-b882-adc7ea72b43a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:46.317964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ae3af34-fe8f-4f2a-b882-adc7ea72b43a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:46.385003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2ae3af34-fe8f-4f2a-b882-adc7ea72b43a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:46.393874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2ae3af34-fe8f-4f2a-b882-adc7ea72b43a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089514 Jul 25 19:46:46.394457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1067/2301] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:47.285951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4e5b9148-15aa-4884-a881-4adca6ef3116 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:47.286814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4e5b9148-15aa-4884-a881-4adca6ef3116 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:47.293821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e5b9148-15aa-4884-a881-4adca6ef3116 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:47.295354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e5b9148-15aa-4884-a881-4adca6ef3116 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:47.296198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e5b9148-15aa-4884-a881-4adca6ef3116 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:47.296643 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e5b9148-15aa-4884-a881-4adca6ef3116 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:47.416218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dcd0989a-2a82-45d3-b0a6-07e96c58cacd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:47.417006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dcd0989a-2a82-45d3-b0a6-07e96c58cacd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:47.427555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcd0989a-2a82-45d3-b0a6-07e96c58cacd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:47.428279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcd0989a-2a82-45d3-b0a6-07e96c58cacd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:47.429544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcd0989a-2a82-45d3-b0a6-07e96c58cacd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:47.430259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcd0989a-2a82-45d3-b0a6-07e96c58cacd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:47.525776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e5b9148-15aa-4884-a881-4adca6ef3116 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:47.539430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e5b9148-15aa-4884-a881-4adca6ef3116 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:47.542108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e5b9148-15aa-4884-a881-4adca6ef3116 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:47.544073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4e5b9148-15aa-4884-a881-4adca6ef3116 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.262895 Jul 25 19:46:47.545031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1235/2302] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:47.556760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dcd0989a-2a82-45d3-b0a6-07e96c58cacd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:47.569721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dcd0989a-2a82-45d3-b0a6-07e96c58cacd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.157110 Jul 25 19:46:47.570595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1068/2303] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:46:48.574932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c06cf29d-bd4f-4416-bb0c-b65be6f7f444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:48.576003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c06cf29d-bd4f-4416-bb0c-b65be6f7f444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:48.586852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c06cf29d-bd4f-4416-bb0c-b65be6f7f444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:48.587566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c06cf29d-bd4f-4416-bb0c-b65be6f7f444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:48.588785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c06cf29d-bd4f-4416-bb0c-b65be6f7f444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:48.589514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c06cf29d-bd4f-4416-bb0c-b65be6f7f444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:48.596731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-95007f93-d5fb-46cf-a2aa-10d099d561f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:48.597648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-95007f93-d5fb-46cf-a2aa-10d099d561f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:48.605386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95007f93-d5fb-46cf-a2aa-10d099d561f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:48.605841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95007f93-d5fb-46cf-a2aa-10d099d561f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:48.606619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95007f93-d5fb-46cf-a2aa-10d099d561f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:48.607052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95007f93-d5fb-46cf-a2aa-10d099d561f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:48.689290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-95007f93-d5fb-46cf-a2aa-10d099d561f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:48.702287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-95007f93-d5fb-46cf-a2aa-10d099d561f0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.110657 Jul 25 19:46:48.703160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1069/2304] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:48.801095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c06cf29d-bd4f-4416-bb0c-b65be6f7f444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:48.811003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c06cf29d-bd4f-4416-bb0c-b65be6f7f444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:48.812565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c06cf29d-bd4f-4416-bb0c-b65be6f7f444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:48.813810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c06cf29d-bd4f-4416-bb0c-b65be6f7f444 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.245532 Jul 25 19:46:48.814379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1236/2305] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:48 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:49.725366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77d1ef44-69e9-4258-b80d-17a7b4b6697e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:49.725964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-77d1ef44-69e9-4258-b80d-17a7b4b6697e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:49.732528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77d1ef44-69e9-4258-b80d-17a7b4b6697e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:49.732979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77d1ef44-69e9-4258-b80d-17a7b4b6697e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:49.733747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77d1ef44-69e9-4258-b80d-17a7b4b6697e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:49.734185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77d1ef44-69e9-4258-b80d-17a7b4b6697e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:49.816456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-77d1ef44-69e9-4258-b80d-17a7b4b6697e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:49.824992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-77d1ef44-69e9-4258-b80d-17a7b4b6697e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.103508 Jul 25 19:46:49.825640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1070/2306] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:49.839023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3b8931c4-c4eb-4487-a645-0569569feb3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:49.840287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3b8931c4-c4eb-4487-a645-0569569feb3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:49.852458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b8931c4-c4eb-4487-a645-0569569feb3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:49.853282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b8931c4-c4eb-4487-a645-0569569feb3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:49.854679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b8931c4-c4eb-4487-a645-0569569feb3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:49.855470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b8931c4-c4eb-4487-a645-0569569feb3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:50.017744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b8931c4-c4eb-4487-a645-0569569feb3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:50.026488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b8931c4-c4eb-4487-a645-0569569feb3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:50.028238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b8931c4-c4eb-4487-a645-0569569feb3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:50.029582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3b8931c4-c4eb-4487-a645-0569569feb3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.195509 Jul 25 19:46:50.029945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1237/2307] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:50.847070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-acabc2c2-4c65-474b-b8bf-75f1555aab08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:50.847678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-acabc2c2-4c65-474b-b8bf-75f1555aab08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:50.854476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-acabc2c2-4c65-474b-b8bf-75f1555aab08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:50.854934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-acabc2c2-4c65-474b-b8bf-75f1555aab08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:50.855741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-acabc2c2-4c65-474b-b8bf-75f1555aab08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:50.856176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-acabc2c2-4c65-474b-b8bf-75f1555aab08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:50.931823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-acabc2c2-4c65-474b-b8bf-75f1555aab08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:50.942772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-acabc2c2-4c65-474b-b8bf-75f1555aab08 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099983 Jul 25 19:46:50.943662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1071/2308] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:51.057437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9ed0b960-7459-4adb-ae07-97e68e5146c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:51.058520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9ed0b960-7459-4adb-ae07-97e68e5146c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:51.067249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ed0b960-7459-4adb-ae07-97e68e5146c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:51.068888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ed0b960-7459-4adb-ae07-97e68e5146c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:51.068888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ed0b960-7459-4adb-ae07-97e68e5146c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:51.069271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ed0b960-7459-4adb-ae07-97e68e5146c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:51.273695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9ed0b960-7459-4adb-ae07-97e68e5146c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:51.286365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9ed0b960-7459-4adb-ae07-97e68e5146c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:51.288355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9ed0b960-7459-4adb-ae07-97e68e5146c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:51.289995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9ed0b960-7459-4adb-ae07-97e68e5146c8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.238130 Jul 25 19:46:51.290727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1238/2309] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:51.973225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-32181d8f-f190-471a-9ec0-80a5b7c7a35b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:51.974255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-32181d8f-f190-471a-9ec0-80a5b7c7a35b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:51.983680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32181d8f-f190-471a-9ec0-80a5b7c7a35b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:51.984311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32181d8f-f190-471a-9ec0-80a5b7c7a35b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:51.985860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32181d8f-f190-471a-9ec0-80a5b7c7a35b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:51.986816 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32181d8f-f190-471a-9ec0-80a5b7c7a35b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:52.063438 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-32181d8f-f190-471a-9ec0-80a5b7c7a35b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:52.079169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-32181d8f-f190-471a-9ec0-80a5b7c7a35b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.109349 Jul 25 19:46:52.080230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1072/2310] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:52.317137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6336d2ed-b080-409a-9ac4-9927f5ffd659 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:52.318085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6336d2ed-b080-409a-9ac4-9927f5ffd659 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:52.325746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6336d2ed-b080-409a-9ac4-9927f5ffd659 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:52.326283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6336d2ed-b080-409a-9ac4-9927f5ffd659 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:52.327105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6336d2ed-b080-409a-9ac4-9927f5ffd659 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:52.327614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6336d2ed-b080-409a-9ac4-9927f5ffd659 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:52.487264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6336d2ed-b080-409a-9ac4-9927f5ffd659 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:52.497440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6336d2ed-b080-409a-9ac4-9927f5ffd659 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:52.498951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6336d2ed-b080-409a-9ac4-9927f5ffd659 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:52.500186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6336d2ed-b080-409a-9ac4-9927f5ffd659 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.187942 Jul 25 19:46:52.501486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1239/2311] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:52 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:53.120028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee74ccce-5b06-41f1-a83c-4c131f79bea1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:53.121186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee74ccce-5b06-41f1-a83c-4c131f79bea1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:53.132580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee74ccce-5b06-41f1-a83c-4c131f79bea1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:53.133250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee74ccce-5b06-41f1-a83c-4c131f79bea1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:53.134452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee74ccce-5b06-41f1-a83c-4c131f79bea1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:53.135156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee74ccce-5b06-41f1-a83c-4c131f79bea1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:53.242041 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee74ccce-5b06-41f1-a83c-4c131f79bea1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:53.251534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee74ccce-5b06-41f1-a83c-4c131f79bea1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.139115 Jul 25 19:46:53.252126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1073/2312] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:53.528470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e84e368d-ecd3-4c17-a104-ca5fea033fbc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:53.529342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e84e368d-ecd3-4c17-a104-ca5fea033fbc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:53.538552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e84e368d-ecd3-4c17-a104-ca5fea033fbc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:53.539049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e84e368d-ecd3-4c17-a104-ca5fea033fbc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:53.539920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e84e368d-ecd3-4c17-a104-ca5fea033fbc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:53.540357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e84e368d-ecd3-4c17-a104-ca5fea033fbc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:53.717656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e84e368d-ecd3-4c17-a104-ca5fea033fbc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:53.727061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e84e368d-ecd3-4c17-a104-ca5fea033fbc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:53.728564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e84e368d-ecd3-4c17-a104-ca5fea033fbc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:53.729743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e84e368d-ecd3-4c17-a104-ca5fea033fbc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.208083 Jul 25 19:46:53.730301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1240/2313] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:54.281302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-092a4d1c-2b94-462a-b61e-caccebfe7b98 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:54.282633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-092a4d1c-2b94-462a-b61e-caccebfe7b98 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:54.289730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-092a4d1c-2b94-462a-b61e-caccebfe7b98 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:54.290180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-092a4d1c-2b94-462a-b61e-caccebfe7b98 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:54.290982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-092a4d1c-2b94-462a-b61e-caccebfe7b98 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:54.291424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-092a4d1c-2b94-462a-b61e-caccebfe7b98 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:54.360171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-092a4d1c-2b94-462a-b61e-caccebfe7b98 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:54.368953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-092a4d1c-2b94-462a-b61e-caccebfe7b98 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.091454 Jul 25 19:46:54.369529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1074/2314] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:54.753699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3251b617-5792-4a9a-a721-499b7758bf48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:54.754322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3251b617-5792-4a9a-a721-499b7758bf48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:54.760986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3251b617-5792-4a9a-a721-499b7758bf48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:54.761436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3251b617-5792-4a9a-a721-499b7758bf48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:54.762211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3251b617-5792-4a9a-a721-499b7758bf48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:54.762656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3251b617-5792-4a9a-a721-499b7758bf48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:54.899528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3251b617-5792-4a9a-a721-499b7758bf48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:54.909088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3251b617-5792-4a9a-a721-499b7758bf48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:54.910587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3251b617-5792-4a9a-a721-499b7758bf48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:54.911769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3251b617-5792-4a9a-a721-499b7758bf48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.162035 Jul 25 19:46:54.912364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1241/2315] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:55.390103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ef4ebe14-43b7-480e-b9f1-bd213f355106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:55.390774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ef4ebe14-43b7-480e-b9f1-bd213f355106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:55.398176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef4ebe14-43b7-480e-b9f1-bd213f355106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:55.398626 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef4ebe14-43b7-480e-b9f1-bd213f355106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:55.399399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef4ebe14-43b7-480e-b9f1-bd213f355106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:55.399870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef4ebe14-43b7-480e-b9f1-bd213f355106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:55.463186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ef4ebe14-43b7-480e-b9f1-bd213f355106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:55.466671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:46:55.472271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ef4ebe14-43b7-480e-b9f1-bd213f355106 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086046 Jul 25 19:46:55.472856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1075/2316] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:55.935755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d0a93289-0efb-4f93-a110-1d35d5472176 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:55.936391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d0a93289-0efb-4f93-a110-1d35d5472176 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:55.943798 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0a93289-0efb-4f93-a110-1d35d5472176 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:55.944243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0a93289-0efb-4f93-a110-1d35d5472176 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:55.945007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0a93289-0efb-4f93-a110-1d35d5472176 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:55.945443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d0a93289-0efb-4f93-a110-1d35d5472176 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:56.083295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d0a93289-0efb-4f93-a110-1d35d5472176 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:56.092468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d0a93289-0efb-4f93-a110-1d35d5472176 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:56.094074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d0a93289-0efb-4f93-a110-1d35d5472176 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:56.095742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d0a93289-0efb-4f93-a110-1d35d5472176 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.163898 Jul 25 19:46:56.096366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1242/2317] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:56.493964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4a97999a-ee5b-4a29-9fc7-aec8e3bd070c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:56.494587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4a97999a-ee5b-4a29-9fc7-aec8e3bd070c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:56.502706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a97999a-ee5b-4a29-9fc7-aec8e3bd070c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:56.503207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a97999a-ee5b-4a29-9fc7-aec8e3bd070c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:56.504126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a97999a-ee5b-4a29-9fc7-aec8e3bd070c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:56.504615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a97999a-ee5b-4a29-9fc7-aec8e3bd070c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:56.572980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4a97999a-ee5b-4a29-9fc7-aec8e3bd070c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:56.583181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4a97999a-ee5b-4a29-9fc7-aec8e3bd070c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092645 Jul 25 19:46:56.583937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1076/2318] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:57.121156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4f7bda05-897d-4b9c-9af7-7794931d628c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:57.121890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4f7bda05-897d-4b9c-9af7-7794931d628c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:57.128936 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f7bda05-897d-4b9c-9af7-7794931d628c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:57.129376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f7bda05-897d-4b9c-9af7-7794931d628c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:57.130158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f7bda05-897d-4b9c-9af7-7794931d628c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:57.130592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4f7bda05-897d-4b9c-9af7-7794931d628c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:57.277572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f7bda05-897d-4b9c-9af7-7794931d628c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:57.288100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f7bda05-897d-4b9c-9af7-7794931d628c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:57.289800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4f7bda05-897d-4b9c-9af7-7794931d628c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:57.291293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4f7bda05-897d-4b9c-9af7-7794931d628c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.174734 Jul 25 19:46:57.292033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1243/2319] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:57.613620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7225f24b-7c00-4959-957e-f6440d46d1ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:57.614367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7225f24b-7c00-4959-957e-f6440d46d1ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:57.621009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7225f24b-7c00-4959-957e-f6440d46d1ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:57.621538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7225f24b-7c00-4959-957e-f6440d46d1ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:57.622242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7225f24b-7c00-4959-957e-f6440d46d1ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:57.622670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7225f24b-7c00-4959-957e-f6440d46d1ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:57.692331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7225f24b-7c00-4959-957e-f6440d46d1ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:57.700869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7225f24b-7c00-4959-957e-f6440d46d1ab tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092491 Jul 25 19:46:57.701658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1077/2320] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:58.316578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cb006270-7c23-4de2-95f6-6ff2334abc3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:58.317274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cb006270-7c23-4de2-95f6-6ff2334abc3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:58.324186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb006270-7c23-4de2-95f6-6ff2334abc3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:58.324690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb006270-7c23-4de2-95f6-6ff2334abc3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:58.325613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb006270-7c23-4de2-95f6-6ff2334abc3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:58.326165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb006270-7c23-4de2-95f6-6ff2334abc3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:58.498693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cb006270-7c23-4de2-95f6-6ff2334abc3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:58.508298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cb006270-7c23-4de2-95f6-6ff2334abc3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:58.509795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cb006270-7c23-4de2-95f6-6ff2334abc3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:58.510965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cb006270-7c23-4de2-95f6-6ff2334abc3a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.199090 Jul 25 19:46:58.511617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1244/2321] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:58.722833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0e143cca-733d-4236-bdc9-73c6b5eb945e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:58.723415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0e143cca-733d-4236-bdc9-73c6b5eb945e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:58.730981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e143cca-733d-4236-bdc9-73c6b5eb945e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:58.731507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e143cca-733d-4236-bdc9-73c6b5eb945e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:58.732315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e143cca-733d-4236-bdc9-73c6b5eb945e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:58.732786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e143cca-733d-4236-bdc9-73c6b5eb945e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:58.803818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0e143cca-733d-4236-bdc9-73c6b5eb945e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:58.812196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0e143cca-733d-4236-bdc9-73c6b5eb945e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.093406 Jul 25 19:46:58.812763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1078/2322] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:46:59.535678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c069303d-c492-49ab-945b-4e53dcd0e223 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:59.536236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c069303d-c492-49ab-945b-4e53dcd0e223 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:59.542843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c069303d-c492-49ab-945b-4e53dcd0e223 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:59.543304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c069303d-c492-49ab-945b-4e53dcd0e223 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:59.544100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c069303d-c492-49ab-945b-4e53dcd0e223 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:59.544538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c069303d-c492-49ab-945b-4e53dcd0e223 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:59.684814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c069303d-c492-49ab-945b-4e53dcd0e223 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:59.694796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c069303d-c492-49ab-945b-4e53dcd0e223 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:59.696514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c069303d-c492-49ab-945b-4e53dcd0e223 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:59.697701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c069303d-c492-49ab-945b-4e53dcd0e223 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.166494 Jul 25 19:46:59.698446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1245/2323] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:46:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:46:59.834693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-59d5e84d-d27e-46c0-a968-a2ea5642ba31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:46:59.835301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-59d5e84d-d27e-46c0-a968-a2ea5642ba31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:46:59.842059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59d5e84d-d27e-46c0-a968-a2ea5642ba31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:59.842510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59d5e84d-d27e-46c0-a968-a2ea5642ba31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:59.843277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59d5e84d-d27e-46c0-a968-a2ea5642ba31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:46:59.843767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59d5e84d-d27e-46c0-a968-a2ea5642ba31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:46:59.910751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-59d5e84d-d27e-46c0-a968-a2ea5642ba31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:46:59.918801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-59d5e84d-d27e-46c0-a968-a2ea5642ba31 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088058 Jul 25 19:46:59.919371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1079/2324] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:46:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:00.722953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5ed23d29-e6d6-4a67-b320-8e08f3bb0532 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:00.723573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5ed23d29-e6d6-4a67-b320-8e08f3bb0532 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:00.730439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ed23d29-e6d6-4a67-b320-8e08f3bb0532 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:00.730890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ed23d29-e6d6-4a67-b320-8e08f3bb0532 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:00.731703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ed23d29-e6d6-4a67-b320-8e08f3bb0532 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:00.732147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5ed23d29-e6d6-4a67-b320-8e08f3bb0532 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:00.873351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5ed23d29-e6d6-4a67-b320-8e08f3bb0532 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:00.883403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5ed23d29-e6d6-4a67-b320-8e08f3bb0532 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:00.885064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5ed23d29-e6d6-4a67-b320-8e08f3bb0532 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:00.886220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5ed23d29-e6d6-4a67-b320-8e08f3bb0532 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.168349 Jul 25 19:47:00.886783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1246/2325] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:00.942701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-237c6bef-104f-4b0a-84fd-8adb80dc989e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:00.943312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-237c6bef-104f-4b0a-84fd-8adb80dc989e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:00.951016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-237c6bef-104f-4b0a-84fd-8adb80dc989e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:00.951547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-237c6bef-104f-4b0a-84fd-8adb80dc989e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:00.952267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-237c6bef-104f-4b0a-84fd-8adb80dc989e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:00.952709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-237c6bef-104f-4b0a-84fd-8adb80dc989e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:01.022374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-237c6bef-104f-4b0a-84fd-8adb80dc989e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:01.030659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-237c6bef-104f-4b0a-84fd-8adb80dc989e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.091970 Jul 25 19:47:01.031282 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1080/2326] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:01.911390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e383cf8e-5aa7-4cc7-b89e-e7d01a91a3c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:01.912034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e383cf8e-5aa7-4cc7-b89e-e7d01a91a3c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:01.918845 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e383cf8e-5aa7-4cc7-b89e-e7d01a91a3c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:01.919301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e383cf8e-5aa7-4cc7-b89e-e7d01a91a3c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:01.920111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e383cf8e-5aa7-4cc7-b89e-e7d01a91a3c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:01.920552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e383cf8e-5aa7-4cc7-b89e-e7d01a91a3c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:01.941126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:47:02.054799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-27e0cb1b-9934-4039-83c4-c29ad46c6485 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:02.055832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-27e0cb1b-9934-4039-83c4-c29ad46c6485 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:02.062561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e383cf8e-5aa7-4cc7-b89e-e7d01a91a3c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:02.062840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27e0cb1b-9934-4039-83c4-c29ad46c6485 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:02.064074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27e0cb1b-9934-4039-83c4-c29ad46c6485 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:02.065069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27e0cb1b-9934-4039-83c4-c29ad46c6485 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:02.065763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27e0cb1b-9934-4039-83c4-c29ad46c6485 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:02.073853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e383cf8e-5aa7-4cc7-b89e-e7d01a91a3c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:02.075671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e383cf8e-5aa7-4cc7-b89e-e7d01a91a3c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:02.076981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e383cf8e-5aa7-4cc7-b89e-e7d01a91a3c7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.170553 Jul 25 19:47:02.077553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1247/2327] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:01 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:02.143941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-27e0cb1b-9934-4039-83c4-c29ad46c6485 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:02.152060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-27e0cb1b-9934-4039-83c4-c29ad46c6485 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.101861 Jul 25 19:47:02.152547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1081/2328] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:47:03.101999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-085e49b7-aa2f-4ff4-ba36-59cc5830e18a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:03.102736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-085e49b7-aa2f-4ff4-ba36-59cc5830e18a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:03.109527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-085e49b7-aa2f-4ff4-ba36-59cc5830e18a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:03.110549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-085e49b7-aa2f-4ff4-ba36-59cc5830e18a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:03.111707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-085e49b7-aa2f-4ff4-ba36-59cc5830e18a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:03.112148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-085e49b7-aa2f-4ff4-ba36-59cc5830e18a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:03.173861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-602ea432-c4e1-4d76-a01f-3d2581e543f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:03.174472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-602ea432-c4e1-4d76-a01f-3d2581e543f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:03.180860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602ea432-c4e1-4d76-a01f-3d2581e543f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:03.181318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602ea432-c4e1-4d76-a01f-3d2581e543f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:03.182099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602ea432-c4e1-4d76-a01f-3d2581e543f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:03.182536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-602ea432-c4e1-4d76-a01f-3d2581e543f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:03.267413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-602ea432-c4e1-4d76-a01f-3d2581e543f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:03.278000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-602ea432-c4e1-4d76-a01f-3d2581e543f7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.108509 Jul 25 19:47:03.279283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1082/2329] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:03 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:47:03.299475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-085e49b7-aa2f-4ff4-ba36-59cc5830e18a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:03.310797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-085e49b7-aa2f-4ff4-ba36-59cc5830e18a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:03.313654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-085e49b7-aa2f-4ff4-ba36-59cc5830e18a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:03.315372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-085e49b7-aa2f-4ff4-ba36-59cc5830e18a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.217215 Jul 25 19:47:03.316017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1248/2330] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:04.300848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-181b1529-cdef-467f-9d05-fe551a9df53f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:04.301575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-181b1529-cdef-467f-9d05-fe551a9df53f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:04.308197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-181b1529-cdef-467f-9d05-fe551a9df53f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:04.308686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-181b1529-cdef-467f-9d05-fe551a9df53f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:04.309458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-181b1529-cdef-467f-9d05-fe551a9df53f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:04.309894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-181b1529-cdef-467f-9d05-fe551a9df53f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:04.339636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-823026fb-e8ee-4b8b-b8a2-d7cfc5bdd726 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:04.340342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-823026fb-e8ee-4b8b-b8a2-d7cfc5bdd726 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:04.347306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-823026fb-e8ee-4b8b-b8a2-d7cfc5bdd726 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:04.347765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-823026fb-e8ee-4b8b-b8a2-d7cfc5bdd726 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:04.348528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-823026fb-e8ee-4b8b-b8a2-d7cfc5bdd726 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:04.348962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-823026fb-e8ee-4b8b-b8a2-d7cfc5bdd726 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:04.378411 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-181b1529-cdef-467f-9d05-fe551a9df53f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:04.387481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-181b1529-cdef-467f-9d05-fe551a9df53f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090377 Jul 25 19:47:04.388304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1083/2331] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:04.492958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-823026fb-e8ee-4b8b-b8a2-d7cfc5bdd726 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:04.502187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-823026fb-e8ee-4b8b-b8a2-d7cfc5bdd726 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:04.503704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-823026fb-e8ee-4b8b-b8a2-d7cfc5bdd726 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:04.504892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-823026fb-e8ee-4b8b-b8a2-d7cfc5bdd726 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.169153 Jul 25 19:47:04.505538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1249/2332] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:47:05.167990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:47:05.168257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:47:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:47:05.413154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f7d81e2e-e8bb-488a-9068-185b8bdc240f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:05.413771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f7d81e2e-e8bb-488a-9068-185b8bdc240f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:05.420736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7d81e2e-e8bb-488a-9068-185b8bdc240f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:05.421183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7d81e2e-e8bb-488a-9068-185b8bdc240f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:05.422914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7d81e2e-e8bb-488a-9068-185b8bdc240f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:05.422914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7d81e2e-e8bb-488a-9068-185b8bdc240f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:05.494772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f7d81e2e-e8bb-488a-9068-185b8bdc240f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:05.505062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f7d81e2e-e8bb-488a-9068-185b8bdc240f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.098185 Jul 25 19:47:05.505700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1084/2333] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:05.528274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d745b205-dacc-4dd7-9b86-3d786f553d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:05.528891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d745b205-dacc-4dd7-9b86-3d786f553d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:05.536150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d745b205-dacc-4dd7-9b86-3d786f553d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:05.536602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d745b205-dacc-4dd7-9b86-3d786f553d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:05.537378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d745b205-dacc-4dd7-9b86-3d786f553d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:05.537961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d745b205-dacc-4dd7-9b86-3d786f553d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:05.693947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d745b205-dacc-4dd7-9b86-3d786f553d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:05.704704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d745b205-dacc-4dd7-9b86-3d786f553d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:05.706219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d745b205-dacc-4dd7-9b86-3d786f553d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:05.707402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d745b205-dacc-4dd7-9b86-3d786f553d95 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.183031 Jul 25 19:47:05.707991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1250/2334] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:06.525229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-235a6be8-0a6d-41b6-a328-3483bad7c45e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:06.525845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-235a6be8-0a6d-41b6-a328-3483bad7c45e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:06.532780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-235a6be8-0a6d-41b6-a328-3483bad7c45e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:06.533229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-235a6be8-0a6d-41b6-a328-3483bad7c45e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:06.534005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-235a6be8-0a6d-41b6-a328-3483bad7c45e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:06.534445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-235a6be8-0a6d-41b6-a328-3483bad7c45e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:06.601703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-235a6be8-0a6d-41b6-a328-3483bad7c45e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:06.609735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-235a6be8-0a6d-41b6-a328-3483bad7c45e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088395 Jul 25 19:47:06.610330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1085/2335] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:06.731189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5def28d0-fa49-4a85-93ff-569669728648 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:06.731867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5def28d0-fa49-4a85-93ff-569669728648 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:06.739583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5def28d0-fa49-4a85-93ff-569669728648 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:06.740049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5def28d0-fa49-4a85-93ff-569669728648 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:06.740846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5def28d0-fa49-4a85-93ff-569669728648 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:06.741281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5def28d0-fa49-4a85-93ff-569669728648 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:06.881673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5def28d0-fa49-4a85-93ff-569669728648 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:06.890186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5def28d0-fa49-4a85-93ff-569669728648 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:06.892338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5def28d0-fa49-4a85-93ff-569669728648 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:06.893508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5def28d0-fa49-4a85-93ff-569669728648 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.166312 Jul 25 19:47:06.894065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1251/2336] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:07.634227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6cdddec1-78ba-40e4-b8c8-66b875fe99b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:07.635042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6cdddec1-78ba-40e4-b8c8-66b875fe99b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:07.642366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cdddec1-78ba-40e4-b8c8-66b875fe99b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:07.642739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cdddec1-78ba-40e4-b8c8-66b875fe99b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:07.643541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cdddec1-78ba-40e4-b8c8-66b875fe99b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:07.643989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cdddec1-78ba-40e4-b8c8-66b875fe99b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:07.715086 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6cdddec1-78ba-40e4-b8c8-66b875fe99b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:07.724396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6cdddec1-78ba-40e4-b8c8-66b875fe99b5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094982 Jul 25 19:47:07.724984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1086/2337] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:07.919656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b97aab2f-1910-49f7-a813-ae525d455ab3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:07.920399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b97aab2f-1910-49f7-a813-ae525d455ab3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:07.927918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b97aab2f-1910-49f7-a813-ae525d455ab3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:07.928414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b97aab2f-1910-49f7-a813-ae525d455ab3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:07.929219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b97aab2f-1910-49f7-a813-ae525d455ab3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:07.929688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b97aab2f-1910-49f7-a813-ae525d455ab3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:08.093598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b97aab2f-1910-49f7-a813-ae525d455ab3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:08.103194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b97aab2f-1910-49f7-a813-ae525d455ab3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:08.104765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b97aab2f-1910-49f7-a813-ae525d455ab3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:08.105970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b97aab2f-1910-49f7-a813-ae525d455ab3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.191136 Jul 25 19:47:08.106527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1252/2338] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:08.746223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05146c77-8962-40f2-84b1-c853e79ebfa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:08.746915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05146c77-8962-40f2-84b1-c853e79ebfa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:08.758101 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05146c77-8962-40f2-84b1-c853e79ebfa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:08.758933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05146c77-8962-40f2-84b1-c853e79ebfa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:08.760422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05146c77-8962-40f2-84b1-c853e79ebfa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:08.761238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05146c77-8962-40f2-84b1-c853e79ebfa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:08.834534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05146c77-8962-40f2-84b1-c853e79ebfa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:08.843280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05146c77-8962-40f2-84b1-c853e79ebfa3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.100950 Jul 25 19:47:08.844374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1087/2339] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:09.131337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-95493ff4-a198-4e09-ac5e-3aa20082d1dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:09.132413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-95493ff4-a198-4e09-ac5e-3aa20082d1dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:09.134591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=50 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:47:09.141357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-95493ff4-a198-4e09-ac5e-3aa20082d1dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:09.142366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-95493ff4-a198-4e09-ac5e-3aa20082d1dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:09.142551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-95493ff4-a198-4e09-ac5e-3aa20082d1dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:09.142984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-95493ff4-a198-4e09-ac5e-3aa20082d1dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:09.302109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-95493ff4-a198-4e09-ac5e-3aa20082d1dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:09.311275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-95493ff4-a198-4e09-ac5e-3aa20082d1dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:09.312876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-95493ff4-a198-4e09-ac5e-3aa20082d1dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:09.314378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-95493ff4-a198-4e09-ac5e-3aa20082d1dd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.187001 Jul 25 19:47:09.315283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1253/2340] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:09.867727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee1539e7-ff38-4292-b841-b6288b08a28c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:09.868389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee1539e7-ff38-4292-b841-b6288b08a28c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:09.870792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=54 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:47:09.877522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee1539e7-ff38-4292-b841-b6288b08a28c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:09.878070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee1539e7-ff38-4292-b841-b6288b08a28c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:09.878927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee1539e7-ff38-4292-b841-b6288b08a28c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:09.879412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee1539e7-ff38-4292-b841-b6288b08a28c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:09.954410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee1539e7-ff38-4292-b841-b6288b08a28c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:09.963943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee1539e7-ff38-4292-b841-b6288b08a28c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.101178 Jul 25 19:47:09.964531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1088/2341] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:10.510880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-39d86096-4f86-4f83-8200-dea3cb411a8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:10.511499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-39d86096-4f86-4f83-8200-dea3cb411a8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:10.518307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-39d86096-4f86-4f83-8200-dea3cb411a8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:10.518770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-39d86096-4f86-4f83-8200-dea3cb411a8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:10.519600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-39d86096-4f86-4f83-8200-dea3cb411a8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:10.520072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-39d86096-4f86-4f83-8200-dea3cb411a8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:10.691163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-39d86096-4f86-4f83-8200-dea3cb411a8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:10.700306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-39d86096-4f86-4f83-8200-dea3cb411a8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:10.701742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-39d86096-4f86-4f83-8200-dea3cb411a8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:10.702926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-39d86096-4f86-4f83-8200-dea3cb411a8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.362659 Jul 25 19:47:10.703798 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1254/2342] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:10.987940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f360cb2-be35-4472-8c35-91689d6eb4ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:10.988569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9f360cb2-be35-4472-8c35-91689d6eb4ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:10.998002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f360cb2-be35-4472-8c35-91689d6eb4ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:10.998489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f360cb2-be35-4472-8c35-91689d6eb4ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:10.999382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f360cb2-be35-4472-8c35-91689d6eb4ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:10.999857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f360cb2-be35-4472-8c35-91689d6eb4ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:11.070581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9f360cb2-be35-4472-8c35-91689d6eb4ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:11.081247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9f360cb2-be35-4472-8c35-91689d6eb4ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.098546 Jul 25 19:47:11.082020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1089/2343] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:11.728037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-728f490e-3d84-4e04-bc13-7011d5c004a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:11.728932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-728f490e-3d84-4e04-bc13-7011d5c004a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:11.737538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-728f490e-3d84-4e04-bc13-7011d5c004a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:11.737989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-728f490e-3d84-4e04-bc13-7011d5c004a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:11.738757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-728f490e-3d84-4e04-bc13-7011d5c004a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:11.739189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-728f490e-3d84-4e04-bc13-7011d5c004a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:11.881401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-728f490e-3d84-4e04-bc13-7011d5c004a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:11.890602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-728f490e-3d84-4e04-bc13-7011d5c004a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:11.892484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-728f490e-3d84-4e04-bc13-7011d5c004a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:11.893616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-728f490e-3d84-4e04-bc13-7011d5c004a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.170982 Jul 25 19:47:11.894533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1255/2344] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:47:12.105792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2d244c7b-60e0-4c4b-8917-3560a3465539 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:12.106831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2d244c7b-60e0-4c4b-8917-3560a3465539 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:12.121602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d244c7b-60e0-4c4b-8917-3560a3465539 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:12.121602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d244c7b-60e0-4c4b-8917-3560a3465539 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:12.121602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d244c7b-60e0-4c4b-8917-3560a3465539 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:12.122004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d244c7b-60e0-4c4b-8917-3560a3465539 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:12.191069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2d244c7b-60e0-4c4b-8917-3560a3465539 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:12.199246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2d244c7b-60e0-4c4b-8917-3560a3465539 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.098328 Jul 25 19:47:12.199916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1090/2345] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:12 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:12.921276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7cba9ecb-c5c3-4ed9-b643-ad878237163f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:12.922636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7cba9ecb-c5c3-4ed9-b643-ad878237163f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:12.932378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7cba9ecb-c5c3-4ed9-b643-ad878237163f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:12.933198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7cba9ecb-c5c3-4ed9-b643-ad878237163f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:12.934466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7cba9ecb-c5c3-4ed9-b643-ad878237163f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:12.935089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7cba9ecb-c5c3-4ed9-b643-ad878237163f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:13.089083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7cba9ecb-c5c3-4ed9-b643-ad878237163f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:13.098836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7cba9ecb-c5c3-4ed9-b643-ad878237163f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:13.100402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7cba9ecb-c5c3-4ed9-b643-ad878237163f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:13.101580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7cba9ecb-c5c3-4ed9-b643-ad878237163f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.186677 Jul 25 19:47:13.102150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1256/2346] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:13.221010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a23a4bb0-2d79-4025-a2ea-3a528c29fbd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:13.221575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a23a4bb0-2d79-4025-a2ea-3a528c29fbd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:13.228578 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23a4bb0-2d79-4025-a2ea-3a528c29fbd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:13.229032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23a4bb0-2d79-4025-a2ea-3a528c29fbd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:13.229811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23a4bb0-2d79-4025-a2ea-3a528c29fbd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:13.230267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23a4bb0-2d79-4025-a2ea-3a528c29fbd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:13.315649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a23a4bb0-2d79-4025-a2ea-3a528c29fbd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:13.323770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a23a4bb0-2d79-4025-a2ea-3a528c29fbd9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.107212 Jul 25 19:47:13.324352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1091/2347] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:13 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:47:14.126748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e5a6f4f6-941f-433f-9c70-82e6fbe3d3e3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:14.127873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e5a6f4f6-941f-433f-9c70-82e6fbe3d3e3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:14.135011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5a6f4f6-941f-433f-9c70-82e6fbe3d3e3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:14.135452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5a6f4f6-941f-433f-9c70-82e6fbe3d3e3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:14.136255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5a6f4f6-941f-433f-9c70-82e6fbe3d3e3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:14.136689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e5a6f4f6-941f-433f-9c70-82e6fbe3d3e3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:14.307068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e5a6f4f6-941f-433f-9c70-82e6fbe3d3e3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:14.322132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e5a6f4f6-941f-433f-9c70-82e6fbe3d3e3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:14.324915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e5a6f4f6-941f-433f-9c70-82e6fbe3d3e3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:14.326593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e5a6f4f6-941f-433f-9c70-82e6fbe3d3e3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.204522 Jul 25 19:47:14.327392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1257/2348] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:14.345543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2e92d38f-eab2-49cd-9830-d2db9d10804b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:14.346151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2e92d38f-eab2-49cd-9830-d2db9d10804b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:14.352694 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e92d38f-eab2-49cd-9830-d2db9d10804b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:14.353143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e92d38f-eab2-49cd-9830-d2db9d10804b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:14.353901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e92d38f-eab2-49cd-9830-d2db9d10804b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:14.354336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e92d38f-eab2-49cd-9830-d2db9d10804b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:14.374818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:47:14.421049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2e92d38f-eab2-49cd-9830-d2db9d10804b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:14.429783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2e92d38f-eab2-49cd-9830-d2db9d10804b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089032 Jul 25 19:47:14.430345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1092/2349] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:14 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:15.351210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b9dbd98f-004b-42c4-845b-f8f5c1da04e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:15.351849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b9dbd98f-004b-42c4-845b-f8f5c1da04e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:15.358316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9dbd98f-004b-42c4-845b-f8f5c1da04e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:15.358759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9dbd98f-004b-42c4-845b-f8f5c1da04e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:15.359566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9dbd98f-004b-42c4-845b-f8f5c1da04e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:15.360006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9dbd98f-004b-42c4-845b-f8f5c1da04e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:15.451499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8251f44d-0a60-48c8-ac74-81e9aa3a7ae9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:15.452365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8251f44d-0a60-48c8-ac74-81e9aa3a7ae9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:15.460649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8251f44d-0a60-48c8-ac74-81e9aa3a7ae9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:15.461186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8251f44d-0a60-48c8-ac74-81e9aa3a7ae9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:15.462024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8251f44d-0a60-48c8-ac74-81e9aa3a7ae9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:15.462533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8251f44d-0a60-48c8-ac74-81e9aa3a7ae9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:15.502571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b9dbd98f-004b-42c4-845b-f8f5c1da04e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:15.511657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b9dbd98f-004b-42c4-845b-f8f5c1da04e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:15.513179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b9dbd98f-004b-42c4-845b-f8f5c1da04e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:15.514335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b9dbd98f-004b-42c4-845b-f8f5c1da04e7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.167116 Jul 25 19:47:15.514897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1258/2350] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:15.530104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8251f44d-0a60-48c8-ac74-81e9aa3a7ae9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:15.538401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8251f44d-0a60-48c8-ac74-81e9aa3a7ae9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090751 Jul 25 19:47:15.538972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1093/2351] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:15 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:47:16.538688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c849ee2b-db45-4c12-b427-9ce21b11fba3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:16.539248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c849ee2b-db45-4c12-b427-9ce21b11fba3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:16.545478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c849ee2b-db45-4c12-b427-9ce21b11fba3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:16.545920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c849ee2b-db45-4c12-b427-9ce21b11fba3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:16.546677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c849ee2b-db45-4c12-b427-9ce21b11fba3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:16.547104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c849ee2b-db45-4c12-b427-9ce21b11fba3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:16.558173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2db5afda-1caf-405c-917a-8e929a6fe4a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:16.558782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2db5afda-1caf-405c-917a-8e929a6fe4a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:16.565492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2db5afda-1caf-405c-917a-8e929a6fe4a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:16.565942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2db5afda-1caf-405c-917a-8e929a6fe4a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:16.566712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2db5afda-1caf-405c-917a-8e929a6fe4a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:16.567147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2db5afda-1caf-405c-917a-8e929a6fe4a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:16.645453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2db5afda-1caf-405c-917a-8e929a6fe4a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:16.653609 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2db5afda-1caf-405c-917a-8e929a6fe4a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099266 Jul 25 19:47:16.654184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1094/2352] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:16 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:16.705802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c849ee2b-db45-4c12-b427-9ce21b11fba3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:16.714585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c849ee2b-db45-4c12-b427-9ce21b11fba3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:16.716123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c849ee2b-db45-4c12-b427-9ce21b11fba3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:16.717271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c849ee2b-db45-4c12-b427-9ce21b11fba3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.182608 Jul 25 19:47:16.717823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1259/2353] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:17.674650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad46e175-dd39-4376-ba4b-51b9b5ada6ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:17.675334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad46e175-dd39-4376-ba4b-51b9b5ada6ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:17.682489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad46e175-dd39-4376-ba4b-51b9b5ada6ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:17.682931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad46e175-dd39-4376-ba4b-51b9b5ada6ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:17.683716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad46e175-dd39-4376-ba4b-51b9b5ada6ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:17.684218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad46e175-dd39-4376-ba4b-51b9b5ada6ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:17.742846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9e8d0802-1a44-42d2-b2f6-f8484bb93085 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:17.743569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9e8d0802-1a44-42d2-b2f6-f8484bb93085 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:17.748563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad46e175-dd39-4376-ba4b-51b9b5ada6ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:17.750068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e8d0802-1a44-42d2-b2f6-f8484bb93085 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:17.750510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e8d0802-1a44-42d2-b2f6-f8484bb93085 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:17.752170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e8d0802-1a44-42d2-b2f6-f8484bb93085 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:17.752302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e8d0802-1a44-42d2-b2f6-f8484bb93085 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:17.757771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad46e175-dd39-4376-ba4b-51b9b5ada6ef tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087132 Jul 25 19:47:17.758340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1095/2354] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:17 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:17.882651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9e8d0802-1a44-42d2-b2f6-f8484bb93085 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:17.890937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9e8d0802-1a44-42d2-b2f6-f8484bb93085 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:17.893166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9e8d0802-1a44-42d2-b2f6-f8484bb93085 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:17.894311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9e8d0802-1a44-42d2-b2f6-f8484bb93085 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.155373 Jul 25 19:47:17.894863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1260/2355] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:47:18.779403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e33e5ce6-d272-4fe4-8d99-c8654b3310a0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:18.780032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e33e5ce6-d272-4fe4-8d99-c8654b3310a0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:18.787293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e33e5ce6-d272-4fe4-8d99-c8654b3310a0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:18.787764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e33e5ce6-d272-4fe4-8d99-c8654b3310a0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:18.788522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e33e5ce6-d272-4fe4-8d99-c8654b3310a0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:18.789060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e33e5ce6-d272-4fe4-8d99-c8654b3310a0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:18.851500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e33e5ce6-d272-4fe4-8d99-c8654b3310a0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:18.859591 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e33e5ce6-d272-4fe4-8d99-c8654b3310a0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.083815 Jul 25 19:47:18.860184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1096/2356] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:18 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:18.917115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3359c017-e76b-439a-a13b-84253812db48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:18.917787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3359c017-e76b-439a-a13b-84253812db48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:18.924621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3359c017-e76b-439a-a13b-84253812db48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:18.925061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3359c017-e76b-439a-a13b-84253812db48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:18.925827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3359c017-e76b-439a-a13b-84253812db48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:18.926249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3359c017-e76b-439a-a13b-84253812db48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:19.057900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3359c017-e76b-439a-a13b-84253812db48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:19.067040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3359c017-e76b-439a-a13b-84253812db48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:19.068579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3359c017-e76b-439a-a13b-84253812db48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:19.069779 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3359c017-e76b-439a-a13b-84253812db48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.156607 Jul 25 19:47:19.070350 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1261/2357] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:19.880782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6d631552-6c56-42f9-94f7-5745229bfaec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:19.881386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d631552-6c56-42f9-94f7-5745229bfaec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:19.888459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d631552-6c56-42f9-94f7-5745229bfaec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:19.888904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d631552-6c56-42f9-94f7-5745229bfaec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:19.889661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d631552-6c56-42f9-94f7-5745229bfaec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:19.890092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d631552-6c56-42f9-94f7-5745229bfaec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:19.954298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6d631552-6c56-42f9-94f7-5745229bfaec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:19.962158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6d631552-6c56-42f9-94f7-5745229bfaec tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085237 Jul 25 19:47:19.962717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1097/2358] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:19 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:47:20.093786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-834aec83-9b71-4ee5-9005-7a76b224e15e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:20.094384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-834aec83-9b71-4ee5-9005-7a76b224e15e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:20.102385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-834aec83-9b71-4ee5-9005-7a76b224e15e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:20.102812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-834aec83-9b71-4ee5-9005-7a76b224e15e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:20.103605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-834aec83-9b71-4ee5-9005-7a76b224e15e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:20.104041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-834aec83-9b71-4ee5-9005-7a76b224e15e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:20.240235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-834aec83-9b71-4ee5-9005-7a76b224e15e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:20.248552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-834aec83-9b71-4ee5-9005-7a76b224e15e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:20.250051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-834aec83-9b71-4ee5-9005-7a76b224e15e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:20.251490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-834aec83-9b71-4ee5-9005-7a76b224e15e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.161306 Jul 25 19:47:20.252012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1262/2359] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:20.983138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-163242aa-047a-47df-848a-ebc4a19414c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:20.983810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-163242aa-047a-47df-848a-ebc4a19414c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:20.991738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-163242aa-047a-47df-848a-ebc4a19414c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:20.992173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-163242aa-047a-47df-848a-ebc4a19414c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:20.992953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-163242aa-047a-47df-848a-ebc4a19414c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:20.993391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-163242aa-047a-47df-848a-ebc4a19414c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:21.056641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-163242aa-047a-47df-848a-ebc4a19414c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:21.065339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-163242aa-047a-47df-848a-ebc4a19414c9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086031 Jul 25 19:47:21.065901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1098/2360] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:20 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:21.274379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5beae97f-7a0a-4af0-8724-c5da887d0582 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:21.274915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5beae97f-7a0a-4af0-8724-c5da887d0582 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:21.281384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5beae97f-7a0a-4af0-8724-c5da887d0582 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:21.281834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5beae97f-7a0a-4af0-8724-c5da887d0582 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:21.282955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5beae97f-7a0a-4af0-8724-c5da887d0582 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:21.283398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5beae97f-7a0a-4af0-8724-c5da887d0582 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:21.413830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5beae97f-7a0a-4af0-8724-c5da887d0582 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:21.422246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5beae97f-7a0a-4af0-8724-c5da887d0582 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:21.424539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5beae97f-7a0a-4af0-8724-c5da887d0582 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:21.425695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5beae97f-7a0a-4af0-8724-c5da887d0582 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.155284 Jul 25 19:47:21.426253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1263/2361] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:22.085905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9e2669bc-e723-4f74-9e6d-0bc7a9087494 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:22.086522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9e2669bc-e723-4f74-9e6d-0bc7a9087494 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:22.092994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e2669bc-e723-4f74-9e6d-0bc7a9087494 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:22.093434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e2669bc-e723-4f74-9e6d-0bc7a9087494 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:22.094191 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e2669bc-e723-4f74-9e6d-0bc7a9087494 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:22.095152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e2669bc-e723-4f74-9e6d-0bc7a9087494 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:22.160252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e2669bc-e723-4f74-9e6d-0bc7a9087494 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:22.168777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9e2669bc-e723-4f74-9e6d-0bc7a9087494 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086691 Jul 25 19:47:22.169564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1099/2362] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:22 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:22.449084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cd51faf3-dec8-4644-9b9d-09f131ef3172 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:22.449633 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cd51faf3-dec8-4644-9b9d-09f131ef3172 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:22.456750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd51faf3-dec8-4644-9b9d-09f131ef3172 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:22.457191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd51faf3-dec8-4644-9b9d-09f131ef3172 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:22.457947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd51faf3-dec8-4644-9b9d-09f131ef3172 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:22.458374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd51faf3-dec8-4644-9b9d-09f131ef3172 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:22.462409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:47:22.595403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cd51faf3-dec8-4644-9b9d-09f131ef3172 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:22.604425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cd51faf3-dec8-4644-9b9d-09f131ef3172 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:22.606070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cd51faf3-dec8-4644-9b9d-09f131ef3172 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:22.607230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cd51faf3-dec8-4644-9b9d-09f131ef3172 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.162241 Jul 25 19:47:22.607877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1264/2363] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:23.190387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bf727456-44dd-4afc-b060-b40736b46b1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:23.191042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bf727456-44dd-4afc-b060-b40736b46b1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:23.198700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf727456-44dd-4afc-b060-b40736b46b1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:23.199147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf727456-44dd-4afc-b060-b40736b46b1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:23.199961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf727456-44dd-4afc-b060-b40736b46b1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:23.200403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf727456-44dd-4afc-b060-b40736b46b1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:23.270674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bf727456-44dd-4afc-b060-b40736b46b1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:23.278791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bf727456-44dd-4afc-b060-b40736b46b1a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092794 Jul 25 19:47:23.279360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1100/2364] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:23 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:23.630610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f21e3c44-1f9e-44a9-9334-3b26957a9207 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:23.631340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f21e3c44-1f9e-44a9-9334-3b26957a9207 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:23.637983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f21e3c44-1f9e-44a9-9334-3b26957a9207 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:23.638429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f21e3c44-1f9e-44a9-9334-3b26957a9207 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:23.639219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f21e3c44-1f9e-44a9-9334-3b26957a9207 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:23.639679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f21e3c44-1f9e-44a9-9334-3b26957a9207 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:23.784038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f21e3c44-1f9e-44a9-9334-3b26957a9207 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:23.793278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f21e3c44-1f9e-44a9-9334-3b26957a9207 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:23.794800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f21e3c44-1f9e-44a9-9334-3b26957a9207 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:23.796055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f21e3c44-1f9e-44a9-9334-3b26957a9207 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.169402 Jul 25 19:47:23.796618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1265/2365] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:24.300954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e337d05-5a3c-4ebe-95c5-fbbccc1d12c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:24.301552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e337d05-5a3c-4ebe-95c5-fbbccc1d12c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:24.308446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e337d05-5a3c-4ebe-95c5-fbbccc1d12c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:24.308900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e337d05-5a3c-4ebe-95c5-fbbccc1d12c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:24.309682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e337d05-5a3c-4ebe-95c5-fbbccc1d12c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:24.310121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e337d05-5a3c-4ebe-95c5-fbbccc1d12c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:24.378395 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7e337d05-5a3c-4ebe-95c5-fbbccc1d12c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:24.386951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e337d05-5a3c-4ebe-95c5-fbbccc1d12c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090321 Jul 25 19:47:24.387573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1101/2366] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:24 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:24.819865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ee8ddf50-5450-40fc-926b-8db0a9ca2a06 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:24.820429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ee8ddf50-5450-40fc-926b-8db0a9ca2a06 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:24.826836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee8ddf50-5450-40fc-926b-8db0a9ca2a06 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:24.827280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee8ddf50-5450-40fc-926b-8db0a9ca2a06 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:24.828071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee8ddf50-5450-40fc-926b-8db0a9ca2a06 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:24.828505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ee8ddf50-5450-40fc-926b-8db0a9ca2a06 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:24.971975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ee8ddf50-5450-40fc-926b-8db0a9ca2a06 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:24.981038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ee8ddf50-5450-40fc-926b-8db0a9ca2a06 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:24.982530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ee8ddf50-5450-40fc-926b-8db0a9ca2a06 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:24.983732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ee8ddf50-5450-40fc-926b-8db0a9ca2a06 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.167842 Jul 25 19:47:24.984309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1266/2367] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:25.409953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3f85f5c7-2483-4448-9997-e2a9a59ef6c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:25.410587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3f85f5c7-2483-4448-9997-e2a9a59ef6c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:25.417367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f85f5c7-2483-4448-9997-e2a9a59ef6c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:25.417813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f85f5c7-2483-4448-9997-e2a9a59ef6c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:25.418590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f85f5c7-2483-4448-9997-e2a9a59ef6c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:25.419029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f85f5c7-2483-4448-9997-e2a9a59ef6c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:25.482211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3f85f5c7-2483-4448-9997-e2a9a59ef6c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:25.491764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3f85f5c7-2483-4448-9997-e2a9a59ef6c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085751 Jul 25 19:47:25.492333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1102/2368] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:25 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:26.007704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3f01cbc9-d413-45ff-bb99-0dcb7a063aff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:26.008305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3f01cbc9-d413-45ff-bb99-0dcb7a063aff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:26.015103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f01cbc9-d413-45ff-bb99-0dcb7a063aff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:26.015575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f01cbc9-d413-45ff-bb99-0dcb7a063aff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:26.016424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f01cbc9-d413-45ff-bb99-0dcb7a063aff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:26.016980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f01cbc9-d413-45ff-bb99-0dcb7a063aff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:26.156066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3f01cbc9-d413-45ff-bb99-0dcb7a063aff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:26.165274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3f01cbc9-d413-45ff-bb99-0dcb7a063aff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:26.166773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3f01cbc9-d413-45ff-bb99-0dcb7a063aff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:26.167969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3f01cbc9-d413-45ff-bb99-0dcb7a063aff tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.164176 Jul 25 19:47:26.168540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1267/2369] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:26.514203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8152333e-358b-41e4-bca1-258068021d10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:26.514835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8152333e-358b-41e4-bca1-258068021d10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:26.522119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8152333e-358b-41e4-bca1-258068021d10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:26.522566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8152333e-358b-41e4-bca1-258068021d10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:26.523352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8152333e-358b-41e4-bca1-258068021d10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:26.523886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8152333e-358b-41e4-bca1-258068021d10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:26.595243 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8152333e-358b-41e4-bca1-258068021d10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:26.604553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8152333e-358b-41e4-bca1-258068021d10 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094225 Jul 25 19:47:26.605170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1103/2370] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:26 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:27.194057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d3dc0fa7-09c9-4e86-9a96-74e2f4e64bfb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:27.194646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d3dc0fa7-09c9-4e86-9a96-74e2f4e64bfb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:27.201492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3dc0fa7-09c9-4e86-9a96-74e2f4e64bfb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:27.201948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3dc0fa7-09c9-4e86-9a96-74e2f4e64bfb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:27.202709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3dc0fa7-09c9-4e86-9a96-74e2f4e64bfb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:27.203141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d3dc0fa7-09c9-4e86-9a96-74e2f4e64bfb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:27.344018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d3dc0fa7-09c9-4e86-9a96-74e2f4e64bfb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:27.353392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d3dc0fa7-09c9-4e86-9a96-74e2f4e64bfb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:27.354897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d3dc0fa7-09c9-4e86-9a96-74e2f4e64bfb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:27.356068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d3dc0fa7-09c9-4e86-9a96-74e2f4e64bfb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.165919 Jul 25 19:47:27.356625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1268/2371] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:27.626590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ba5c9108-2374-4af8-afd5-f1109b1e98a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:27.627181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ba5c9108-2374-4af8-afd5-f1109b1e98a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:27.633969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba5c9108-2374-4af8-afd5-f1109b1e98a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:27.634421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba5c9108-2374-4af8-afd5-f1109b1e98a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:27.635182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba5c9108-2374-4af8-afd5-f1109b1e98a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:27.635650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba5c9108-2374-4af8-afd5-f1109b1e98a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:27.700007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba5c9108-2374-4af8-afd5-f1109b1e98a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:27.709006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ba5c9108-2374-4af8-afd5-f1109b1e98a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086519 Jul 25 19:47:27.709688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1104/2372] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:27 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:28.385684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c30ec556-60ce-4a5b-99b3-a813bed07899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:28.386271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c30ec556-60ce-4a5b-99b3-a813bed07899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:28.397773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c30ec556-60ce-4a5b-99b3-a813bed07899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:28.398223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c30ec556-60ce-4a5b-99b3-a813bed07899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:28.399307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c30ec556-60ce-4a5b-99b3-a813bed07899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:28.399804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c30ec556-60ce-4a5b-99b3-a813bed07899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:28.538734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c30ec556-60ce-4a5b-99b3-a813bed07899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:28.547293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c30ec556-60ce-4a5b-99b3-a813bed07899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:28.549928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c30ec556-60ce-4a5b-99b3-a813bed07899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:28.551108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c30ec556-60ce-4a5b-99b3-a813bed07899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.169511 Jul 25 19:47:28.551688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1269/2373] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:28.733478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-949f0394-ed32-4c85-8063-c82b872704b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:28.734446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-949f0394-ed32-4c85-8063-c82b872704b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:28.742331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-949f0394-ed32-4c85-8063-c82b872704b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:28.742814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-949f0394-ed32-4c85-8063-c82b872704b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:28.744013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-949f0394-ed32-4c85-8063-c82b872704b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:28.744397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-949f0394-ed32-4c85-8063-c82b872704b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:28.808844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-949f0394-ed32-4c85-8063-c82b872704b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:28.817701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-949f0394-ed32-4c85-8063-c82b872704b2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088830 Jul 25 19:47:28.818273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1105/2374] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:28 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:47:29.575199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-baa2572f-292b-4568-9aa5-0ea7f9447fb4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:29.575829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-baa2572f-292b-4568-9aa5-0ea7f9447fb4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:29.582932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-baa2572f-292b-4568-9aa5-0ea7f9447fb4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:29.583379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-baa2572f-292b-4568-9aa5-0ea7f9447fb4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:29.584185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-baa2572f-292b-4568-9aa5-0ea7f9447fb4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:29.584625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-baa2572f-292b-4568-9aa5-0ea7f9447fb4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:29.719451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-baa2572f-292b-4568-9aa5-0ea7f9447fb4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:29.728207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-baa2572f-292b-4568-9aa5-0ea7f9447fb4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:29.729699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-baa2572f-292b-4568-9aa5-0ea7f9447fb4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:29.730846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-baa2572f-292b-4568-9aa5-0ea7f9447fb4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.159642 Jul 25 19:47:29.731406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1270/2375] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:29 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:29.841199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-68c4b2e8-43d2-4115-a9e8-82b08d4aa647 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:29.841721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-68c4b2e8-43d2-4115-a9e8-82b08d4aa647 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:29.848364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68c4b2e8-43d2-4115-a9e8-82b08d4aa647 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:29.848805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68c4b2e8-43d2-4115-a9e8-82b08d4aa647 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:29.849593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68c4b2e8-43d2-4115-a9e8-82b08d4aa647 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:29.850018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68c4b2e8-43d2-4115-a9e8-82b08d4aa647 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:29.911718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-68c4b2e8-43d2-4115-a9e8-82b08d4aa647 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:29.919568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-68c4b2e8-43d2-4115-a9e8-82b08d4aa647 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.082311 Jul 25 19:47:29.920122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1106/2376] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:29 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:30.754295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8483de21-15f4-40b1-9050-2dc099059237 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:30.754893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8483de21-15f4-40b1-9050-2dc099059237 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:30.761635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8483de21-15f4-40b1-9050-2dc099059237 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:30.762105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8483de21-15f4-40b1-9050-2dc099059237 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:30.762998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8483de21-15f4-40b1-9050-2dc099059237 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:30.763373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8483de21-15f4-40b1-9050-2dc099059237 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:30.901416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8483de21-15f4-40b1-9050-2dc099059237 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:30.910470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8483de21-15f4-40b1-9050-2dc099059237 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:30.912002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8483de21-15f4-40b1-9050-2dc099059237 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:30.913170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8483de21-15f4-40b1-9050-2dc099059237 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.162846 Jul 25 19:47:30.913724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1271/2377] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:30.940568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ee92332-6c58-4f46-92c5-ac003abaf747 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:30.941174 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ee92332-6c58-4f46-92c5-ac003abaf747 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:30.947825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ee92332-6c58-4f46-92c5-ac003abaf747 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:30.948265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ee92332-6c58-4f46-92c5-ac003abaf747 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:30.949020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ee92332-6c58-4f46-92c5-ac003abaf747 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:30.949458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ee92332-6c58-4f46-92c5-ac003abaf747 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:31.022885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4ee92332-6c58-4f46-92c5-ac003abaf747 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:31.030877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4ee92332-6c58-4f46-92c5-ac003abaf747 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094676 Jul 25 19:47:31.031449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1107/2378] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:30 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:31.936525 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-da989c79-f476-43aa-87fb-9a2ce549c24f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:31.937101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-da989c79-f476-43aa-87fb-9a2ce549c24f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:31.943642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da989c79-f476-43aa-87fb-9a2ce549c24f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:31.944085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da989c79-f476-43aa-87fb-9a2ce549c24f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:31.944833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da989c79-f476-43aa-87fb-9a2ce549c24f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:31.945260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-da989c79-f476-43aa-87fb-9a2ce549c24f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:32.053467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ea355b03-2962-4a0b-92b8-22e04d9b6064 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:32.054101 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ea355b03-2962-4a0b-92b8-22e04d9b6064 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:32.060965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea355b03-2962-4a0b-92b8-22e04d9b6064 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:32.061420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea355b03-2962-4a0b-92b8-22e04d9b6064 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:32.062212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea355b03-2962-4a0b-92b8-22e04d9b6064 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:32.062652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea355b03-2962-4a0b-92b8-22e04d9b6064 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:32.128825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ea355b03-2962-4a0b-92b8-22e04d9b6064 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:32.137322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ea355b03-2962-4a0b-92b8-22e04d9b6064 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087809 Jul 25 19:47:32.137907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1108/2379] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:32 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:47:32.241308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da989c79-f476-43aa-87fb-9a2ce549c24f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:32.250153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da989c79-f476-43aa-87fb-9a2ce549c24f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:32.251714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-da989c79-f476-43aa-87fb-9a2ce549c24f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:32.252852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-da989c79-f476-43aa-87fb-9a2ce549c24f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.320223 Jul 25 19:47:32.253397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1272/2380] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:33.158569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e599a536-177b-47fe-b724-b61d54aab9c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:33.159689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e599a536-177b-47fe-b724-b61d54aab9c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:33.165734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e599a536-177b-47fe-b724-b61d54aab9c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:33.166180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e599a536-177b-47fe-b724-b61d54aab9c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:33.166931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e599a536-177b-47fe-b724-b61d54aab9c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:33.167369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e599a536-177b-47fe-b724-b61d54aab9c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:33.171537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:47:33.234554 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e599a536-177b-47fe-b724-b61d54aab9c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:33.244388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e599a536-177b-47fe-b724-b61d54aab9c7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089862 Jul 25 19:47:33.245021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1109/2381] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:33 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:33.276927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f20d4930-a2ab-4296-a909-969e09912617 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:33.277531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f20d4930-a2ab-4296-a909-969e09912617 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:33.284356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f20d4930-a2ab-4296-a909-969e09912617 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:33.284802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f20d4930-a2ab-4296-a909-969e09912617 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:33.285570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f20d4930-a2ab-4296-a909-969e09912617 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:33.286001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f20d4930-a2ab-4296-a909-969e09912617 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:33.417579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f20d4930-a2ab-4296-a909-969e09912617 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:33.427183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f20d4930-a2ab-4296-a909-969e09912617 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:33.428800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f20d4930-a2ab-4296-a909-969e09912617 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:33.429954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f20d4930-a2ab-4296-a909-969e09912617 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.157090 Jul 25 19:47:33.430511 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1273/2382] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:47:34.267333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0a20ca62-6263-4d38-9a15-29b15ef46a06 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:34.267971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0a20ca62-6263-4d38-9a15-29b15ef46a06 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:34.274765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a20ca62-6263-4d38-9a15-29b15ef46a06 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:34.275206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a20ca62-6263-4d38-9a15-29b15ef46a06 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:34.275991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a20ca62-6263-4d38-9a15-29b15ef46a06 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:34.276439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a20ca62-6263-4d38-9a15-29b15ef46a06 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:34.341491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0a20ca62-6263-4d38-9a15-29b15ef46a06 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:34.350205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0a20ca62-6263-4d38-9a15-29b15ef46a06 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087646 Jul 25 19:47:34.350766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1110/2383] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:34 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:34.453462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-00c08104-4f94-49cc-a2b2-ffb7e16d4acf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:34.454765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-00c08104-4f94-49cc-a2b2-ffb7e16d4acf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:34.461095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00c08104-4f94-49cc-a2b2-ffb7e16d4acf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:34.461541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00c08104-4f94-49cc-a2b2-ffb7e16d4acf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:34.462299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00c08104-4f94-49cc-a2b2-ffb7e16d4acf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:34.462729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00c08104-4f94-49cc-a2b2-ffb7e16d4acf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:34.595259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-00c08104-4f94-49cc-a2b2-ffb7e16d4acf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:34.603910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-00c08104-4f94-49cc-a2b2-ffb7e16d4acf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:34.605407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-00c08104-4f94-49cc-a2b2-ffb7e16d4acf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:34.606546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-00c08104-4f94-49cc-a2b2-ffb7e16d4acf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.157019 Jul 25 19:47:34.607090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1274/2384] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:47:35.372304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8d12b4d5-0f91-4084-99fa-0b1cc3cda1bd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:35.372909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8d12b4d5-0f91-4084-99fa-0b1cc3cda1bd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:35.379810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d12b4d5-0f91-4084-99fa-0b1cc3cda1bd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:35.380261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d12b4d5-0f91-4084-99fa-0b1cc3cda1bd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:35.381028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d12b4d5-0f91-4084-99fa-0b1cc3cda1bd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:35.381562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d12b4d5-0f91-4084-99fa-0b1cc3cda1bd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:35.446021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d12b4d5-0f91-4084-99fa-0b1cc3cda1bd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:35.454776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8d12b4d5-0f91-4084-99fa-0b1cc3cda1bd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086537 Jul 25 19:47:35.455350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1111/2385] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:35 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:35.631631 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-06738a29-abcc-43cd-8b16-04e75a9f8ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:35.632184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-06738a29-abcc-43cd-8b16-04e75a9f8ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:35.638736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06738a29-abcc-43cd-8b16-04e75a9f8ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:35.639174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06738a29-abcc-43cd-8b16-04e75a9f8ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:35.639979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06738a29-abcc-43cd-8b16-04e75a9f8ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:35.640401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06738a29-abcc-43cd-8b16-04e75a9f8ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:35.778047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-06738a29-abcc-43cd-8b16-04e75a9f8ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:35.786570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-06738a29-abcc-43cd-8b16-04e75a9f8ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:35.788107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-06738a29-abcc-43cd-8b16-04e75a9f8ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:35.789263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-06738a29-abcc-43cd-8b16-04e75a9f8ecb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.161756 Jul 25 19:47:35.789835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1275/2386] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:36.476026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de1c1c6b-15d9-469b-9ced-c3d08b15cef6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:36.476564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de1c1c6b-15d9-469b-9ced-c3d08b15cef6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:36.483124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de1c1c6b-15d9-469b-9ced-c3d08b15cef6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:36.483587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de1c1c6b-15d9-469b-9ced-c3d08b15cef6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:36.484350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de1c1c6b-15d9-469b-9ced-c3d08b15cef6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:36.485398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de1c1c6b-15d9-469b-9ced-c3d08b15cef6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:36.550076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de1c1c6b-15d9-469b-9ced-c3d08b15cef6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:36.559616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de1c1c6b-15d9-469b-9ced-c3d08b15cef6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087364 Jul 25 19:47:36.560197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1112/2387] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:36 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:36.812751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8856a8e1-74b7-4ba9-af78-b0746a71330c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:36.813680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8856a8e1-74b7-4ba9-af78-b0746a71330c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:36.820155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8856a8e1-74b7-4ba9-af78-b0746a71330c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:36.820601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8856a8e1-74b7-4ba9-af78-b0746a71330c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:36.821373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8856a8e1-74b7-4ba9-af78-b0746a71330c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:36.821811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8856a8e1-74b7-4ba9-af78-b0746a71330c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:36.956497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8856a8e1-74b7-4ba9-af78-b0746a71330c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:36.964901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8856a8e1-74b7-4ba9-af78-b0746a71330c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:36.966393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8856a8e1-74b7-4ba9-af78-b0746a71330c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:36.967562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8856a8e1-74b7-4ba9-af78-b0746a71330c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.158664 Jul 25 19:47:36.968126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1276/2388] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:37.580808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7f491a6a-0399-4ac5-86d2-2edc7b391e88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:37.581398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7f491a6a-0399-4ac5-86d2-2edc7b391e88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:37.587932 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f491a6a-0399-4ac5-86d2-2edc7b391e88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:37.588377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f491a6a-0399-4ac5-86d2-2edc7b391e88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:37.589128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f491a6a-0399-4ac5-86d2-2edc7b391e88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:37.589567 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f491a6a-0399-4ac5-86d2-2edc7b391e88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:37.654334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f491a6a-0399-4ac5-86d2-2edc7b391e88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:37.662545 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7f491a6a-0399-4ac5-86d2-2edc7b391e88 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085711 Jul 25 19:47:37.663115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1113/2389] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:37.992516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1e7995b1-1aff-494f-84c7-8c6349fea509 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:37.993063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1e7995b1-1aff-494f-84c7-8c6349fea509 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:37.999990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e7995b1-1aff-494f-84c7-8c6349fea509 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:38.000453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e7995b1-1aff-494f-84c7-8c6349fea509 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:38.001336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e7995b1-1aff-494f-84c7-8c6349fea509 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:38.001767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e7995b1-1aff-494f-84c7-8c6349fea509 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:38.134037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1e7995b1-1aff-494f-84c7-8c6349fea509 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:38.142644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1e7995b1-1aff-494f-84c7-8c6349fea509 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:38.144165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1e7995b1-1aff-494f-84c7-8c6349fea509 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:38.145333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1e7995b1-1aff-494f-84c7-8c6349fea509 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.156808 Jul 25 19:47:38.145888 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1277/2390] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:38.684711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5cc33881-c657-4ddd-bc94-54907caa36a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:38.685374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5cc33881-c657-4ddd-bc94-54907caa36a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:38.693046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5cc33881-c657-4ddd-bc94-54907caa36a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:38.693601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5cc33881-c657-4ddd-bc94-54907caa36a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:38.694416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5cc33881-c657-4ddd-bc94-54907caa36a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:38.694849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5cc33881-c657-4ddd-bc94-54907caa36a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:38.757869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5cc33881-c657-4ddd-bc94-54907caa36a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:38.765821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5cc33881-c657-4ddd-bc94-54907caa36a3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085205 Jul 25 19:47:38.767037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1114/2391] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:38 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:39.169408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-beab011e-7e0f-4c73-8281-bf9d66fe3fb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:39.170472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-beab011e-7e0f-4c73-8281-bf9d66fe3fb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:39.172987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=50 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:47:39.178569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-beab011e-7e0f-4c73-8281-bf9d66fe3fb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:39.179016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-beab011e-7e0f-4c73-8281-bf9d66fe3fb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:39.179808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-beab011e-7e0f-4c73-8281-bf9d66fe3fb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:39.180249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-beab011e-7e0f-4c73-8281-bf9d66fe3fb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:39.315305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-beab011e-7e0f-4c73-8281-bf9d66fe3fb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:39.323702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-beab011e-7e0f-4c73-8281-bf9d66fe3fb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:39.325182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-beab011e-7e0f-4c73-8281-bf9d66fe3fb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:39.326319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-beab011e-7e0f-4c73-8281-bf9d66fe3fb5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.160793 Jul 25 19:47:39.326877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1278/2392] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:39.789064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0fb0319-c13c-4a92-a184-54e353e3db94 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:39.789697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0fb0319-c13c-4a92-a184-54e353e3db94 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:39.796179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0fb0319-c13c-4a92-a184-54e353e3db94 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:39.796622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0fb0319-c13c-4a92-a184-54e353e3db94 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:39.797377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0fb0319-c13c-4a92-a184-54e353e3db94 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:39.797805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0fb0319-c13c-4a92-a184-54e353e3db94 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:39.859073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0fb0319-c13c-4a92-a184-54e353e3db94 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:39.867963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0fb0319-c13c-4a92-a184-54e353e3db94 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.083155 Jul 25 19:47:39.868531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1115/2393] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:39 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:40.350132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-72c361f7-88a2-414d-ad28-574215c8b964 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:40.350713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-72c361f7-88a2-414d-ad28-574215c8b964 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:40.357203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72c361f7-88a2-414d-ad28-574215c8b964 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:40.357651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72c361f7-88a2-414d-ad28-574215c8b964 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:40.358401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72c361f7-88a2-414d-ad28-574215c8b964 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:40.358831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72c361f7-88a2-414d-ad28-574215c8b964 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:40.492259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-72c361f7-88a2-414d-ad28-574215c8b964 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:40.501607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-72c361f7-88a2-414d-ad28-574215c8b964 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:40.503171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-72c361f7-88a2-414d-ad28-574215c8b964 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:40.504375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-72c361f7-88a2-414d-ad28-574215c8b964 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.158155 Jul 25 19:47:40.504948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1279/2394] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:40.888781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f2086fc3-4a07-4284-875d-ab25b9376dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:40.889406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f2086fc3-4a07-4284-875d-ab25b9376dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:40.892079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=56 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:47:40.897277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2086fc3-4a07-4284-875d-ab25b9376dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:40.897727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2086fc3-4a07-4284-875d-ab25b9376dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:40.898496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2086fc3-4a07-4284-875d-ab25b9376dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:40.898939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2086fc3-4a07-4284-875d-ab25b9376dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:40.962913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2086fc3-4a07-4284-875d-ab25b9376dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:40.971791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f2086fc3-4a07-4284-875d-ab25b9376dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086780 Jul 25 19:47:40.972368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1116/2395] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:40 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:41.531188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-efa1e7bd-7215-44e2-8102-19d6969fe376 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:41.531869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-efa1e7bd-7215-44e2-8102-19d6969fe376 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:41.538327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-efa1e7bd-7215-44e2-8102-19d6969fe376 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:41.538779 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-efa1e7bd-7215-44e2-8102-19d6969fe376 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:41.539573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-efa1e7bd-7215-44e2-8102-19d6969fe376 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:41.540013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-efa1e7bd-7215-44e2-8102-19d6969fe376 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:41.671313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-efa1e7bd-7215-44e2-8102-19d6969fe376 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:41.675305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:47:41.681729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-efa1e7bd-7215-44e2-8102-19d6969fe376 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:41.683224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-efa1e7bd-7215-44e2-8102-19d6969fe376 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:41.684443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-efa1e7bd-7215-44e2-8102-19d6969fe376 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.157264 Jul 25 19:47:41.685001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1280/2396] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:41.993082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0c21cf82-d973-40e6-b90d-7b67a0530a42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:41.993726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0c21cf82-d973-40e6-b90d-7b67a0530a42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:42.000358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c21cf82-d973-40e6-b90d-7b67a0530a42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:42.000835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c21cf82-d973-40e6-b90d-7b67a0530a42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:42.001642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c21cf82-d973-40e6-b90d-7b67a0530a42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:42.002095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c21cf82-d973-40e6-b90d-7b67a0530a42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:42.066301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0c21cf82-d973-40e6-b90d-7b67a0530a42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:42.074325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0c21cf82-d973-40e6-b90d-7b67a0530a42 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085112 Jul 25 19:47:42.074899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1117/2397] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:41 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:42.708746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4c8e30e1-2ea5-4818-bdc5-dcd5e305687d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:42.709323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4c8e30e1-2ea5-4818-bdc5-dcd5e305687d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:42.715758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c8e30e1-2ea5-4818-bdc5-dcd5e305687d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:42.716269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c8e30e1-2ea5-4818-bdc5-dcd5e305687d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:42.716987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c8e30e1-2ea5-4818-bdc5-dcd5e305687d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:42.717415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c8e30e1-2ea5-4818-bdc5-dcd5e305687d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:42.851232 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4c8e30e1-2ea5-4818-bdc5-dcd5e305687d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:42.860218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4c8e30e1-2ea5-4818-bdc5-dcd5e305687d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:42.861152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4c8e30e1-2ea5-4818-bdc5-dcd5e305687d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:42.862571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4c8e30e1-2ea5-4818-bdc5-dcd5e305687d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.158184 Jul 25 19:47:42.863129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1281/2398] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:42.927317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:47:42.927720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:47:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:47:43.096794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5b388f46-9953-4eed-8385-a0a411f3adb4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:43.097476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5b388f46-9953-4eed-8385-a0a411f3adb4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:43.103999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b388f46-9953-4eed-8385-a0a411f3adb4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:43.104454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b388f46-9953-4eed-8385-a0a411f3adb4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:43.105212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b388f46-9953-4eed-8385-a0a411f3adb4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:43.105669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b388f46-9953-4eed-8385-a0a411f3adb4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:43.168258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5b388f46-9953-4eed-8385-a0a411f3adb4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:43.176944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5b388f46-9953-4eed-8385-a0a411f3adb4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.084015 Jul 25 19:47:43.177511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1118/2399] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:43 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:43.886268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4e29d657-bef2-4f30-9205-e429943692df tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:43.886856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4e29d657-bef2-4f30-9205-e429943692df tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:43.894271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e29d657-bef2-4f30-9205-e429943692df tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:43.894714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e29d657-bef2-4f30-9205-e429943692df tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:43.895471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e29d657-bef2-4f30-9205-e429943692df tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:43.895928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e29d657-bef2-4f30-9205-e429943692df tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:44.025316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e29d657-bef2-4f30-9205-e429943692df tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:44.033950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e29d657-bef2-4f30-9205-e429943692df tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:44.035428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e29d657-bef2-4f30-9205-e429943692df tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:44.036606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4e29d657-bef2-4f30-9205-e429943692df tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.154406 Jul 25 19:47:44.037150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1282/2400] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:44.198304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-775c4119-4b27-4b57-b2e2-3e1f05b76dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:44.198977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-775c4119-4b27-4b57-b2e2-3e1f05b76dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:44.206084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-775c4119-4b27-4b57-b2e2-3e1f05b76dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:44.206539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-775c4119-4b27-4b57-b2e2-3e1f05b76dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:44.207310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-775c4119-4b27-4b57-b2e2-3e1f05b76dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:44.207779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-775c4119-4b27-4b57-b2e2-3e1f05b76dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:44.276914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-775c4119-4b27-4b57-b2e2-3e1f05b76dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:44.285088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-775c4119-4b27-4b57-b2e2-3e1f05b76dfd tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090620 Jul 25 19:47:44.285656 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1119/2401] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:44 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:45.059496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-665914d5-46df-456f-9b1e-f42c80ac1dcc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:45.060130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-665914d5-46df-456f-9b1e-f42c80ac1dcc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:45.066846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-665914d5-46df-456f-9b1e-f42c80ac1dcc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:45.067288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-665914d5-46df-456f-9b1e-f42c80ac1dcc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:45.068075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-665914d5-46df-456f-9b1e-f42c80ac1dcc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:45.068508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-665914d5-46df-456f-9b1e-f42c80ac1dcc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:45.197885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-665914d5-46df-456f-9b1e-f42c80ac1dcc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:45.207211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-665914d5-46df-456f-9b1e-f42c80ac1dcc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:45.208821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-665914d5-46df-456f-9b1e-f42c80ac1dcc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:45.209973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-665914d5-46df-456f-9b1e-f42c80ac1dcc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.154449 Jul 25 19:47:45.210532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1283/2402] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:45.307606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-513832d8-24a4-456c-98d1-d17493b9acb0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:45.308212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-513832d8-24a4-456c-98d1-d17493b9acb0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:45.316098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-513832d8-24a4-456c-98d1-d17493b9acb0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:45.316478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-513832d8-24a4-456c-98d1-d17493b9acb0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:45.317309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-513832d8-24a4-456c-98d1-d17493b9acb0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:45.317741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-513832d8-24a4-456c-98d1-d17493b9acb0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:45.380454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-513832d8-24a4-456c-98d1-d17493b9acb0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:45.388332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-513832d8-24a4-456c-98d1-d17493b9acb0 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.084581 Jul 25 19:47:45.389213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1120/2403] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:45 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:46.235826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df6ae60e-314d-4ef1-bca3-3b008d9cf086 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:46.236719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df6ae60e-314d-4ef1-bca3-3b008d9cf086 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:46.242865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df6ae60e-314d-4ef1-bca3-3b008d9cf086 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:46.243312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df6ae60e-314d-4ef1-bca3-3b008d9cf086 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:46.244109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df6ae60e-314d-4ef1-bca3-3b008d9cf086 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:46.244538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df6ae60e-314d-4ef1-bca3-3b008d9cf086 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:46.378562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df6ae60e-314d-4ef1-bca3-3b008d9cf086 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:46.386858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df6ae60e-314d-4ef1-bca3-3b008d9cf086 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:46.388375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df6ae60e-314d-4ef1-bca3-3b008d9cf086 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:46.389509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df6ae60e-314d-4ef1-bca3-3b008d9cf086 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.158305 Jul 25 19:47:46.390060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1284/2404] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:46.410458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af87ebe8-0f2b-43f2-85f7-a03ac22dcbc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:46.411064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af87ebe8-0f2b-43f2-85f7-a03ac22dcbc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:46.417540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af87ebe8-0f2b-43f2-85f7-a03ac22dcbc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:46.417981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af87ebe8-0f2b-43f2-85f7-a03ac22dcbc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:46.418730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af87ebe8-0f2b-43f2-85f7-a03ac22dcbc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:46.419157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af87ebe8-0f2b-43f2-85f7-a03ac22dcbc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:46.480875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-af87ebe8-0f2b-43f2-85f7-a03ac22dcbc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:46.488976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af87ebe8-0f2b-43f2-85f7-a03ac22dcbc5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.082961 Jul 25 19:47:46.489606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1121/2405] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:46 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:47.413256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d6447f97-6bc1-42c7-a552-3b5467a06632 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:47.413828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d6447f97-6bc1-42c7-a552-3b5467a06632 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:47.420392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d6447f97-6bc1-42c7-a552-3b5467a06632 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:47.420782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d6447f97-6bc1-42c7-a552-3b5467a06632 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:47.421534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d6447f97-6bc1-42c7-a552-3b5467a06632 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:47.422492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d6447f97-6bc1-42c7-a552-3b5467a06632 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:47.509612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-63e3aaae-2b36-412a-82de-f18f1ea46609 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:47.510216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-63e3aaae-2b36-412a-82de-f18f1ea46609 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:47.517172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e3aaae-2b36-412a-82de-f18f1ea46609 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:47.517635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e3aaae-2b36-412a-82de-f18f1ea46609 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:47.518391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e3aaae-2b36-412a-82de-f18f1ea46609 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:47.518824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e3aaae-2b36-412a-82de-f18f1ea46609 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:47.554283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d6447f97-6bc1-42c7-a552-3b5467a06632 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:47.564234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d6447f97-6bc1-42c7-a552-3b5467a06632 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:47.565796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d6447f97-6bc1-42c7-a552-3b5467a06632 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:47.566979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d6447f97-6bc1-42c7-a552-3b5467a06632 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.157675 Jul 25 19:47:47.567611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1285/2406] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:47.586976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-63e3aaae-2b36-412a-82de-f18f1ea46609 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:47.595857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-63e3aaae-2b36-412a-82de-f18f1ea46609 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.090057 Jul 25 19:47:47.596573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1122/2407] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:47 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:47:48.590581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-43118f6f-7144-401b-88a4-92440ae3cb66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:48.591178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-43118f6f-7144-401b-88a4-92440ae3cb66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:48.597838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43118f6f-7144-401b-88a4-92440ae3cb66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:48.598285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43118f6f-7144-401b-88a4-92440ae3cb66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:48.599036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43118f6f-7144-401b-88a4-92440ae3cb66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:48.599464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43118f6f-7144-401b-88a4-92440ae3cb66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:48.617335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ab0d0fa-2c19-490d-96e4-8d2624079537 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:48.617936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ab0d0fa-2c19-490d-96e4-8d2624079537 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:48.624038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ab0d0fa-2c19-490d-96e4-8d2624079537 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:48.624480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ab0d0fa-2c19-490d-96e4-8d2624079537 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:48.626108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ab0d0fa-2c19-490d-96e4-8d2624079537 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:48.626598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ab0d0fa-2c19-490d-96e4-8d2624079537 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:48.695368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ab0d0fa-2c19-490d-96e4-8d2624079537 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:48.703922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ab0d0fa-2c19-490d-96e4-8d2624079537 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089843 Jul 25 19:47:48.704647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1123/2408] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:48 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:48.761862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-43118f6f-7144-401b-88a4-92440ae3cb66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:48.777583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-43118f6f-7144-401b-88a4-92440ae3cb66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:48.779604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-43118f6f-7144-401b-88a4-92440ae3cb66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:48.780808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-43118f6f-7144-401b-88a4-92440ae3cb66 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.194039 Jul 25 19:47:48.781410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1286/2409] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:48 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:49.727887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cf8150e0-d807-4f09-8339-fe6c5b60b31d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:49.728478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cf8150e0-d807-4f09-8339-fe6c5b60b31d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:49.734887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf8150e0-d807-4f09-8339-fe6c5b60b31d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:49.735332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf8150e0-d807-4f09-8339-fe6c5b60b31d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:49.736119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf8150e0-d807-4f09-8339-fe6c5b60b31d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:49.736822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf8150e0-d807-4f09-8339-fe6c5b60b31d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:49.796685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cf8150e0-d807-4f09-8339-fe6c5b60b31d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:49.803797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-69a846d8-f0c4-4535-9f65-c888c740a969 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:49.804399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-69a846d8-f0c4-4535-9f65-c888c740a969 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:49.804952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cf8150e0-d807-4f09-8339-fe6c5b60b31d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.080903 Jul 25 19:47:49.805532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1124/2410] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:49 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:47:49.810737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69a846d8-f0c4-4535-9f65-c888c740a969 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:49.811179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69a846d8-f0c4-4535-9f65-c888c740a969 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:49.811963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69a846d8-f0c4-4535-9f65-c888c740a969 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:49.812393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-69a846d8-f0c4-4535-9f65-c888c740a969 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:49.945646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-69a846d8-f0c4-4535-9f65-c888c740a969 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:49.954818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-69a846d8-f0c4-4535-9f65-c888c740a969 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:49.956356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-69a846d8-f0c4-4535-9f65-c888c740a969 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:49.957504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-69a846d8-f0c4-4535-9f65-c888c740a969 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.157504 Jul 25 19:47:49.958061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1287/2411] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:47:50.826264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f81d4687-cb9f-43d9-a2ea-46cbb4cc4a39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:50.826867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f81d4687-cb9f-43d9-a2ea-46cbb4cc4a39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:50.833952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f81d4687-cb9f-43d9-a2ea-46cbb4cc4a39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:50.834389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f81d4687-cb9f-43d9-a2ea-46cbb4cc4a39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:50.835135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f81d4687-cb9f-43d9-a2ea-46cbb4cc4a39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:50.835602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f81d4687-cb9f-43d9-a2ea-46cbb4cc4a39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:50.896746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f81d4687-cb9f-43d9-a2ea-46cbb4cc4a39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:50.900491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:47:50.905816 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f81d4687-cb9f-43d9-a2ea-46cbb4cc4a39 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.083374 Jul 25 19:47:50.906537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1125/2412] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:50 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:50.981316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4b797005-8cdd-47ee-ae32-c0b1630a2008 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:50.981918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4b797005-8cdd-47ee-ae32-c0b1630a2008 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:50.989170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b797005-8cdd-47ee-ae32-c0b1630a2008 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:50.989625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b797005-8cdd-47ee-ae32-c0b1630a2008 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:50.990380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b797005-8cdd-47ee-ae32-c0b1630a2008 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:50.990812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4b797005-8cdd-47ee-ae32-c0b1630a2008 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:51.125808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4b797005-8cdd-47ee-ae32-c0b1630a2008 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:51.135561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4b797005-8cdd-47ee-ae32-c0b1630a2008 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:51.137064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4b797005-8cdd-47ee-ae32-c0b1630a2008 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:51.138221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4b797005-8cdd-47ee-ae32-c0b1630a2008 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.160898 Jul 25 19:47:51.138827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1288/2413] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:51.926561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-71650ec5-7337-41c7-98ef-f65372d2e10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:51.927167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-71650ec5-7337-41c7-98ef-f65372d2e10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:51.933792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71650ec5-7337-41c7-98ef-f65372d2e10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:51.934237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71650ec5-7337-41c7-98ef-f65372d2e10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:51.934996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71650ec5-7337-41c7-98ef-f65372d2e10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:51.935432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71650ec5-7337-41c7-98ef-f65372d2e10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:51.999998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-71650ec5-7337-41c7-98ef-f65372d2e10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:52.008002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-71650ec5-7337-41c7-98ef-f65372d2e10e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.085486 Jul 25 19:47:52.008799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1126/2414] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:51 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:52.161688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-68334e11-752b-4711-944a-f7bcec6f00f4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:52.162275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-68334e11-752b-4711-944a-f7bcec6f00f4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:52.168886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68334e11-752b-4711-944a-f7bcec6f00f4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:52.169322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68334e11-752b-4711-944a-f7bcec6f00f4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:52.170108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68334e11-752b-4711-944a-f7bcec6f00f4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:52.170544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68334e11-752b-4711-944a-f7bcec6f00f4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:52.300719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-68334e11-752b-4711-944a-f7bcec6f00f4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:52.309079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-68334e11-752b-4711-944a-f7bcec6f00f4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:52.310571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-68334e11-752b-4711-944a-f7bcec6f00f4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:52.311745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-68334e11-752b-4711-944a-f7bcec6f00f4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.153927 Jul 25 19:47:52.312319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1289/2415] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:52 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:53.030150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2985bd0c-0d91-4b89-a857-6da6d638ad8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:53.030970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2985bd0c-0d91-4b89-a857-6da6d638ad8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:53.037436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2985bd0c-0d91-4b89-a857-6da6d638ad8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:53.037880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2985bd0c-0d91-4b89-a857-6da6d638ad8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:53.038660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2985bd0c-0d91-4b89-a857-6da6d638ad8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:53.039096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2985bd0c-0d91-4b89-a857-6da6d638ad8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:53.100445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2985bd0c-0d91-4b89-a857-6da6d638ad8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:53.108278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2985bd0c-0d91-4b89-a857-6da6d638ad8a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.082181 Jul 25 19:47:53.108844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1127/2416] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:53 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:53.334855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ccf18ab8-d627-467a-8f82-d9ba508e58e6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:53.335480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ccf18ab8-d627-467a-8f82-d9ba508e58e6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:53.342041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf18ab8-d627-467a-8f82-d9ba508e58e6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:53.342488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf18ab8-d627-467a-8f82-d9ba508e58e6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:53.343237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf18ab8-d627-467a-8f82-d9ba508e58e6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:53.343701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ccf18ab8-d627-467a-8f82-d9ba508e58e6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:53.480802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ccf18ab8-d627-467a-8f82-d9ba508e58e6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:53.490494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ccf18ab8-d627-467a-8f82-d9ba508e58e6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:53.492012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ccf18ab8-d627-467a-8f82-d9ba508e58e6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:53.493171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ccf18ab8-d627-467a-8f82-d9ba508e58e6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.162291 Jul 25 19:47:53.493727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1290/2417] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:54.129074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f1d7559d-6339-4411-8832-f8e91f9b4705 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:54.129841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f1d7559d-6339-4411-8832-f8e91f9b4705 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:54.136638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1d7559d-6339-4411-8832-f8e91f9b4705 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:54.137119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1d7559d-6339-4411-8832-f8e91f9b4705 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:54.137881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1d7559d-6339-4411-8832-f8e91f9b4705 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:54.138316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1d7559d-6339-4411-8832-f8e91f9b4705 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:54.200631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f1d7559d-6339-4411-8832-f8e91f9b4705 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:54.209172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f1d7559d-6339-4411-8832-f8e91f9b4705 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.084403 Jul 25 19:47:54.209741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1128/2418] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:54 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:47:54.517655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5e8f8a99-995e-4e4a-a492-2da43d9ace98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:54.518226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5e8f8a99-995e-4e4a-a492-2da43d9ace98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:54.524906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e8f8a99-995e-4e4a-a492-2da43d9ace98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:54.525355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e8f8a99-995e-4e4a-a492-2da43d9ace98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:54.526120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e8f8a99-995e-4e4a-a492-2da43d9ace98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:54.526563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e8f8a99-995e-4e4a-a492-2da43d9ace98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:54.660730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5e8f8a99-995e-4e4a-a492-2da43d9ace98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:54.669085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5e8f8a99-995e-4e4a-a492-2da43d9ace98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:54.670594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5e8f8a99-995e-4e4a-a492-2da43d9ace98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:54.671775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5e8f8a99-995e-4e4a-a492-2da43d9ace98 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.158690 Jul 25 19:47:54.672605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1291/2419] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:55.230979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b39fc66-0c2f-432b-9757-ae206f57c30f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:55.231600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b39fc66-0c2f-432b-9757-ae206f57c30f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:55.239161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b39fc66-0c2f-432b-9757-ae206f57c30f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:55.239631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b39fc66-0c2f-432b-9757-ae206f57c30f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:55.240388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b39fc66-0c2f-432b-9757-ae206f57c30f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:55.240822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b39fc66-0c2f-432b-9757-ae206f57c30f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:55.301799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b39fc66-0c2f-432b-9757-ae206f57c30f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:55.309789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b39fc66-0c2f-432b-9757-ae206f57c30f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.082667 Jul 25 19:47:55.310362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1129/2420] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:55 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:55.696388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-78b56a1c-7401-4717-aebf-4cbb6aa30007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:55.697161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-78b56a1c-7401-4717-aebf-4cbb6aa30007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:55.704470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78b56a1c-7401-4717-aebf-4cbb6aa30007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:55.705036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78b56a1c-7401-4717-aebf-4cbb6aa30007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:55.705817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78b56a1c-7401-4717-aebf-4cbb6aa30007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:55.706257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78b56a1c-7401-4717-aebf-4cbb6aa30007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:55.848549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78b56a1c-7401-4717-aebf-4cbb6aa30007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:55.857193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78b56a1c-7401-4717-aebf-4cbb6aa30007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:55.858688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78b56a1c-7401-4717-aebf-4cbb6aa30007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:55.859985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-78b56a1c-7401-4717-aebf-4cbb6aa30007 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.167825 Jul 25 19:47:55.860546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1292/2421] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:47:56.330539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5ee1dbe8-da83-4ea0-a9c7-5069243f9f69 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:56.331167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5ee1dbe8-da83-4ea0-a9c7-5069243f9f69 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:56.337722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ee1dbe8-da83-4ea0-a9c7-5069243f9f69 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:56.338170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ee1dbe8-da83-4ea0-a9c7-5069243f9f69 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:56.338935 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ee1dbe8-da83-4ea0-a9c7-5069243f9f69 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:56.339374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ee1dbe8-da83-4ea0-a9c7-5069243f9f69 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:56.404674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5ee1dbe8-da83-4ea0-a9c7-5069243f9f69 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:56.413033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5ee1dbe8-da83-4ea0-a9c7-5069243f9f69 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086535 Jul 25 19:47:56.414140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1130/2422] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:56 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:56.885039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e91f219b-f5b8-4b7f-a4a7-1298c8548235 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:56.885594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e91f219b-f5b8-4b7f-a4a7-1298c8548235 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:56.892565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e91f219b-f5b8-4b7f-a4a7-1298c8548235 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:56.893012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e91f219b-f5b8-4b7f-a4a7-1298c8548235 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:56.893782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e91f219b-f5b8-4b7f-a4a7-1298c8548235 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:56.894218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e91f219b-f5b8-4b7f-a4a7-1298c8548235 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:57.030063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e91f219b-f5b8-4b7f-a4a7-1298c8548235 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:57.039435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e91f219b-f5b8-4b7f-a4a7-1298c8548235 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:57.040969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e91f219b-f5b8-4b7f-a4a7-1298c8548235 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:57.042136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e91f219b-f5b8-4b7f-a4a7-1298c8548235 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.161357 Jul 25 19:47:57.042703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1293/2423] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:56 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:57.435435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-beb13d2a-86c2-4b5f-b317-e0e601262f95 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:57.435988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-beb13d2a-86c2-4b5f-b317-e0e601262f95 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:57.442811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-beb13d2a-86c2-4b5f-b317-e0e601262f95 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:57.443254 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-beb13d2a-86c2-4b5f-b317-e0e601262f95 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:57.444046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-beb13d2a-86c2-4b5f-b317-e0e601262f95 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:57.444477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-beb13d2a-86c2-4b5f-b317-e0e601262f95 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:57.512770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-beb13d2a-86c2-4b5f-b317-e0e601262f95 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:57.521006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-beb13d2a-86c2-4b5f-b317-e0e601262f95 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.089504 Jul 25 19:47:57.521574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1131/2424] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:57 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:58.066564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3a2211a0-7d71-4389-92ba-5dc86c22bfac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:58.067175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3a2211a0-7d71-4389-92ba-5dc86c22bfac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:58.073786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a2211a0-7d71-4389-92ba-5dc86c22bfac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:58.074234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a2211a0-7d71-4389-92ba-5dc86c22bfac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:58.075009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a2211a0-7d71-4389-92ba-5dc86c22bfac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:58.075455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3a2211a0-7d71-4389-92ba-5dc86c22bfac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:58.220043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3a2211a0-7d71-4389-92ba-5dc86c22bfac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:58.228917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3a2211a0-7d71-4389-92ba-5dc86c22bfac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:58.230427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3a2211a0-7d71-4389-92ba-5dc86c22bfac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:58.231629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3a2211a0-7d71-4389-92ba-5dc86c22bfac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.169831 Jul 25 19:47:58.232194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1294/2425] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:58.543149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-31431d87-608e-4bc5-802b-24dfda31e90e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:58.543747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-31431d87-608e-4bc5-802b-24dfda31e90e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:58.550776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31431d87-608e-4bc5-802b-24dfda31e90e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:58.551223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31431d87-608e-4bc5-802b-24dfda31e90e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:58.552357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31431d87-608e-4bc5-802b-24dfda31e90e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:58.552807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31431d87-608e-4bc5-802b-24dfda31e90e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:58.617632 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-31431d87-608e-4bc5-802b-24dfda31e90e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:58.626706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-31431d87-608e-4bc5-802b-24dfda31e90e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.087349 Jul 25 19:47:58.627288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1132/2426] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:58 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:47:59.257338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d23260e8-dcc1-4a9e-8036-205c079ea963 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:59.257957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d23260e8-dcc1-4a9e-8036-205c079ea963 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:59.264987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d23260e8-dcc1-4a9e-8036-205c079ea963 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:59.265941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d23260e8-dcc1-4a9e-8036-205c079ea963 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:59.267260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d23260e8-dcc1-4a9e-8036-205c079ea963 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:59.267744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d23260e8-dcc1-4a9e-8036-205c079ea963 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:59.410179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d23260e8-dcc1-4a9e-8036-205c079ea963 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:59.419261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d23260e8-dcc1-4a9e-8036-205c079ea963 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:59.420733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d23260e8-dcc1-4a9e-8036-205c079ea963 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:59.422634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d23260e8-dcc1-4a9e-8036-205c079ea963 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.168452 Jul 25 19:47:59.423310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1295/2427] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:47:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:47:59.648716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae08e698-5869-4ee1-b879-f1954353df64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:47:59.649339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae08e698-5869-4ee1-b879-f1954353df64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:47:59.657616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae08e698-5869-4ee1-b879-f1954353df64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:59.658079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae08e698-5869-4ee1-b879-f1954353df64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:59.658867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae08e698-5869-4ee1-b879-f1954353df64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:47:59.659306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae08e698-5869-4ee1-b879-f1954353df64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:47:59.723401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae08e698-5869-4ee1-b879-f1954353df64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:47:59.733533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae08e698-5869-4ee1-b879-f1954353df64 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.088576 Jul 25 19:47:59.734135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1133/2428] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:47:59 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:00.447586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8843eb3c-0769-4d3b-afa6-1e63a73fcf7b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:00.448221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8843eb3c-0769-4d3b-afa6-1e63a73fcf7b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:00.455668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8843eb3c-0769-4d3b-afa6-1e63a73fcf7b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:00.456123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8843eb3c-0769-4d3b-afa6-1e63a73fcf7b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:00.456910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8843eb3c-0769-4d3b-afa6-1e63a73fcf7b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:00.457349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8843eb3c-0769-4d3b-afa6-1e63a73fcf7b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:00.611349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8843eb3c-0769-4d3b-afa6-1e63a73fcf7b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:00.620882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8843eb3c-0769-4d3b-afa6-1e63a73fcf7b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:00.622514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8843eb3c-0769-4d3b-afa6-1e63a73fcf7b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:00.623822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8843eb3c-0769-4d3b-afa6-1e63a73fcf7b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.180277 Jul 25 19:48:00.624686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1296/2429] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:00.755113 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f25e6be9-30a5-4ea8-b5a4-c095661cb315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:00.755755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f25e6be9-30a5-4ea8-b5a4-c095661cb315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:00.762596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f25e6be9-30a5-4ea8-b5a4-c095661cb315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:00.763040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f25e6be9-30a5-4ea8-b5a4-c095661cb315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:00.763850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f25e6be9-30a5-4ea8-b5a4-c095661cb315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:00.764287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f25e6be9-30a5-4ea8-b5a4-c095661cb315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:00.829499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f25e6be9-30a5-4ea8-b5a4-c095661cb315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:00.837751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f25e6be9-30a5-4ea8-b5a4-c095661cb315 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.086636 Jul 25 19:48:00.838322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1134/2430] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:00 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:01.648609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6f4f6478-62d7-4546-9809-56af567dba4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:01.649205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6f4f6478-62d7-4546-9809-56af567dba4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:01.655966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f4f6478-62d7-4546-9809-56af567dba4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:01.656410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f4f6478-62d7-4546-9809-56af567dba4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:01.657185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f4f6478-62d7-4546-9809-56af567dba4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:01.657620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6f4f6478-62d7-4546-9809-56af567dba4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:01.676995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:01.800034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6f4f6478-62d7-4546-9809-56af567dba4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:01.808713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6f4f6478-62d7-4546-9809-56af567dba4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:01.810204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6f4f6478-62d7-4546-9809-56af567dba4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:01.811374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6f4f6478-62d7-4546-9809-56af567dba4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.167695 Jul 25 19:48:01.811966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1297/2431] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:01 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:01.859871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f8c3c033-b241-4f0c-9592-7cff250087f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:01.861132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f8c3c033-b241-4f0c-9592-7cff250087f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:01.868303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8c3c033-b241-4f0c-9592-7cff250087f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:01.868746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8c3c033-b241-4f0c-9592-7cff250087f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:01.869514 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8c3c033-b241-4f0c-9592-7cff250087f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:01.869977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8c3c033-b241-4f0c-9592-7cff250087f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:01.939770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f8c3c033-b241-4f0c-9592-7cff250087f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:01.947901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f8c3c033-b241-4f0c-9592-7cff250087f9 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092065 Jul 25 19:48:01.948659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1135/2432] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:01 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:02.836291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-32be128d-1948-4c94-b90c-1c3fbda5a4ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:02.840560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-32be128d-1948-4c94-b90c-1c3fbda5a4ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:02.847332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32be128d-1948-4c94-b90c-1c3fbda5a4ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:02.848014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32be128d-1948-4c94-b90c-1c3fbda5a4ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:02.848818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32be128d-1948-4c94-b90c-1c3fbda5a4ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:02.849254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-32be128d-1948-4c94-b90c-1c3fbda5a4ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:02.969441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2725cbe6-0b0f-4dce-b88d-9408f957d237 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:02.970050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2725cbe6-0b0f-4dce-b88d-9408f957d237 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:02.976594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2725cbe6-0b0f-4dce-b88d-9408f957d237 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:02.977053 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2725cbe6-0b0f-4dce-b88d-9408f957d237 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:02.977823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2725cbe6-0b0f-4dce-b88d-9408f957d237 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:02.978264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2725cbe6-0b0f-4dce-b88d-9408f957d237 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:02.989634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-32be128d-1948-4c94-b90c-1c3fbda5a4ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:02.998825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-32be128d-1948-4c94-b90c-1c3fbda5a4ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:03.001917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-32be128d-1948-4c94-b90c-1c3fbda5a4ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:03.007858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-32be128d-1948-4c94-b90c-1c3fbda5a4ce tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.171625 Jul 25 19:48:03.007858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1298/2433] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:03.052194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2725cbe6-0b0f-4dce-b88d-9408f957d237 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:03.060595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2725cbe6-0b0f-4dce-b88d-9408f957d237 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.094909 Jul 25 19:48:03.061179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1136/2434] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:02 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:48:04.026958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a622ced8-5505-4963-9619-e015e834268e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:04.027500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a622ced8-5505-4963-9619-e015e834268e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:04.034919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a622ced8-5505-4963-9619-e015e834268e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:04.035362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a622ced8-5505-4963-9619-e015e834268e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:04.036157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a622ced8-5505-4963-9619-e015e834268e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:04.036596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a622ced8-5505-4963-9619-e015e834268e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:04.082478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b6afb311-7ab5-483f-8e52-0ee408d141f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:04.083177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b6afb311-7ab5-483f-8e52-0ee408d141f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:04.090180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6afb311-7ab5-483f-8e52-0ee408d141f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:04.090636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6afb311-7ab5-483f-8e52-0ee408d141f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:04.091421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6afb311-7ab5-483f-8e52-0ee408d141f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:04.091897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6afb311-7ab5-483f-8e52-0ee408d141f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:04.161377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b6afb311-7ab5-483f-8e52-0ee408d141f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:04.169917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b6afb311-7ab5-483f-8e52-0ee408d141f8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.091675 Jul 25 19:48:04.170330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1137/2435] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:04 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:48:04.199739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a622ced8-5505-4963-9619-e015e834268e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:04.209365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a622ced8-5505-4963-9619-e015e834268e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:04.210874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a622ced8-5505-4963-9619-e015e834268e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:04.212094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a622ced8-5505-4963-9619-e015e834268e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.189085 Jul 25 19:48:04.212655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1299/2436] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:05.190752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3633b03c-e1c0-4301-9b66-32b5082c85ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:05.191354 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3633b03c-e1c0-4301-9b66-32b5082c85ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:05.198755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3633b03c-e1c0-4301-9b66-32b5082c85ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:05.199205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3633b03c-e1c0-4301-9b66-32b5082c85ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:05.200033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3633b03c-e1c0-4301-9b66-32b5082c85ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:05.200472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3633b03c-e1c0-4301-9b66-32b5082c85ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:05.237980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-28e1bdb2-9e91-4ade-bd6b-51a5d282dabc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:05.238607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-28e1bdb2-9e91-4ade-bd6b-51a5d282dabc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:05.246768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28e1bdb2-9e91-4ade-bd6b-51a5d282dabc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:05.247216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28e1bdb2-9e91-4ade-bd6b-51a5d282dabc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:05.248046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28e1bdb2-9e91-4ade-bd6b-51a5d282dabc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:05.248486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28e1bdb2-9e91-4ade-bd6b-51a5d282dabc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:05.287833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3633b03c-e1c0-4301-9b66-32b5082c85ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:05.296351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3633b03c-e1c0-4301-9b66-32b5082c85ea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.109769 Jul 25 19:48:05.303634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1138/2437] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:05 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:05.432939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-28e1bdb2-9e91-4ade-bd6b-51a5d282dabc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:05.444722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-28e1bdb2-9e91-4ade-bd6b-51a5d282dabc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:05.447464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-28e1bdb2-9e91-4ade-bd6b-51a5d282dabc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:05.449378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-28e1bdb2-9e91-4ade-bd6b-51a5d282dabc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.215841 Jul 25 19:48:05.449981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1300/2438] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:48:05.634461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:48:05.634695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:48:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:48:06.320810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5652703-e74f-459f-90ea-be103b478760 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:06.321924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d5652703-e74f-459f-90ea-be103b478760 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:06.333405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5652703-e74f-459f-90ea-be103b478760 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:06.334166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5652703-e74f-459f-90ea-be103b478760 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:06.335471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5652703-e74f-459f-90ea-be103b478760 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:06.336174 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5652703-e74f-459f-90ea-be103b478760 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:06.405795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5652703-e74f-459f-90ea-be103b478760 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:06.414866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d5652703-e74f-459f-90ea-be103b478760 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.099340 Jul 25 19:48:06.415443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1139/2439] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:06 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:06.475103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8495ae62-85a2-4a24-b380-88ddb09a3dac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:06.475790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8495ae62-85a2-4a24-b380-88ddb09a3dac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:06.482674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8495ae62-85a2-4a24-b380-88ddb09a3dac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:06.483127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8495ae62-85a2-4a24-b380-88ddb09a3dac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:06.483950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8495ae62-85a2-4a24-b380-88ddb09a3dac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:06.484407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8495ae62-85a2-4a24-b380-88ddb09a3dac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:06.621979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8495ae62-85a2-4a24-b380-88ddb09a3dac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:06.632234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8495ae62-85a2-4a24-b380-88ddb09a3dac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:06.633786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8495ae62-85a2-4a24-b380-88ddb09a3dac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:06.635005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8495ae62-85a2-4a24-b380-88ddb09a3dac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.164474 Jul 25 19:48:06.635602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1301/2440] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:07.437453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a23a69bc-7f90-40fd-b9f1-aa86f4cfa526 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:07.438688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a23a69bc-7f90-40fd-b9f1-aa86f4cfa526 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:07.447724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23a69bc-7f90-40fd-b9f1-aa86f4cfa526 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:07.448305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23a69bc-7f90-40fd-b9f1-aa86f4cfa526 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:07.449237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23a69bc-7f90-40fd-b9f1-aa86f4cfa526 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:07.449788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a23a69bc-7f90-40fd-b9f1-aa86f4cfa526 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:07.546681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a23a69bc-7f90-40fd-b9f1-aa86f4cfa526 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:07.556075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a23a69bc-7f90-40fd-b9f1-aa86f4cfa526 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.123198 Jul 25 19:48:07.556678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1140/2441] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:07 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:48:07.659256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-76fa7e18-dc6b-4803-8719-981a20ee4bec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:07.659932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-76fa7e18-dc6b-4803-8719-981a20ee4bec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:07.667120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76fa7e18-dc6b-4803-8719-981a20ee4bec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:07.667610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76fa7e18-dc6b-4803-8719-981a20ee4bec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:07.668422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76fa7e18-dc6b-4803-8719-981a20ee4bec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:07.668955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76fa7e18-dc6b-4803-8719-981a20ee4bec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:07.823058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-76fa7e18-dc6b-4803-8719-981a20ee4bec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:07.834258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-76fa7e18-dc6b-4803-8719-981a20ee4bec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:07.835948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-76fa7e18-dc6b-4803-8719-981a20ee4bec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:07.837571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-76fa7e18-dc6b-4803-8719-981a20ee4bec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.182913 Jul 25 19:48:07.838248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1302/2442] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:08.579030 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d69000f5-e7ee-40d8-a4a8-17dca40c6506 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:08.579647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d69000f5-e7ee-40d8-a4a8-17dca40c6506 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:08.587792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d69000f5-e7ee-40d8-a4a8-17dca40c6506 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:08.588585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d69000f5-e7ee-40d8-a4a8-17dca40c6506 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:08.589920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d69000f5-e7ee-40d8-a4a8-17dca40c6506 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:08.590620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d69000f5-e7ee-40d8-a4a8-17dca40c6506 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:08.657631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d69000f5-e7ee-40d8-a4a8-17dca40c6506 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:08.666762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d69000f5-e7ee-40d8-a4a8-17dca40c6506 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.092130 Jul 25 19:48:08.667543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1141/2443] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:08 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:08.864129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1da8f507-9e46-4df1-8540-e8e6af84276a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:08.864691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1da8f507-9e46-4df1-8540-e8e6af84276a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:08.871255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1da8f507-9e46-4df1-8540-e8e6af84276a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:08.871740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1da8f507-9e46-4df1-8540-e8e6af84276a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:08.872523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1da8f507-9e46-4df1-8540-e8e6af84276a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:08.872961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1da8f507-9e46-4df1-8540-e8e6af84276a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:09.325744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1da8f507-9e46-4df1-8540-e8e6af84276a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:09.334989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1da8f507-9e46-4df1-8540-e8e6af84276a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:09.336522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1da8f507-9e46-4df1-8540-e8e6af84276a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:09.337702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1da8f507-9e46-4df1-8540-e8e6af84276a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.478162 Jul 25 19:48:09.338256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1303/2444] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:09.689904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-97e7b1cc-4bff-4ced-8ffa-68251b8250c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:09.690726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-97e7b1cc-4bff-4ced-8ffa-68251b8250c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:09.698839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e7b1cc-4bff-4ced-8ffa-68251b8250c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:09.699322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e7b1cc-4bff-4ced-8ffa-68251b8250c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:09.700204 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e7b1cc-4bff-4ced-8ffa-68251b8250c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:09.700650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e7b1cc-4bff-4ced-8ffa-68251b8250c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:09.725017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:09.772607 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97e7b1cc-4bff-4ced-8ffa-68251b8250c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:09.781847 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-97e7b1cc-4bff-4ced-8ffa-68251b8250c6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.095685 Jul 25 19:48:09.782531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1142/2445] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:09 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:10.363018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a1f5e621-f6d2-4a79-bd7c-cd45e4394920 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:10.363865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a1f5e621-f6d2-4a79-bd7c-cd45e4394920 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:10.366156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=52 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:10.371541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1f5e621-f6d2-4a79-bd7c-cd45e4394920 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:10.371999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1f5e621-f6d2-4a79-bd7c-cd45e4394920 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:10.372782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1f5e621-f6d2-4a79-bd7c-cd45e4394920 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:10.373209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1f5e621-f6d2-4a79-bd7c-cd45e4394920 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:10.520051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a1f5e621-f6d2-4a79-bd7c-cd45e4394920 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:10.529024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a1f5e621-f6d2-4a79-bd7c-cd45e4394920 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:10.530522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a1f5e621-f6d2-4a79-bd7c-cd45e4394920 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:10.531745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a1f5e621-f6d2-4a79-bd7c-cd45e4394920 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.173293 Jul 25 19:48:10.532310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1304/2446] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:10 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:10.811022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a683a143-178e-45d2-b70e-7a69d3c75114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:10.811819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a683a143-178e-45d2-b70e-7a69d3c75114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:10.823155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a683a143-178e-45d2-b70e-7a69d3c75114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:10.823928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a683a143-178e-45d2-b70e-7a69d3c75114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:10.824858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a683a143-178e-45d2-b70e-7a69d3c75114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:10.825300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a683a143-178e-45d2-b70e-7a69d3c75114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:10.924558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a683a143-178e-45d2-b70e-7a69d3c75114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:10.933357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a683a143-178e-45d2-b70e-7a69d3c75114 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 200 len: 1372 microversion: 2.1 time: 0.127552 Jul 25 19:48:10.934290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1143/2447] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:10 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 1372 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:10.957003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f42468aa-bff5-4aa5-8f75-107d21474e97 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '.version_select at 0x7feb090b2280>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:10.988066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f42468aa-bff5-4aa5-8f75-107d21474e97 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-899432830" status: 202 len: 0 microversion: 2.1 time: 0.035007 Jul 25 19:48:10.989059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1305/2448] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Jul 25 19:48:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-899432830 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:48:11.556906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0c4c616-c4ca-4d62-9f05-cd6b28af5e21 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:11.557528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0c4c616-c4ca-4d62-9f05-cd6b28af5e21 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:11.559541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=56 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:11.567189 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0c4c616-c4ca-4d62-9f05-cd6b28af5e21 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:11.567685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0c4c616-c4ca-4d62-9f05-cd6b28af5e21 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:11.568479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0c4c616-c4ca-4d62-9f05-cd6b28af5e21 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:11.568922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0c4c616-c4ca-4d62-9f05-cd6b28af5e21 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:11.854166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0c4c616-c4ca-4d62-9f05-cd6b28af5e21 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:11.867112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0c4c616-c4ca-4d62-9f05-cd6b28af5e21 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:11.869152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0c4c616-c4ca-4d62-9f05-cd6b28af5e21 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:11.870536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0c4c616-c4ca-4d62-9f05-cd6b28af5e21 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.317926 Jul 25 19:48:11.872235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1144/2449] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:12.049245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c2e94fae-57b1-42d6-b15c-7ab4660e37ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: .version_select at 0x7feafb57b3a0>, body: {"keypair": {"name": "tempest-keypair-97164375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/nMT5vaNZGOGz3wTZdoiFN5Iz38ph1ekMsXpHAURwE/3hVq7jexcacfH9bpRTMBCoCgANqGVLy5tgtXn/tvehcyCynA0gVsgihyxSjLRskv25TotPgy5h+U6iGlEm9Q=="}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:48:12.079929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-c2e94fae-57b1-42d6-b15c-7ab4660e37ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:48:12.086654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-c2e94fae-57b1-42d6-b15c-7ab4660e37ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for user 6ecf34ceee294b53b5be7c1723b42950 and project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:48:12.128945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c2e94fae-57b1-42d6-b15c-7ab4660e37ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.087524 Jul 25 19:48:12.130416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1306/2450] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Jul 25 19:48:12 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:48:12.912160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a02dba28-888a-4b60-a1af-835b1703c221 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:12.913446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a02dba28-888a-4b60-a1af-835b1703c221 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:12.926396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a02dba28-888a-4b60-a1af-835b1703c221 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:12.927199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a02dba28-888a-4b60-a1af-835b1703c221 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:12.928682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a02dba28-888a-4b60-a1af-835b1703c221 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:12.929479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a02dba28-888a-4b60-a1af-835b1703c221 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:13.104625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a02dba28-888a-4b60-a1af-835b1703c221 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:13.118490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a02dba28-888a-4b60-a1af-835b1703c221 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:13.120077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a02dba28-888a-4b60-a1af-835b1703c221 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:13.121336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a02dba28-888a-4b60-a1af-835b1703c221 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.217710 Jul 25 19:48:13.121919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1145/2451] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:13.699421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1997917958", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b6d8d22-cbba-4be4-870a-41dcb5ed33ac"}], "security_groups": [{"name": "tempest-securitygroup--2017293867"}], "key_name": "tempest-keypair-97164375", "user_data": "}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:48:13.828309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] validate_networks() for [('5b6d8d22-cbba-4be4-870a-41dcb5ed33ac', None, None, None, None, None)] {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:48:14.168160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-53af2913-49c0-4d81-86e3-36ee59975332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:14.169514 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-53af2913-49c0-4d81-86e3-36ee59975332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:14.177739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53af2913-49c0-4d81-86e3-36ee59975332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:14.178286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53af2913-49c0-4d81-86e3-36ee59975332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:14.179264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53af2913-49c0-4d81-86e3-36ee59975332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:14.179762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53af2913-49c0-4d81-86e3-36ee59975332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:14.410789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:48:14.411241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:48:14.411754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:48:14.412164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:48:14.412572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:48:14.423876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:14.424476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:14.425483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:14.426074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:14.429640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-53af2913-49c0-4d81-86e3-36ee59975332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:14.441434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-53af2913-49c0-4d81-86e3-36ee59975332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:14.443892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-53af2913-49c0-4d81-86e3-36ee59975332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:14.445379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-53af2913-49c0-4d81-86e3-36ee59975332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.281825 Jul 25 19:48:14.446324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1146/2452] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:48:14.449955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:48:14.455684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for user 6ecf34ceee294b53b5be7c1723b42950 and project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:48:14.469390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:48:14.471768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:48:14.526215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-88bc9c43-d101-4806-990e-86e8d82f5007 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.831510 Jul 25 19:48:14.527311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1307/2453] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:48:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:48:14.541227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7ab13056-5c6f-44c3-a392-8c80344d0aad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:14.542158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7ab13056-5c6f-44c3-a392-8c80344d0aad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:14.608385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7ab13056-5c6f-44c3-a392-8c80344d0aad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:14.616739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7ab13056-5c6f-44c3-a392-8c80344d0aad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1240 microversion: 2.1 time: 0.081241 Jul 25 19:48:14.617334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1147/2454] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:14 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:48:15.472171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ea73262f-efae-4ec8-a6ec-3ec0e9293029 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:15.472829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ea73262f-efae-4ec8-a6ec-3ec0e9293029 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:15.480352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ea73262f-efae-4ec8-a6ec-3ec0e9293029 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:15.480819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ea73262f-efae-4ec8-a6ec-3ec0e9293029 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:15.481620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ea73262f-efae-4ec8-a6ec-3ec0e9293029 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:15.482070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ea73262f-efae-4ec8-a6ec-3ec0e9293029 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:15.643010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-852c81c5-0ba7-41c7-9bda-77a9901d33f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:15.644676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-852c81c5-0ba7-41c7-9bda-77a9901d33f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:15.683734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ea73262f-efae-4ec8-a6ec-3ec0e9293029 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:15.704473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ea73262f-efae-4ec8-a6ec-3ec0e9293029 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:15.707691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ea73262f-efae-4ec8-a6ec-3ec0e9293029 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:15.712103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ea73262f-efae-4ec8-a6ec-3ec0e9293029 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.243666 Jul 25 19:48:15.713527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1308/2455] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:15 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:15.737104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-852c81c5-0ba7-41c7-9bda-77a9901d33f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:15.746056 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-852c81c5-0ba7-41c7-9bda-77a9901d33f3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1240 microversion: 2.1 time: 0.110216 Jul 25 19:48:15.746720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1148/2456] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:15 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1240 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:16.751801 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3616792a-df60-41a6-a444-10a8643dd4ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:16.752485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3616792a-df60-41a6-a444-10a8643dd4ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:16.761373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3616792a-df60-41a6-a444-10a8643dd4ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:16.761819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3616792a-df60-41a6-a444-10a8643dd4ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:16.762699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3616792a-df60-41a6-a444-10a8643dd4ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:16.763380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3616792a-df60-41a6-a444-10a8643dd4ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:16.772039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-711debd2-269a-49d3-bc25-442387b57142 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:16.773081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-711debd2-269a-49d3-bc25-442387b57142 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:16.871347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-711debd2-269a-49d3-bc25-442387b57142 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:16.888164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-711debd2-269a-49d3-bc25-442387b57142 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1240 microversion: 2.1 time: 0.122800 Jul 25 19:48:16.889367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1149/2457] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:16 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1240 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:48:16.961898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3616792a-df60-41a6-a444-10a8643dd4ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:16.971532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3616792a-df60-41a6-a444-10a8643dd4ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:16.973254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3616792a-df60-41a6-a444-10a8643dd4ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:16.974443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3616792a-df60-41a6-a444-10a8643dd4ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.228023 Jul 25 19:48:16.975026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1309/2458] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:17.911693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-14b7f8f1-b172-4584-8fac-7aa71200127e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:17.912353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-14b7f8f1-b172-4584-8fac-7aa71200127e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:17.969702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-14b7f8f1-b172-4584-8fac-7aa71200127e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:17.976673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-14b7f8f1-b172-4584-8fac-7aa71200127e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1240 microversion: 2.1 time: 0.069231 Jul 25 19:48:17.977275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1150/2459] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:17 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:17.998458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c96f3f40-981f-45ba-b549-fb45bff6af59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:17.999086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c96f3f40-981f-45ba-b549-fb45bff6af59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:18.006188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c96f3f40-981f-45ba-b549-fb45bff6af59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:18.006762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c96f3f40-981f-45ba-b549-fb45bff6af59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:18.007782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c96f3f40-981f-45ba-b549-fb45bff6af59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:18.008236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c96f3f40-981f-45ba-b549-fb45bff6af59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:18.175799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c96f3f40-981f-45ba-b549-fb45bff6af59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:18.185457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c96f3f40-981f-45ba-b549-fb45bff6af59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:18.186851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c96f3f40-981f-45ba-b549-fb45bff6af59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:18.188532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c96f3f40-981f-45ba-b549-fb45bff6af59 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.194113 Jul 25 19:48:18.189099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1310/2460] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:18.926301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:48:18.927005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:48:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:48:19.000926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f078796e-8175-4bc2-8c63-7395c2624376 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:19.001574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f078796e-8175-4bc2-8c63-7395c2624376 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:19.009037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f078796e-8175-4bc2-8c63-7395c2624376 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:19.009478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f078796e-8175-4bc2-8c63-7395c2624376 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:19.010242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f078796e-8175-4bc2-8c63-7395c2624376 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:19.010675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f078796e-8175-4bc2-8c63-7395c2624376 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:19.073283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f078796e-8175-4bc2-8c63-7395c2624376 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:19.080823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f078796e-8175-4bc2-8c63-7395c2624376 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1244 microversion: 2.1 time: 0.084767 Jul 25 19:48:19.081385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1151/2461] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:18 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:19.213133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b1f9003f-c198-45ec-9f09-8ae098bbd19e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:19.213735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b1f9003f-c198-45ec-9f09-8ae098bbd19e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:19.221145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1f9003f-c198-45ec-9f09-8ae098bbd19e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:19.221587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1f9003f-c198-45ec-9f09-8ae098bbd19e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:19.222355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1f9003f-c198-45ec-9f09-8ae098bbd19e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:19.222788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1f9003f-c198-45ec-9f09-8ae098bbd19e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:19.356972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b1f9003f-c198-45ec-9f09-8ae098bbd19e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:19.366905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b1f9003f-c198-45ec-9f09-8ae098bbd19e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:19.368558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b1f9003f-c198-45ec-9f09-8ae098bbd19e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:19.369780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b1f9003f-c198-45ec-9f09-8ae098bbd19e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.160526 Jul 25 19:48:19.370433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1311/2462] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:20.102306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7ba02d8f-e8e7-429d-a0b6-8a63bf619dea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:20.103211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7ba02d8f-e8e7-429d-a0b6-8a63bf619dea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:20.110184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ba02d8f-e8e7-429d-a0b6-8a63bf619dea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:20.110777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ba02d8f-e8e7-429d-a0b6-8a63bf619dea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:20.111909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ba02d8f-e8e7-429d-a0b6-8a63bf619dea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:20.112417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ba02d8f-e8e7-429d-a0b6-8a63bf619dea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:20.201611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7ba02d8f-e8e7-429d-a0b6-8a63bf619dea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:20.210261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7ba02d8f-e8e7-429d-a0b6-8a63bf619dea tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1310 microversion: 2.1 time: 0.111780 Jul 25 19:48:20.210835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1152/2463] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:20 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1310 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:20.393270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b4baa550-ae1c-4ecf-a145-4f6ebad2c271 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:20.393822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b4baa550-ae1c-4ecf-a145-4f6ebad2c271 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:20.400223 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4baa550-ae1c-4ecf-a145-4f6ebad2c271 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:20.400763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4baa550-ae1c-4ecf-a145-4f6ebad2c271 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:20.401534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4baa550-ae1c-4ecf-a145-4f6ebad2c271 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:20.401969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b4baa550-ae1c-4ecf-a145-4f6ebad2c271 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:20.597864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b4baa550-ae1c-4ecf-a145-4f6ebad2c271 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:20.607129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b4baa550-ae1c-4ecf-a145-4f6ebad2c271 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:20.608792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b4baa550-ae1c-4ecf-a145-4f6ebad2c271 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:20.610641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b4baa550-ae1c-4ecf-a145-4f6ebad2c271 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.221375 Jul 25 19:48:20.611206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1312/2464] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:20 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:21.231895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6dbdfc11-9658-44c9-be73-5f41f195e860 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:21.232503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6dbdfc11-9658-44c9-be73-5f41f195e860 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:21.240577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dbdfc11-9658-44c9-be73-5f41f195e860 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:21.240942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dbdfc11-9658-44c9-be73-5f41f195e860 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:21.241707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dbdfc11-9658-44c9-be73-5f41f195e860 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:21.242169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dbdfc11-9658-44c9-be73-5f41f195e860 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:21.487119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6dbdfc11-9658-44c9-be73-5f41f195e860 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:21.494865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6dbdfc11-9658-44c9-be73-5f41f195e860 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1366 microversion: 2.1 time: 0.266742 Jul 25 19:48:21.495370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1153/2465] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:21 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:21.642384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cb3b36a7-1c4b-4a26-9436-9600b934a899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:21.643543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cb3b36a7-1c4b-4a26-9436-9600b934a899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:21.659670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb3b36a7-1c4b-4a26-9436-9600b934a899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:21.660124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb3b36a7-1c4b-4a26-9436-9600b934a899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:21.660903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb3b36a7-1c4b-4a26-9436-9600b934a899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:21.661345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cb3b36a7-1c4b-4a26-9436-9600b934a899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:21.856324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cb3b36a7-1c4b-4a26-9436-9600b934a899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:21.865368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cb3b36a7-1c4b-4a26-9436-9600b934a899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:21.866850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cb3b36a7-1c4b-4a26-9436-9600b934a899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:21.868047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cb3b36a7-1c4b-4a26-9436-9600b934a899 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.234128 Jul 25 19:48:21.868590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1313/2466] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:22.060791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-6c3d0427-8bf2-4fec-8620-e6df16f0d2cc req-80d77821-28b6-45fb-a21f-daf4ef9a6df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f473a58-cf08-414e-8307-99283263dd30", "tag": "082c8b7f-e878-4256-9011-4d70d8adbf74"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:48:22.072403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-6c3d0427-8bf2-4fec-8620-e6df16f0d2cc req-80d77821-28b6-45fb-a21f-daf4ef9a6df5 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:22.072844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-6c3d0427-8bf2-4fec-8620-e6df16f0d2cc req-80d77821-28b6-45fb-a21f-daf4ef9a6df5 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:22.089456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-6c3d0427-8bf2-4fec-8620-e6df16f0d2cc req-80d77821-28b6-45fb-a21f-daf4ef9a6df5 service nova] Creating event network-changed:082c8b7f-e878-4256-9011-4d70d8adbf74 for instance 2f473a58-cf08-414e-8307-99283263dd30 on hv-cinder-85093 Jul 25 19:48:22.094789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-6c3d0427-8bf2-4fec-8620-e6df16f0d2cc req-80d77821-28b6-45fb-a21f-daf4ef9a6df5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120848 Jul 25 19:48:22.095410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1154/2467] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:48:22.517592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-40ac4d2d-6f27-421e-a74e-170f901b06a5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:22.518200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-40ac4d2d-6f27-421e-a74e-170f901b06a5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:22.524447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40ac4d2d-6f27-421e-a74e-170f901b06a5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:22.524821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40ac4d2d-6f27-421e-a74e-170f901b06a5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:22.525577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40ac4d2d-6f27-421e-a74e-170f901b06a5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:22.526011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40ac4d2d-6f27-421e-a74e-170f901b06a5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:22.657858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-40ac4d2d-6f27-421e-a74e-170f901b06a5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:22.665704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-40ac4d2d-6f27-421e-a74e-170f901b06a5 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1366 microversion: 2.1 time: 0.152535 Jul 25 19:48:22.666267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1314/2468] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:22 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:22.892357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1eef4158-c377-4945-9d5b-10ed4afc2db3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:22.893698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1eef4158-c377-4945-9d5b-10ed4afc2db3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:22.900129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1eef4158-c377-4945-9d5b-10ed4afc2db3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:22.900574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1eef4158-c377-4945-9d5b-10ed4afc2db3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:22.901328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1eef4158-c377-4945-9d5b-10ed4afc2db3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:22.901763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1eef4158-c377-4945-9d5b-10ed4afc2db3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:23.040725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1eef4158-c377-4945-9d5b-10ed4afc2db3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:23.050981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1eef4158-c377-4945-9d5b-10ed4afc2db3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:23.052530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1eef4158-c377-4945-9d5b-10ed4afc2db3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:23.053700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1eef4158-c377-4945-9d5b-10ed4afc2db3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.166078 Jul 25 19:48:23.054256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1155/2469] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:23.686493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-102ca1be-e0e3-44ef-9227-7bbcf7d44d44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:23.687128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-102ca1be-e0e3-44ef-9227-7bbcf7d44d44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:23.694450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-102ca1be-e0e3-44ef-9227-7bbcf7d44d44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:23.694892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-102ca1be-e0e3-44ef-9227-7bbcf7d44d44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:23.695683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-102ca1be-e0e3-44ef-9227-7bbcf7d44d44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:23.696118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-102ca1be-e0e3-44ef-9227-7bbcf7d44d44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:23.835587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-102ca1be-e0e3-44ef-9227-7bbcf7d44d44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:23.842988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-102ca1be-e0e3-44ef-9227-7bbcf7d44d44 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1366 microversion: 2.1 time: 0.160791 Jul 25 19:48:23.843564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1315/2470] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:23 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:24.079477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a45a0f6-c36a-4a45-82f7-42568779423a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:24.080715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a45a0f6-c36a-4a45-82f7-42568779423a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:24.092256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a45a0f6-c36a-4a45-82f7-42568779423a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:24.092919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a45a0f6-c36a-4a45-82f7-42568779423a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:24.094397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a45a0f6-c36a-4a45-82f7-42568779423a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:24.095219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a45a0f6-c36a-4a45-82f7-42568779423a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:24.301505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a45a0f6-c36a-4a45-82f7-42568779423a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:24.310162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a45a0f6-c36a-4a45-82f7-42568779423a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:24.311681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a45a0f6-c36a-4a45-82f7-42568779423a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:24.312846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a45a0f6-c36a-4a45-82f7-42568779423a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.239138 Jul 25 19:48:24.313959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1156/2471] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:24.865710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-83afb353-ad41-4e52-af20-b1a4696e38ff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:24.866309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-83afb353-ad41-4e52-af20-b1a4696e38ff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:24.868186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:24.868844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=10 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:24.874983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83afb353-ad41-4e52-af20-b1a4696e38ff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:24.875422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83afb353-ad41-4e52-af20-b1a4696e38ff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:24.876879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83afb353-ad41-4e52-af20-b1a4696e38ff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:24.877306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83afb353-ad41-4e52-af20-b1a4696e38ff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:25.011214 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-83afb353-ad41-4e52-af20-b1a4696e38ff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:25.014723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:25.019548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-83afb353-ad41-4e52-af20-b1a4696e38ff tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1366 microversion: 2.1 time: 0.157942 Jul 25 19:48:25.020119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1316/2472] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:24 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:25.338463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b1502aee-d1cf-49e4-83aa-063bd46a4b0f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:25.339093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b1502aee-d1cf-49e4-83aa-063bd46a4b0f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:25.346184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1502aee-d1cf-49e4-83aa-063bd46a4b0f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:25.346623 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1502aee-d1cf-49e4-83aa-063bd46a4b0f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:25.347378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1502aee-d1cf-49e4-83aa-063bd46a4b0f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:25.347866 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1502aee-d1cf-49e4-83aa-063bd46a4b0f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:25.495367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1502aee-d1cf-49e4-83aa-063bd46a4b0f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:25.505431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1502aee-d1cf-49e4-83aa-063bd46a4b0f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:25.506938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1502aee-d1cf-49e4-83aa-063bd46a4b0f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:25.508164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b1502aee-d1cf-49e4-83aa-063bd46a4b0f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.173579 Jul 25 19:48:25.508738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1157/2473] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:26.040773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8d5c5344-f953-45d5-8c8a-d9aff69fdc3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:26.041337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8d5c5344-f953-45d5-8c8a-d9aff69fdc3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:26.048921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d5c5344-f953-45d5-8c8a-d9aff69fdc3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:26.049366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d5c5344-f953-45d5-8c8a-d9aff69fdc3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:26.050137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d5c5344-f953-45d5-8c8a-d9aff69fdc3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:26.050571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d5c5344-f953-45d5-8c8a-d9aff69fdc3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:26.190150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8d5c5344-f953-45d5-8c8a-d9aff69fdc3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:26.198787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8d5c5344-f953-45d5-8c8a-d9aff69fdc3f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1366 microversion: 2.1 time: 0.161846 Jul 25 19:48:26.199876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1317/2474] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:26 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:48:26.541974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a0349c8e-0f3e-49f0-88c9-172c2fb9e650 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:26.542840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a0349c8e-0f3e-49f0-88c9-172c2fb9e650 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:26.550701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0349c8e-0f3e-49f0-88c9-172c2fb9e650 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:26.551146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0349c8e-0f3e-49f0-88c9-172c2fb9e650 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:26.552100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0349c8e-0f3e-49f0-88c9-172c2fb9e650 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:26.552393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0349c8e-0f3e-49f0-88c9-172c2fb9e650 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:26.684679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0349c8e-0f3e-49f0-88c9-172c2fb9e650 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:26.695164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0349c8e-0f3e-49f0-88c9-172c2fb9e650 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:26.696824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0349c8e-0f3e-49f0-88c9-172c2fb9e650 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:26.697986 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a0349c8e-0f3e-49f0-88c9-172c2fb9e650 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.159974 Jul 25 19:48:26.698576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1158/2475] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:27.221555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-04e0fc33-f99f-4ec4-bdc4-998912cbbb30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:27.222145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-04e0fc33-f99f-4ec4-bdc4-998912cbbb30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:27.228955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04e0fc33-f99f-4ec4-bdc4-998912cbbb30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:27.229395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04e0fc33-f99f-4ec4-bdc4-998912cbbb30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:27.230149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04e0fc33-f99f-4ec4-bdc4-998912cbbb30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:27.230583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-04e0fc33-f99f-4ec4-bdc4-998912cbbb30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:27.383355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-04e0fc33-f99f-4ec4-bdc4-998912cbbb30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:27.391020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-04e0fc33-f99f-4ec4-bdc4-998912cbbb30 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1366 microversion: 2.1 time: 0.173984 Jul 25 19:48:27.392236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1318/2476] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:27 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:27.722151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ddc37b3-220b-4242-aaa0-ede2f86c7248 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:27.722786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ddc37b3-220b-4242-aaa0-ede2f86c7248 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:27.729392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ddc37b3-220b-4242-aaa0-ede2f86c7248 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:27.729836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ddc37b3-220b-4242-aaa0-ede2f86c7248 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:27.730600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ddc37b3-220b-4242-aaa0-ede2f86c7248 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:27.731033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ddc37b3-220b-4242-aaa0-ede2f86c7248 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:27.867915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4ddc37b3-220b-4242-aaa0-ede2f86c7248 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:27.877033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4ddc37b3-220b-4242-aaa0-ede2f86c7248 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:27.878536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4ddc37b3-220b-4242-aaa0-ede2f86c7248 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:27.879724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4ddc37b3-220b-4242-aaa0-ede2f86c7248 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.161713 Jul 25 19:48:27.880275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1159/2477] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:28.366445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-dc04c582-f810-46fd-82cc-0cbebf282fec req-e4ebbbea-8c88-4294-9934-42b33aec740c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f473a58-cf08-414e-8307-99283263dd30", "name": "network-vif-plugged", "status": "completed", "tag": "082c8b7f-e878-4256-9011-4d70d8adbf74"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:48:28.376596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-dc04c582-f810-46fd-82cc-0cbebf282fec req-e4ebbbea-8c88-4294-9934-42b33aec740c service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:28.377324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-dc04c582-f810-46fd-82cc-0cbebf282fec req-e4ebbbea-8c88-4294-9934-42b33aec740c service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:28.389000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-dc04c582-f810-46fd-82cc-0cbebf282fec req-e4ebbbea-8c88-4294-9934-42b33aec740c service nova] Creating event network-vif-plugged:082c8b7f-e878-4256-9011-4d70d8adbf74 for instance 2f473a58-cf08-414e-8307-99283263dd30 on hv-cinder-85093 Jul 25 19:48:28.397562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-dc04c582-f810-46fd-82cc-0cbebf282fec req-e4ebbbea-8c88-4294-9934-42b33aec740c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096831 Jul 25 19:48:28.398355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1319/2478] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:48:28.413787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6d74553b-48e3-484f-a70d-4c6c766fc33c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:28.414408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d74553b-48e3-484f-a70d-4c6c766fc33c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:28.416498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=8 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:28.422067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d74553b-48e3-484f-a70d-4c6c766fc33c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:28.422619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d74553b-48e3-484f-a70d-4c6c766fc33c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:28.423481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d74553b-48e3-484f-a70d-4c6c766fc33c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:28.423955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d74553b-48e3-484f-a70d-4c6c766fc33c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:28.595591 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6d74553b-48e3-484f-a70d-4c6c766fc33c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:28.603175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6d74553b-48e3-484f-a70d-4c6c766fc33c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1366 microversion: 2.1 time: 0.194241 Jul 25 19:48:28.603780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1160/2479] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:28 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:28.903026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-af98815c-d070-4293-921c-bca8ebaeb08c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:28.903632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-af98815c-d070-4293-921c-bca8ebaeb08c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:28.911031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af98815c-d070-4293-921c-bca8ebaeb08c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:28.911476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af98815c-d070-4293-921c-bca8ebaeb08c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:28.912270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af98815c-d070-4293-921c-bca8ebaeb08c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:28.912697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af98815c-d070-4293-921c-bca8ebaeb08c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:29.060768 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-af98815c-d070-4293-921c-bca8ebaeb08c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:29.071401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-af98815c-d070-4293-921c-bca8ebaeb08c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:29.072994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-af98815c-d070-4293-921c-bca8ebaeb08c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:29.074217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-af98815c-d070-4293-921c-bca8ebaeb08c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.175543 Jul 25 19:48:29.075017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1320/2480] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:29.624835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-39cb05b9-1986-409d-a1be-0a93244bb446 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:29.625417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-39cb05b9-1986-409d-a1be-0a93244bb446 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:29.632998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39cb05b9-1986-409d-a1be-0a93244bb446 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:29.633437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39cb05b9-1986-409d-a1be-0a93244bb446 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:29.634198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39cb05b9-1986-409d-a1be-0a93244bb446 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:29.634631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39cb05b9-1986-409d-a1be-0a93244bb446 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:29.780543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-39cb05b9-1986-409d-a1be-0a93244bb446 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:29.789221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-39cb05b9-1986-409d-a1be-0a93244bb446 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1366 microversion: 2.1 time: 0.168099 Jul 25 19:48:29.789812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1161/2481] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:29 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:30.099478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1ddb8041-49d3-4fc9-b51e-caca7b8206cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:30.100250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1ddb8041-49d3-4fc9-b51e-caca7b8206cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:30.106533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ddb8041-49d3-4fc9-b51e-caca7b8206cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:30.107262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ddb8041-49d3-4fc9-b51e-caca7b8206cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:30.108076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ddb8041-49d3-4fc9-b51e-caca7b8206cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:30.108514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ddb8041-49d3-4fc9-b51e-caca7b8206cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:30.247416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1ddb8041-49d3-4fc9-b51e-caca7b8206cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:30.257280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1ddb8041-49d3-4fc9-b51e-caca7b8206cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:30.258777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1ddb8041-49d3-4fc9-b51e-caca7b8206cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:30.260004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1ddb8041-49d3-4fc9-b51e-caca7b8206cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.165637 Jul 25 19:48:30.260710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1321/2482] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:30.811709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cebc3c8a-1682-40cc-840f-5dca6810694e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:30.812539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cebc3c8a-1682-40cc-840f-5dca6810694e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:30.819678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cebc3c8a-1682-40cc-840f-5dca6810694e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:30.820120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cebc3c8a-1682-40cc-840f-5dca6810694e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:30.820968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cebc3c8a-1682-40cc-840f-5dca6810694e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:30.821601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cebc3c8a-1682-40cc-840f-5dca6810694e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:30.980942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cebc3c8a-1682-40cc-840f-5dca6810694e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:30.992107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cebc3c8a-1682-40cc-840f-5dca6810694e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1366 microversion: 2.1 time: 0.184295 Jul 25 19:48:30.992707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1162/2483] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:30 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:31.297469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b9d28f82-8a14-4813-9273-4ca6251ddd2c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:31.300036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b9d28f82-8a14-4813-9273-4ca6251ddd2c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:31.308843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9d28f82-8a14-4813-9273-4ca6251ddd2c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:31.309407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9d28f82-8a14-4813-9273-4ca6251ddd2c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:31.310298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9d28f82-8a14-4813-9273-4ca6251ddd2c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:31.310838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9d28f82-8a14-4813-9273-4ca6251ddd2c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:31.462018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b9d28f82-8a14-4813-9273-4ca6251ddd2c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:31.471694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b9d28f82-8a14-4813-9273-4ca6251ddd2c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:31.473633 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b9d28f82-8a14-4813-9273-4ca6251ddd2c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:31.474960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b9d28f82-8a14-4813-9273-4ca6251ddd2c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.182376 Jul 25 19:48:31.475810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1322/2484] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:32.015642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8d39b6ee-93f8-40aa-92ea-f21994b8f1ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:32.016980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8d39b6ee-93f8-40aa-92ea-f21994b8f1ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:32.023776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d39b6ee-93f8-40aa-92ea-f21994b8f1ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:32.024227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d39b6ee-93f8-40aa-92ea-f21994b8f1ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:32.025021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d39b6ee-93f8-40aa-92ea-f21994b8f1ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:32.025442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d39b6ee-93f8-40aa-92ea-f21994b8f1ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:32.175005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d39b6ee-93f8-40aa-92ea-f21994b8f1ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:32.178765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:32.183533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8d39b6ee-93f8-40aa-92ea-f21994b8f1ca tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1555 microversion: 2.1 time: 0.171691 Jul 25 19:48:32.184109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1163/2485] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:32 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:32.207716 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5f561786-4ab1-4bd8-8c43-25cd5e83c417 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:32.208219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5f561786-4ab1-4bd8-8c43-25cd5e83c417 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:32.214857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f561786-4ab1-4bd8-8c43-25cd5e83c417 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:32.215304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f561786-4ab1-4bd8-8c43-25cd5e83c417 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:32.216108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f561786-4ab1-4bd8-8c43-25cd5e83c417 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:32.216546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f561786-4ab1-4bd8-8c43-25cd5e83c417 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:32.302527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5f561786-4ab1-4bd8-8c43-25cd5e83c417 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100226 Jul 25 19:48:32.303150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1323/2486] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Jul 25 19:48:32 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:48:32.498019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-69b7d300-123a-44e3-961d-dfaad2d54c63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:32.498627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-69b7d300-123a-44e3-961d-dfaad2d54c63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:32.505568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69b7d300-123a-44e3-961d-dfaad2d54c63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:32.506010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69b7d300-123a-44e3-961d-dfaad2d54c63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:32.506767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69b7d300-123a-44e3-961d-dfaad2d54c63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:32.507207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69b7d300-123a-44e3-961d-dfaad2d54c63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:33.056722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69b7d300-123a-44e3-961d-dfaad2d54c63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:33.066559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69b7d300-123a-44e3-961d-dfaad2d54c63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:33.068182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69b7d300-123a-44e3-961d-dfaad2d54c63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:33.069452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-69b7d300-123a-44e3-961d-dfaad2d54c63 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.575350 Jul 25 19:48:33.070312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1164/2487] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:32 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:34.041449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-b452e5eb-0589-47e9-b447-8942535f4a04 req-2014d5d5-ea28-4d4e-b304-dc3a025d1934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f473a58-cf08-414e-8307-99283263dd30", "tag": "082c8b7f-e878-4256-9011-4d70d8adbf74"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:48:34.053110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-b452e5eb-0589-47e9-b447-8942535f4a04 req-2014d5d5-ea28-4d4e-b304-dc3a025d1934 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:34.053583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-b452e5eb-0589-47e9-b447-8942535f4a04 req-2014d5d5-ea28-4d4e-b304-dc3a025d1934 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:34.066911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-b452e5eb-0589-47e9-b447-8942535f4a04 req-2014d5d5-ea28-4d4e-b304-dc3a025d1934 service nova] Creating event network-changed:082c8b7f-e878-4256-9011-4d70d8adbf74 for instance 2f473a58-cf08-414e-8307-99283263dd30 on hv-cinder-85093 Jul 25 19:48:34.072126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-b452e5eb-0589-47e9-b447-8942535f4a04 req-2014d5d5-ea28-4d4e-b304-dc3a025d1934 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035043 Jul 25 19:48:34.073041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1324/2488] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:48:34.095695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5332250e-2906-4f88-af28-46dbd6aff811 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:34.095695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5332250e-2906-4f88-af28-46dbd6aff811 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:34.102012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5332250e-2906-4f88-af28-46dbd6aff811 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:34.102465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5332250e-2906-4f88-af28-46dbd6aff811 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:34.103238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5332250e-2906-4f88-af28-46dbd6aff811 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:34.103713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5332250e-2906-4f88-af28-46dbd6aff811 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:34.333959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5332250e-2906-4f88-af28-46dbd6aff811 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:34.344946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5332250e-2906-4f88-af28-46dbd6aff811 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:34.346983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5332250e-2906-4f88-af28-46dbd6aff811 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:34.348357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5332250e-2906-4f88-af28-46dbd6aff811 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.258104 Jul 25 19:48:34.348940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1165/2489] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:35.375273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a308d7e4-cfb6-482d-9730-7a12c6100e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:35.376033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a308d7e4-cfb6-482d-9730-7a12c6100e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:35.382495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a308d7e4-cfb6-482d-9730-7a12c6100e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:35.382937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a308d7e4-cfb6-482d-9730-7a12c6100e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:35.383733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a308d7e4-cfb6-482d-9730-7a12c6100e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:35.384166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a308d7e4-cfb6-482d-9730-7a12c6100e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:35.522462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a308d7e4-cfb6-482d-9730-7a12c6100e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:35.531092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a308d7e4-cfb6-482d-9730-7a12c6100e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:35.533443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a308d7e4-cfb6-482d-9730-7a12c6100e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:35.534731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a308d7e4-cfb6-482d-9730-7a12c6100e20 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.165491 Jul 25 19:48:35.535316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1325/2490] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:36.558886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-89c917ea-619f-48b9-bebb-e5b2172acf93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:36.559538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-89c917ea-619f-48b9-bebb-e5b2172acf93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:36.567342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89c917ea-619f-48b9-bebb-e5b2172acf93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:36.567807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89c917ea-619f-48b9-bebb-e5b2172acf93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:36.568597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89c917ea-619f-48b9-bebb-e5b2172acf93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:36.569031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89c917ea-619f-48b9-bebb-e5b2172acf93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:36.702492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-89c917ea-619f-48b9-bebb-e5b2172acf93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:36.711266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-89c917ea-619f-48b9-bebb-e5b2172acf93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:36.712785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-89c917ea-619f-48b9-bebb-e5b2172acf93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:36.713929 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-89c917ea-619f-48b9-bebb-e5b2172acf93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.158917 Jul 25 19:48:36.714499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1166/2491] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:37.737589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b90b4e36-2dfa-469f-90ae-351d53411d23 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:37.738224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b90b4e36-2dfa-469f-90ae-351d53411d23 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:37.744854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b90b4e36-2dfa-469f-90ae-351d53411d23 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:37.745296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b90b4e36-2dfa-469f-90ae-351d53411d23 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:37.746071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b90b4e36-2dfa-469f-90ae-351d53411d23 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:37.746508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b90b4e36-2dfa-469f-90ae-351d53411d23 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:37.896250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b90b4e36-2dfa-469f-90ae-351d53411d23 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:37.912395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b90b4e36-2dfa-469f-90ae-351d53411d23 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:37.915346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b90b4e36-2dfa-469f-90ae-351d53411d23 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:37.917650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b90b4e36-2dfa-469f-90ae-351d53411d23 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.184008 Jul 25 19:48:37.918704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1326/2492] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:38.960396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bc8eea90-21f6-4745-9f61-719789e5b58e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:38.961138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bc8eea90-21f6-4745-9f61-719789e5b58e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:38.968540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc8eea90-21f6-4745-9f61-719789e5b58e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:38.969024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc8eea90-21f6-4745-9f61-719789e5b58e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:38.970178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc8eea90-21f6-4745-9f61-719789e5b58e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:38.970628 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc8eea90-21f6-4745-9f61-719789e5b58e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:39.110314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bc8eea90-21f6-4745-9f61-719789e5b58e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:39.120771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bc8eea90-21f6-4745-9f61-719789e5b58e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:39.122273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bc8eea90-21f6-4745-9f61-719789e5b58e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:39.123463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bc8eea90-21f6-4745-9f61-719789e5b58e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.167140 Jul 25 19:48:39.124198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1167/2493] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:38 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:40.148466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-78ff655d-45d5-4113-9de8-93c53bacea9e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:40.149075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-78ff655d-45d5-4113-9de8-93c53bacea9e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:40.155605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78ff655d-45d5-4113-9de8-93c53bacea9e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:40.156048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78ff655d-45d5-4113-9de8-93c53bacea9e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:40.157550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78ff655d-45d5-4113-9de8-93c53bacea9e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:40.157996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-78ff655d-45d5-4113-9de8-93c53bacea9e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:40.311942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78ff655d-45d5-4113-9de8-93c53bacea9e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:40.320495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78ff655d-45d5-4113-9de8-93c53bacea9e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:40.321963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-78ff655d-45d5-4113-9de8-93c53bacea9e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:40.323104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-78ff655d-45d5-4113-9de8-93c53bacea9e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.178549 Jul 25 19:48:40.323689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1327/2494] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:41.346461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eadec882-3769-4632-89cc-3c1588a1ac4d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:41.347063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eadec882-3769-4632-89cc-3c1588a1ac4d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:41.353835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eadec882-3769-4632-89cc-3c1588a1ac4d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:41.354279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eadec882-3769-4632-89cc-3c1588a1ac4d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:41.355044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eadec882-3769-4632-89cc-3c1588a1ac4d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:41.355475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eadec882-3769-4632-89cc-3c1588a1ac4d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:41.494047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eadec882-3769-4632-89cc-3c1588a1ac4d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:41.502877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eadec882-3769-4632-89cc-3c1588a1ac4d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:41.504388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eadec882-3769-4632-89cc-3c1588a1ac4d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:41.505539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eadec882-3769-4632-89cc-3c1588a1ac4d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.163262 Jul 25 19:48:41.506539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1168/2495] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:42.529897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-29e3de24-6596-4b69-a0e8-131d128605eb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:42.530474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-29e3de24-6596-4b69-a0e8-131d128605eb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:42.533521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:42.538889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29e3de24-6596-4b69-a0e8-131d128605eb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:42.539342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29e3de24-6596-4b69-a0e8-131d128605eb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:42.540140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29e3de24-6596-4b69-a0e8-131d128605eb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:42.540583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-29e3de24-6596-4b69-a0e8-131d128605eb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:42.692437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-29e3de24-6596-4b69-a0e8-131d128605eb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:42.707896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-29e3de24-6596-4b69-a0e8-131d128605eb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:42.710878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-29e3de24-6596-4b69-a0e8-131d128605eb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:42.713151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-29e3de24-6596-4b69-a0e8-131d128605eb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.186888 Jul 25 19:48:42.714196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1328/2496] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:43.738399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c32cca9e-899c-41c5-8a61-cbe4fe6bd5b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:43.739035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c32cca9e-899c-41c5-8a61-cbe4fe6bd5b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:43.741604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=58 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:43.746915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32cca9e-899c-41c5-8a61-cbe4fe6bd5b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:43.747400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32cca9e-899c-41c5-8a61-cbe4fe6bd5b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:43.748138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32cca9e-899c-41c5-8a61-cbe4fe6bd5b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:43.748570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32cca9e-899c-41c5-8a61-cbe4fe6bd5b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:43.888542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c32cca9e-899c-41c5-8a61-cbe4fe6bd5b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:43.897733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c32cca9e-899c-41c5-8a61-cbe4fe6bd5b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:43.899217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c32cca9e-899c-41c5-8a61-cbe4fe6bd5b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:43.900390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c32cca9e-899c-41c5-8a61-cbe4fe6bd5b7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.166831 Jul 25 19:48:43.900936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1169/2497] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:43 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:44.925611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-66031c31-c713-42c0-b4c9-e154b256659a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:44.926186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-66031c31-c713-42c0-b4c9-e154b256659a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:44.932722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66031c31-c713-42c0-b4c9-e154b256659a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:44.933173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66031c31-c713-42c0-b4c9-e154b256659a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:44.933944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66031c31-c713-42c0-b4c9-e154b256659a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:44.934385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66031c31-c713-42c0-b4c9-e154b256659a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:45.074263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-66031c31-c713-42c0-b4c9-e154b256659a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:45.083320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-66031c31-c713-42c0-b4c9-e154b256659a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:45.084843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-66031c31-c713-42c0-b4c9-e154b256659a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:45.086000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-66031c31-c713-42c0-b4c9-e154b256659a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.165149 Jul 25 19:48:45.086561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1329/2498] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:46.111569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-919ea300-f18f-46ad-895a-8326a31af87d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:46.112496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-919ea300-f18f-46ad-895a-8326a31af87d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:46.119453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-919ea300-f18f-46ad-895a-8326a31af87d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:46.119930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-919ea300-f18f-46ad-895a-8326a31af87d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:46.120822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-919ea300-f18f-46ad-895a-8326a31af87d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:46.121398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-919ea300-f18f-46ad-895a-8326a31af87d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:46.268274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-919ea300-f18f-46ad-895a-8326a31af87d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:46.277415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-919ea300-f18f-46ad-895a-8326a31af87d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:46.278951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-919ea300-f18f-46ad-895a-8326a31af87d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:46.280127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-919ea300-f18f-46ad-895a-8326a31af87d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.174163 Jul 25 19:48:46.280688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1170/2499] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:48:47.303406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cdf144f5-57fb-40bb-b62c-1f73aa42bb2e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:47.304019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cdf144f5-57fb-40bb-b62c-1f73aa42bb2e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:47.310374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdf144f5-57fb-40bb-b62c-1f73aa42bb2e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:47.310819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdf144f5-57fb-40bb-b62c-1f73aa42bb2e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:47.311723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdf144f5-57fb-40bb-b62c-1f73aa42bb2e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:47.312231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cdf144f5-57fb-40bb-b62c-1f73aa42bb2e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:47.450303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cdf144f5-57fb-40bb-b62c-1f73aa42bb2e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:47.459746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cdf144f5-57fb-40bb-b62c-1f73aa42bb2e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:47.461250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cdf144f5-57fb-40bb-b62c-1f73aa42bb2e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:47.462601 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cdf144f5-57fb-40bb-b62c-1f73aa42bb2e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.163284 Jul 25 19:48:47.463171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1330/2500] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:48.486777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c08d291-e036-4d2d-a3dd-1789b5880fad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:48.489143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c08d291-e036-4d2d-a3dd-1789b5880fad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:48.494289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c08d291-e036-4d2d-a3dd-1789b5880fad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:48.494738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c08d291-e036-4d2d-a3dd-1789b5880fad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:48.495546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c08d291-e036-4d2d-a3dd-1789b5880fad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:48.495976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c08d291-e036-4d2d-a3dd-1789b5880fad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:48.645475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c08d291-e036-4d2d-a3dd-1789b5880fad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:48.654106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c08d291-e036-4d2d-a3dd-1789b5880fad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:48.655648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c08d291-e036-4d2d-a3dd-1789b5880fad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:48.656885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c08d291-e036-4d2d-a3dd-1789b5880fad tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.174597 Jul 25 19:48:48.657675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1171/2501] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:48 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:49.680926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-65065519-46f3-4099-bc8d-4f164eae5c8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:49.681602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-65065519-46f3-4099-bc8d-4f164eae5c8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:49.688787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65065519-46f3-4099-bc8d-4f164eae5c8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:49.689421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65065519-46f3-4099-bc8d-4f164eae5c8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:49.690191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65065519-46f3-4099-bc8d-4f164eae5c8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:49.690619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65065519-46f3-4099-bc8d-4f164eae5c8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:49.829934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-65065519-46f3-4099-bc8d-4f164eae5c8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:49.839253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-65065519-46f3-4099-bc8d-4f164eae5c8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:49.840782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-65065519-46f3-4099-bc8d-4f164eae5c8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:49.841941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-65065519-46f3-4099-bc8d-4f164eae5c8a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.164924 Jul 25 19:48:49.842492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1331/2502] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:50.867050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-12eba883-c014-4527-bf08-eca5307ee6db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:50.867926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-12eba883-c014-4527-bf08-eca5307ee6db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:50.874735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12eba883-c014-4527-bf08-eca5307ee6db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:50.876166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12eba883-c014-4527-bf08-eca5307ee6db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:50.876945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12eba883-c014-4527-bf08-eca5307ee6db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:50.877376 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12eba883-c014-4527-bf08-eca5307ee6db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:51.025363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-12eba883-c014-4527-bf08-eca5307ee6db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:51.034981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-12eba883-c014-4527-bf08-eca5307ee6db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:51.036517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-12eba883-c014-4527-bf08-eca5307ee6db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:51.037683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-12eba883-c014-4527-bf08-eca5307ee6db tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.175496 Jul 25 19:48:51.038255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1172/2503] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:48:51.861749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-06f27a0a-c9ac-4330-8e8e-62b6ee7c3013 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:51.862617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-06f27a0a-c9ac-4330-8e8e-62b6ee7c3013 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:51.869835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06f27a0a-c9ac-4330-8e8e-62b6ee7c3013 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:51.870307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06f27a0a-c9ac-4330-8e8e-62b6ee7c3013 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:51.870973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06f27a0a-c9ac-4330-8e8e-62b6ee7c3013 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:51.871450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06f27a0a-c9ac-4330-8e8e-62b6ee7c3013 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:51.900032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-06f27a0a-c9ac-4330-8e8e-62b6ee7c3013 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Going to try to terminate instance {{(pid=117952) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:48:51.991985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-06f27a0a-c9ac-4330-8e8e-62b6ee7c3013 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 204 len: 0 microversion: 2.1 time: 0.134656 Jul 25 19:48:51.992773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1332/2504] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:48:51 2022] DELETE /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:48:52.001974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fdb550aa-3f68-463a-8411-46950e19946a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:52.002549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fdb550aa-3f68-463a-8411-46950e19946a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:52.008931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdb550aa-3f68-463a-8411-46950e19946a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:52.009376 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdb550aa-3f68-463a-8411-46950e19946a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:52.010144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdb550aa-3f68-463a-8411-46950e19946a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:52.010581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdb550aa-3f68-463a-8411-46950e19946a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:52.061612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b348bc89-a984-4f34-a2b6-d5bc127f1190 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:52.062305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b348bc89-a984-4f34-a2b6-d5bc127f1190 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:52.069923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b348bc89-a984-4f34-a2b6-d5bc127f1190 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:52.070373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b348bc89-a984-4f34-a2b6-d5bc127f1190 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:52.071158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b348bc89-a984-4f34-a2b6-d5bc127f1190 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:52.071615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b348bc89-a984-4f34-a2b6-d5bc127f1190 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:52.092706 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:48:52.208523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fdb550aa-3f68-463a-8411-46950e19946a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:52.216753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fdb550aa-3f68-463a-8411-46950e19946a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.219385 Jul 25 19:48:52.217336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1173/2505] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:51 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:52.247764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b348bc89-a984-4f34-a2b6-d5bc127f1190 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:52.256531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b348bc89-a984-4f34-a2b6-d5bc127f1190 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:52.258034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b348bc89-a984-4f34-a2b6-d5bc127f1190 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:52.259252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b348bc89-a984-4f34-a2b6-d5bc127f1190 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.201929 Jul 25 19:48:52.259863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1333/2506] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:52 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:48:53.240965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-597ac230-b676-4876-a93b-a847ba440427 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:53.241595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-597ac230-b676-4876-a93b-a847ba440427 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:53.248909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-597ac230-b676-4876-a93b-a847ba440427 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:53.249354 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-597ac230-b676-4876-a93b-a847ba440427 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:53.250117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-597ac230-b676-4876-a93b-a847ba440427 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:53.250548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-597ac230-b676-4876-a93b-a847ba440427 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:53.283480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4e031867-fa10-490b-b291-e026a1f045fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:53.284328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4e031867-fa10-490b-b291-e026a1f045fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:53.292391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e031867-fa10-490b-b291-e026a1f045fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:53.293032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e031867-fa10-490b-b291-e026a1f045fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:53.294417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e031867-fa10-490b-b291-e026a1f045fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:53.295111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e031867-fa10-490b-b291-e026a1f045fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:53.448450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-597ac230-b676-4876-a93b-a847ba440427 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:53.459490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-597ac230-b676-4876-a93b-a847ba440427 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.222837 Jul 25 19:48:53.460606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1174/2507] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:53 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:53.503641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e031867-fa10-490b-b291-e026a1f045fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:53.512759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e031867-fa10-490b-b291-e026a1f045fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:53.514253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e031867-fa10-490b-b291-e026a1f045fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:53.515417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4e031867-fa10-490b-b291-e026a1f045fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.236810 Jul 25 19:48:53.516200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1334/2508] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:48:54.481080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-71cb26ae-349e-477c-86e7-249be6e60340 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:54.481655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-71cb26ae-349e-477c-86e7-249be6e60340 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:54.489153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71cb26ae-349e-477c-86e7-249be6e60340 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:54.489592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71cb26ae-349e-477c-86e7-249be6e60340 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:54.490352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71cb26ae-349e-477c-86e7-249be6e60340 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:54.490779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71cb26ae-349e-477c-86e7-249be6e60340 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:54.540598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8096179f-c8b6-4796-823b-6631d89b3a4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:54.541391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8096179f-c8b6-4796-823b-6631d89b3a4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:54.548050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8096179f-c8b6-4796-823b-6631d89b3a4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:54.548539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8096179f-c8b6-4796-823b-6631d89b3a4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:54.549326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8096179f-c8b6-4796-823b-6631d89b3a4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:54.549769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8096179f-c8b6-4796-823b-6631d89b3a4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:54.694087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-71cb26ae-349e-477c-86e7-249be6e60340 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:54.704907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-71cb26ae-349e-477c-86e7-249be6e60340 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.227561 Jul 25 19:48:54.705516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1175/2509] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:54 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:54.741015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8096179f-c8b6-4796-823b-6631d89b3a4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:54.750039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8096179f-c8b6-4796-823b-6631d89b3a4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:54.752381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8096179f-c8b6-4796-823b-6631d89b3a4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:54.753574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8096179f-c8b6-4796-823b-6631d89b3a4c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.217476 Jul 25 19:48:54.754146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1335/2510] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:48:55.726808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e89ad808-ffc4-4971-b566-65c8a061be7b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:55.727646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e89ad808-ffc4-4971-b566-65c8a061be7b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:55.734187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e89ad808-ffc4-4971-b566-65c8a061be7b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:55.734772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e89ad808-ffc4-4971-b566-65c8a061be7b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:55.735617 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e89ad808-ffc4-4971-b566-65c8a061be7b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:55.736058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e89ad808-ffc4-4971-b566-65c8a061be7b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:55.778178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a7e73984-2fa9-4a9f-a2a0-cc7465283d27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:55.778816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a7e73984-2fa9-4a9f-a2a0-cc7465283d27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:55.786728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7e73984-2fa9-4a9f-a2a0-cc7465283d27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:55.787175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7e73984-2fa9-4a9f-a2a0-cc7465283d27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:55.787981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7e73984-2fa9-4a9f-a2a0-cc7465283d27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:55.788418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a7e73984-2fa9-4a9f-a2a0-cc7465283d27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:55.935203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e89ad808-ffc4-4971-b566-65c8a061be7b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:55.945082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e89ad808-ffc4-4971-b566-65c8a061be7b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.222389 Jul 25 19:48:55.945670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1176/2511] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:55 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:55.975621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a7e73984-2fa9-4a9f-a2a0-cc7465283d27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:55.987252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a7e73984-2fa9-4a9f-a2a0-cc7465283d27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:55.988711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a7e73984-2fa9-4a9f-a2a0-cc7465283d27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:55.989894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a7e73984-2fa9-4a9f-a2a0-cc7465283d27 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.215805 Jul 25 19:48:55.990467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1336/2512] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:48:56.970115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-746acefa-271d-4849-bfea-ef1345784959 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:56.970949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-746acefa-271d-4849-bfea-ef1345784959 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:56.977374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-746acefa-271d-4849-bfea-ef1345784959 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:56.977823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-746acefa-271d-4849-bfea-ef1345784959 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:56.978598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-746acefa-271d-4849-bfea-ef1345784959 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:56.979038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-746acefa-271d-4849-bfea-ef1345784959 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:57.016186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-68a6b812-8ebb-4f6b-a2ed-207b8d8dafd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:57.017293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-68a6b812-8ebb-4f6b-a2ed-207b8d8dafd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:57.026228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68a6b812-8ebb-4f6b-a2ed-207b8d8dafd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:57.026766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68a6b812-8ebb-4f6b-a2ed-207b8d8dafd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:57.030553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68a6b812-8ebb-4f6b-a2ed-207b8d8dafd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:57.030553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-68a6b812-8ebb-4f6b-a2ed-207b8d8dafd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:57.195796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-746acefa-271d-4849-bfea-ef1345784959 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:57.207835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-746acefa-271d-4849-bfea-ef1345784959 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.242674 Jul 25 19:48:57.208603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1177/2513] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:56 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:48:57.228540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-68a6b812-8ebb-4f6b-a2ed-207b8d8dafd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:57.243259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-68a6b812-8ebb-4f6b-a2ed-207b8d8dafd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:57.245930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-68a6b812-8ebb-4f6b-a2ed-207b8d8dafd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:57.247897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-68a6b812-8ebb-4f6b-a2ed-207b8d8dafd7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.236806 Jul 25 19:48:57.248883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1337/2514] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:48:58.233031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8913fcd-34d0-477d-a098-dede01ae9a07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:58.233739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8913fcd-34d0-477d-a098-dede01ae9a07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:58.249372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8913fcd-34d0-477d-a098-dede01ae9a07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:58.250355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8913fcd-34d0-477d-a098-dede01ae9a07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:58.251290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8913fcd-34d0-477d-a098-dede01ae9a07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:58.251759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8913fcd-34d0-477d-a098-dede01ae9a07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:58.276916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-538adb64-f2fb-452e-ae01-fa818aeefc5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:58.278041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-538adb64-f2fb-452e-ae01-fa818aeefc5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:58.289702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-538adb64-f2fb-452e-ae01-fa818aeefc5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:58.290577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-538adb64-f2fb-452e-ae01-fa818aeefc5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:58.291998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-538adb64-f2fb-452e-ae01-fa818aeefc5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:58.292551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-538adb64-f2fb-452e-ae01-fa818aeefc5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:58.466516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a8913fcd-34d0-477d-a098-dede01ae9a07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:58.475150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8913fcd-34d0-477d-a098-dede01ae9a07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.246126 Jul 25 19:48:58.475953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1178/2515] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:58 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:58.507773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-538adb64-f2fb-452e-ae01-fa818aeefc5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:58.520694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-538adb64-f2fb-452e-ae01-fa818aeefc5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:58.522751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-538adb64-f2fb-452e-ae01-fa818aeefc5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:58.523972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-538adb64-f2fb-452e-ae01-fa818aeefc5d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.254164 Jul 25 19:48:58.524546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1338/2516] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:48:59.498342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-63a3c4fa-e3ab-40e5-86a3-17c82106c660 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:59.498923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-63a3c4fa-e3ab-40e5-86a3-17c82106c660 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:59.506760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63a3c4fa-e3ab-40e5-86a3-17c82106c660 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:59.507207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63a3c4fa-e3ab-40e5-86a3-17c82106c660 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:59.508003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63a3c4fa-e3ab-40e5-86a3-17c82106c660 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:59.508439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63a3c4fa-e3ab-40e5-86a3-17c82106c660 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:59.548635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6ea446fa-75aa-4046-875c-f8bd3b36126e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:48:59.549687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6ea446fa-75aa-4046-875c-f8bd3b36126e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:48:59.556638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ea446fa-75aa-4046-875c-f8bd3b36126e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:59.557075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ea446fa-75aa-4046-875c-f8bd3b36126e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:59.557850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ea446fa-75aa-4046-875c-f8bd3b36126e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:48:59.558283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ea446fa-75aa-4046-875c-f8bd3b36126e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:48:59.707176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-63a3c4fa-e3ab-40e5-86a3-17c82106c660 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:59.716476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-63a3c4fa-e3ab-40e5-86a3-17c82106c660 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.221963 Jul 25 19:48:59.717280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1179/2517] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:48:59 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:48:59.741948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6ea446fa-75aa-4046-875c-f8bd3b36126e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:59.751743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6ea446fa-75aa-4046-875c-f8bd3b36126e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:59.753141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6ea446fa-75aa-4046-875c-f8bd3b36126e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:48:59.754312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6ea446fa-75aa-4046-875c-f8bd3b36126e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.210258 Jul 25 19:48:59.754879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1339/2518] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:48:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:00.740979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0076ad89-159b-4b2a-98bb-2405c30f18d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:00.741973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0076ad89-159b-4b2a-98bb-2405c30f18d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:00.748794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0076ad89-159b-4b2a-98bb-2405c30f18d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:00.749230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0076ad89-159b-4b2a-98bb-2405c30f18d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:00.750028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0076ad89-159b-4b2a-98bb-2405c30f18d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:00.750458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0076ad89-159b-4b2a-98bb-2405c30f18d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:00.774239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:49:00.778412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5f808e95-902c-492c-b118-00f542a9b87a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:00.779175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5f808e95-902c-492c-b118-00f542a9b87a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:00.786639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f808e95-902c-492c-b118-00f542a9b87a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:00.787087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f808e95-902c-492c-b118-00f542a9b87a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:00.787884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f808e95-902c-492c-b118-00f542a9b87a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:00.788382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f808e95-902c-492c-b118-00f542a9b87a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:00.969630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0076ad89-159b-4b2a-98bb-2405c30f18d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:00.978085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0076ad89-159b-4b2a-98bb-2405c30f18d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.243195 Jul 25 19:49:00.978717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1180/2519] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:00 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:00.982111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5f808e95-902c-492c-b118-00f542a9b87a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:00.992003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5f808e95-902c-492c-b118-00f542a9b87a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:00.993508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5f808e95-902c-492c-b118-00f542a9b87a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:00.994672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5f808e95-902c-492c-b118-00f542a9b87a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.220360 Jul 25 19:49:00.995236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1340/2520] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:01.999505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-54bb8ffc-f81f-4f32-9767-a578a3c3d837 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:02.000302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-54bb8ffc-f81f-4f32-9767-a578a3c3d837 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:02.007020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54bb8ffc-f81f-4f32-9767-a578a3c3d837 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:02.007461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54bb8ffc-f81f-4f32-9767-a578a3c3d837 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:02.008249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54bb8ffc-f81f-4f32-9767-a578a3c3d837 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:02.008684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54bb8ffc-f81f-4f32-9767-a578a3c3d837 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:02.018603 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-96c2c583-0e11-4d45-82c9-1e376a0abbc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:02.019533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-96c2c583-0e11-4d45-82c9-1e376a0abbc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:02.027820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96c2c583-0e11-4d45-82c9-1e376a0abbc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:02.027820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96c2c583-0e11-4d45-82c9-1e376a0abbc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:02.027820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96c2c583-0e11-4d45-82c9-1e376a0abbc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:02.031951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96c2c583-0e11-4d45-82c9-1e376a0abbc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:02.488017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-54bb8ffc-f81f-4f32-9767-a578a3c3d837 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:02.495811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-96c2c583-0e11-4d45-82c9-1e376a0abbc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:02.496246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-54bb8ffc-f81f-4f32-9767-a578a3c3d837 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.500586 Jul 25 19:49:02.496835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1181/2521] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:01 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:02.505444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-96c2c583-0e11-4d45-82c9-1e376a0abbc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:02.506944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-96c2c583-0e11-4d45-82c9-1e376a0abbc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:02.508131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-96c2c583-0e11-4d45-82c9-1e376a0abbc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.493678 Jul 25 19:49:02.508695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1341/2522] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:03.518852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81ca53b0-6dd1-4b07-8500-2bb2f8f80df1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:03.519442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81ca53b0-6dd1-4b07-8500-2bb2f8f80df1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:03.525756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81ca53b0-6dd1-4b07-8500-2bb2f8f80df1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:03.526197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81ca53b0-6dd1-4b07-8500-2bb2f8f80df1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:03.526951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81ca53b0-6dd1-4b07-8500-2bb2f8f80df1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:03.527378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81ca53b0-6dd1-4b07-8500-2bb2f8f80df1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:03.530622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-33e98633-f795-437b-a84c-ae5e34c37b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:03.532015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-33e98633-f795-437b-a84c-ae5e34c37b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:03.539065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33e98633-f795-437b-a84c-ae5e34c37b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:03.539538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33e98633-f795-437b-a84c-ae5e34c37b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:03.540321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33e98633-f795-437b-a84c-ae5e34c37b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:03.540763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33e98633-f795-437b-a84c-ae5e34c37b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:03.742254 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-81ca53b0-6dd1-4b07-8500-2bb2f8f80df1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:03.746565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-33e98633-f795-437b-a84c-ae5e34c37b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:03.750713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81ca53b0-6dd1-4b07-8500-2bb2f8f80df1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.236223 Jul 25 19:49:03.751311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1182/2523] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:03 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:03.758238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-33e98633-f795-437b-a84c-ae5e34c37b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:03.759775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-33e98633-f795-437b-a84c-ae5e34c37b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:03.760974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-33e98633-f795-437b-a84c-ae5e34c37b3d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.234480 Jul 25 19:49:03.761532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1342/2524] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:04.774771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-910eb3c4-e259-4d0d-8b3a-a1073f8b54e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:04.775714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-910eb3c4-e259-4d0d-8b3a-a1073f8b54e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:04.784983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-910eb3c4-e259-4d0d-8b3a-a1073f8b54e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:04.785498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-910eb3c4-e259-4d0d-8b3a-a1073f8b54e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:04.786284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-910eb3c4-e259-4d0d-8b3a-a1073f8b54e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:04.786868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-910eb3c4-e259-4d0d-8b3a-a1073f8b54e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:04.791840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-12c38350-9554-46f8-a2b3-88d52a5719c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:04.792573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-12c38350-9554-46f8-a2b3-88d52a5719c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:04.810420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-12c38350-9554-46f8-a2b3-88d52a5719c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:04.810420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-12c38350-9554-46f8-a2b3-88d52a5719c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:04.810420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-12c38350-9554-46f8-a2b3-88d52a5719c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:04.810420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-12c38350-9554-46f8-a2b3-88d52a5719c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:05.024027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-910eb3c4-e259-4d0d-8b3a-a1073f8b54e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:05.033091 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-910eb3c4-e259-4d0d-8b3a-a1073f8b54e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.264736 Jul 25 19:49:05.033678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1183/2525] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:04 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:05.036393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-12c38350-9554-46f8-a2b3-88d52a5719c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:05.048933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-12c38350-9554-46f8-a2b3-88d52a5719c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:05.050446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-12c38350-9554-46f8-a2b3-88d52a5719c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:05.051650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-12c38350-9554-46f8-a2b3-88d52a5719c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.268453 Jul 25 19:49:05.052224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1343/2526] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:06.057663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af7608ef-f558-4ebe-b65e-ffd35eda51fc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:06.058316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af7608ef-f558-4ebe-b65e-ffd35eda51fc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:06.066664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af7608ef-f558-4ebe-b65e-ffd35eda51fc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:06.067119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af7608ef-f558-4ebe-b65e-ffd35eda51fc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:06.068246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af7608ef-f558-4ebe-b65e-ffd35eda51fc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:06.068693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af7608ef-f558-4ebe-b65e-ffd35eda51fc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:06.078456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-33b5a0e1-bcba-446d-959e-21115c452694 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:06.079178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-33b5a0e1-bcba-446d-959e-21115c452694 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:06.087098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33b5a0e1-bcba-446d-959e-21115c452694 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:06.087566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33b5a0e1-bcba-446d-959e-21115c452694 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:06.088369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33b5a0e1-bcba-446d-959e-21115c452694 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:06.088777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-33b5a0e1-bcba-446d-959e-21115c452694 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:06.283858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-af7608ef-f558-4ebe-b65e-ffd35eda51fc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:06.292155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af7608ef-f558-4ebe-b65e-ffd35eda51fc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.238473 Jul 25 19:49:06.292759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1184/2527] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:06 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:06.299125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-33b5a0e1-bcba-446d-959e-21115c452694 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:06.308345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-33b5a0e1-bcba-446d-959e-21115c452694 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:06.309800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-33b5a0e1-bcba-446d-959e-21115c452694 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:06.310958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-33b5a0e1-bcba-446d-959e-21115c452694 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.237007 Jul 25 19:49:06.311539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1344/2528] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:06 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:07.314156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-37f934b6-3c54-4996-a90e-4521911104b1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:07.314993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-37f934b6-3c54-4996-a90e-4521911104b1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:07.323273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37f934b6-3c54-4996-a90e-4521911104b1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:07.323753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37f934b6-3c54-4996-a90e-4521911104b1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:07.324528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37f934b6-3c54-4996-a90e-4521911104b1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:07.324962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37f934b6-3c54-4996-a90e-4521911104b1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:07.335582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-218d684b-86d5-48f5-8455-fc3bde87bbcf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:07.336265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-218d684b-86d5-48f5-8455-fc3bde87bbcf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:07.342981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-218d684b-86d5-48f5-8455-fc3bde87bbcf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:07.344039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-218d684b-86d5-48f5-8455-fc3bde87bbcf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:07.344994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-218d684b-86d5-48f5-8455-fc3bde87bbcf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:07.345520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-218d684b-86d5-48f5-8455-fc3bde87bbcf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:07.556564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37f934b6-3c54-4996-a90e-4521911104b1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:07.566398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-37f934b6-3c54-4996-a90e-4521911104b1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.256603 Jul 25 19:49:07.567004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1185/2529] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:07 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:07.577162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-218d684b-86d5-48f5-8455-fc3bde87bbcf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:07.588679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-218d684b-86d5-48f5-8455-fc3bde87bbcf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:07.590429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-218d684b-86d5-48f5-8455-fc3bde87bbcf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:07.591680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-218d684b-86d5-48f5-8455-fc3bde87bbcf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.260143 Jul 25 19:49:07.592257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1345/2530] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:08.590662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-596c067e-946d-4f0c-acc2-867b8914ca49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:08.591234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-596c067e-946d-4f0c-acc2-867b8914ca49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:08.598558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-596c067e-946d-4f0c-acc2-867b8914ca49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:08.599003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-596c067e-946d-4f0c-acc2-867b8914ca49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:08.599802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-596c067e-946d-4f0c-acc2-867b8914ca49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:08.600358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-596c067e-946d-4f0c-acc2-867b8914ca49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:08.617247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1d098dee-ccc5-48f1-9fe9-47180b5bb798 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:08.617891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1d098dee-ccc5-48f1-9fe9-47180b5bb798 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:08.625483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d098dee-ccc5-48f1-9fe9-47180b5bb798 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:08.625845 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d098dee-ccc5-48f1-9fe9-47180b5bb798 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:08.626634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d098dee-ccc5-48f1-9fe9-47180b5bb798 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:08.627106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1d098dee-ccc5-48f1-9fe9-47180b5bb798 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:08.820401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-596c067e-946d-4f0c-acc2-867b8914ca49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:08.824984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1d098dee-ccc5-48f1-9fe9-47180b5bb798 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:08.834267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-596c067e-946d-4f0c-acc2-867b8914ca49 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.247262 Jul 25 19:49:08.834688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1d098dee-ccc5-48f1-9fe9-47180b5bb798 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:08.835375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1186/2531] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:08 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:08.836215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1d098dee-ccc5-48f1-9fe9-47180b5bb798 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:08.837402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1d098dee-ccc5-48f1-9fe9-47180b5bb798 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.224636 Jul 25 19:49:08.837956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1346/2532] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:09.858028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5122cb04-075e-4624-ab74-d18cf5d3d2eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:09.858658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5122cb04-075e-4624-ab74-d18cf5d3d2eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:09.860889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b7d31829-7d44-447b-8fdc-9f367189eaca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:09.861783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b7d31829-7d44-447b-8fdc-9f367189eaca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:09.866002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5122cb04-075e-4624-ab74-d18cf5d3d2eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:09.866454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5122cb04-075e-4624-ab74-d18cf5d3d2eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:09.867263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5122cb04-075e-4624-ab74-d18cf5d3d2eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:09.867749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5122cb04-075e-4624-ab74-d18cf5d3d2eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:09.868994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7d31829-7d44-447b-8fdc-9f367189eaca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:09.869445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7d31829-7d44-447b-8fdc-9f367189eaca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:09.870217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7d31829-7d44-447b-8fdc-9f367189eaca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:09.870653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7d31829-7d44-447b-8fdc-9f367189eaca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:10.092602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5122cb04-075e-4624-ab74-d18cf5d3d2eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:10.100221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b7d31829-7d44-447b-8fdc-9f367189eaca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:10.101163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5122cb04-075e-4624-ab74-d18cf5d3d2eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.247502 Jul 25 19:49:10.101738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1187/2533] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:09 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:10.109838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b7d31829-7d44-447b-8fdc-9f367189eaca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:10.111309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b7d31829-7d44-447b-8fdc-9f367189eaca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:10.112776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b7d31829-7d44-447b-8fdc-9f367189eaca tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.256480 Jul 25 19:49:10.113331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1347/2534] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:11.138130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-336f443d-78ec-485e-9e6d-fa4e7965b0f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:11.138821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-336f443d-78ec-485e-9e6d-fa4e7965b0f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:11.146739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-336f443d-78ec-485e-9e6d-fa4e7965b0f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:11.147192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-336f443d-78ec-485e-9e6d-fa4e7965b0f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:11.148051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-336f443d-78ec-485e-9e6d-fa4e7965b0f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:11.148497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-336f443d-78ec-485e-9e6d-fa4e7965b0f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:11.276413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66582a19-3d2f-4084-8a9b-d93dc632513a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:11.277122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66582a19-3d2f-4084-8a9b-d93dc632513a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:11.285145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66582a19-3d2f-4084-8a9b-d93dc632513a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:11.285592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66582a19-3d2f-4084-8a9b-d93dc632513a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:11.286378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66582a19-3d2f-4084-8a9b-d93dc632513a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:11.286813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66582a19-3d2f-4084-8a9b-d93dc632513a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:11.325527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-336f443d-78ec-485e-9e6d-fa4e7965b0f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:11.336100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-336f443d-78ec-485e-9e6d-fa4e7965b0f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:11.337599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-336f443d-78ec-485e-9e6d-fa4e7965b0f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:11.338787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-336f443d-78ec-485e-9e6d-fa4e7965b0f8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.204725 Jul 25 19:49:11.339679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1348/2535] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:11.430636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66582a19-3d2f-4084-8a9b-d93dc632513a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:11.439043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66582a19-3d2f-4084-8a9b-d93dc632513a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.318478 Jul 25 19:49:11.439718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1188/2536] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:11 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:12.367000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-161c8f43-2097-49ae-adfe-d5177e0ad7a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:12.367652 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-161c8f43-2097-49ae-adfe-d5177e0ad7a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:12.374889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-161c8f43-2097-49ae-adfe-d5177e0ad7a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:12.375335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-161c8f43-2097-49ae-adfe-d5177e0ad7a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:12.376279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-161c8f43-2097-49ae-adfe-d5177e0ad7a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:12.376848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-161c8f43-2097-49ae-adfe-d5177e0ad7a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:12.460400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-35ab20e1-f774-40cb-993b-247dc88bdcea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:12.460956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-35ab20e1-f774-40cb-993b-247dc88bdcea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:12.469170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35ab20e1-f774-40cb-993b-247dc88bdcea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:12.469651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35ab20e1-f774-40cb-993b-247dc88bdcea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:12.470413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35ab20e1-f774-40cb-993b-247dc88bdcea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:12.471099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35ab20e1-f774-40cb-993b-247dc88bdcea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:12.569614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-161c8f43-2097-49ae-adfe-d5177e0ad7a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:12.583462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-161c8f43-2097-49ae-adfe-d5177e0ad7a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:12.586596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-161c8f43-2097-49ae-adfe-d5177e0ad7a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:12.588883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-161c8f43-2097-49ae-adfe-d5177e0ad7a0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.225479 Jul 25 19:49:12.590265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1349/2537] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:12.644810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-35ab20e1-f774-40cb-993b-247dc88bdcea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:12.653570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-35ab20e1-f774-40cb-993b-247dc88bdcea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.197205 Jul 25 19:49:12.654317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1189/2538] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:12 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:49:13.614999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b6907db8-8a35-4bcc-aafb-b9442891f508 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:13.615644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b6907db8-8a35-4bcc-aafb-b9442891f508 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:13.618098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:49:13.625849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6907db8-8a35-4bcc-aafb-b9442891f508 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:13.626299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6907db8-8a35-4bcc-aafb-b9442891f508 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:13.627357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6907db8-8a35-4bcc-aafb-b9442891f508 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:13.627822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b6907db8-8a35-4bcc-aafb-b9442891f508 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:13.634501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:49:13.676976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9020eea4-0477-403b-bc2d-c589570ff095 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:13.677621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9020eea4-0477-403b-bc2d-c589570ff095 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:13.685131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9020eea4-0477-403b-bc2d-c589570ff095 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:13.686192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9020eea4-0477-403b-bc2d-c589570ff095 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:13.686967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9020eea4-0477-403b-bc2d-c589570ff095 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:13.687445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9020eea4-0477-403b-bc2d-c589570ff095 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:13.836376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b6907db8-8a35-4bcc-aafb-b9442891f508 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:13.846436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b6907db8-8a35-4bcc-aafb-b9442891f508 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:13.848252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b6907db8-8a35-4bcc-aafb-b9442891f508 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:13.849435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b6907db8-8a35-4bcc-aafb-b9442891f508 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.239011 Jul 25 19:49:13.850047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1350/2539] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:13.876881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9020eea4-0477-403b-bc2d-c589570ff095 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:13.887023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9020eea4-0477-403b-bc2d-c589570ff095 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.214016 Jul 25 19:49:13.887628 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1190/2540] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:13 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:14.877586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d8dd1bdb-c82f-4f1c-806e-38f96c8de0ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:14.878448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d8dd1bdb-c82f-4f1c-806e-38f96c8de0ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:14.886055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8dd1bdb-c82f-4f1c-806e-38f96c8de0ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:14.886499 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8dd1bdb-c82f-4f1c-806e-38f96c8de0ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:14.887266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8dd1bdb-c82f-4f1c-806e-38f96c8de0ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:14.887729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8dd1bdb-c82f-4f1c-806e-38f96c8de0ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:14.908584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1f5da8fc-0b8f-4981-a2af-e82eadc172a0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:14.909212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1f5da8fc-0b8f-4981-a2af-e82eadc172a0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:14.911654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=44 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:49:14.917430 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f5da8fc-0b8f-4981-a2af-e82eadc172a0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:14.917871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f5da8fc-0b8f-4981-a2af-e82eadc172a0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:14.918655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f5da8fc-0b8f-4981-a2af-e82eadc172a0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:14.919072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1f5da8fc-0b8f-4981-a2af-e82eadc172a0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:15.104707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d8dd1bdb-c82f-4f1c-806e-38f96c8de0ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:15.115101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d8dd1bdb-c82f-4f1c-806e-38f96c8de0ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:15.116831 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d8dd1bdb-c82f-4f1c-806e-38f96c8de0ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:15.118102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d8dd1bdb-c82f-4f1c-806e-38f96c8de0ab tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.245471 Jul 25 19:49:15.118242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1f5da8fc-0b8f-4981-a2af-e82eadc172a0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:15.118898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1351/2541] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:15.135993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1f5da8fc-0b8f-4981-a2af-e82eadc172a0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.231144 Jul 25 19:49:15.136512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1191/2542] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:14 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:49:16.144020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eee220ab-eb77-445a-a237-87646955e6f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:16.144661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eee220ab-eb77-445a-a237-87646955e6f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:16.150968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eee220ab-eb77-445a-a237-87646955e6f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:16.151449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eee220ab-eb77-445a-a237-87646955e6f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:16.152252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eee220ab-eb77-445a-a237-87646955e6f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:16.152685 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eee220ab-eb77-445a-a237-87646955e6f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:16.159375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-07871c60-9352-4e37-854e-e452416ce485 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:16.160133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-07871c60-9352-4e37-854e-e452416ce485 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:16.166958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07871c60-9352-4e37-854e-e452416ce485 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:16.167400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07871c60-9352-4e37-854e-e452416ce485 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:16.168246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07871c60-9352-4e37-854e-e452416ce485 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:16.168690 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07871c60-9352-4e37-854e-e452416ce485 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:16.373636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07871c60-9352-4e37-854e-e452416ce485 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:16.382019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-07871c60-9352-4e37-854e-e452416ce485 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.227210 Jul 25 19:49:16.382624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1192/2543] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:16 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:49:16.383269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eee220ab-eb77-445a-a237-87646955e6f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:16.394142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eee220ab-eb77-445a-a237-87646955e6f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:16.395568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eee220ab-eb77-445a-a237-87646955e6f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:16.396747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eee220ab-eb77-445a-a237-87646955e6f6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.258328 Jul 25 19:49:16.397314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1352/2544] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:17.404989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b9811f28-ed88-4489-9327-916c725dd207 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:17.405671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b9811f28-ed88-4489-9327-916c725dd207 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:17.413008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9811f28-ed88-4489-9327-916c725dd207 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:17.413611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9811f28-ed88-4489-9327-916c725dd207 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:17.414236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9811f28-ed88-4489-9327-916c725dd207 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:17.414678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9811f28-ed88-4489-9327-916c725dd207 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:17.422680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-84763cb0-7b4f-4639-9e01-a121075f9fb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:17.423231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-84763cb0-7b4f-4639-9e01-a121075f9fb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:17.430557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84763cb0-7b4f-4639-9e01-a121075f9fb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:17.432017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84763cb0-7b4f-4639-9e01-a121075f9fb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:17.432808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84763cb0-7b4f-4639-9e01-a121075f9fb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:17.433250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84763cb0-7b4f-4639-9e01-a121075f9fb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:17.635119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9811f28-ed88-4489-9327-916c725dd207 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:17.646142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b9811f28-ed88-4489-9327-916c725dd207 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.246441 Jul 25 19:49:17.647032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1193/2545] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:17 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:49:17.648415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-84763cb0-7b4f-4639-9e01-a121075f9fb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:17.657442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-84763cb0-7b4f-4639-9e01-a121075f9fb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:17.659039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-84763cb0-7b4f-4639-9e01-a121075f9fb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:17.660248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-84763cb0-7b4f-4639-9e01-a121075f9fb7 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.242416 Jul 25 19:49:17.660857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1353/2546] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:18.029836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ed5cb90d-ea10-4d4b-8799-8d5ba8c59073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:18.030327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ed5cb90d-ea10-4d4b-8799-8d5ba8c59073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:18.037671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed5cb90d-ea10-4d4b-8799-8d5ba8c59073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:18.038125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed5cb90d-ea10-4d4b-8799-8d5ba8c59073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:18.038896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed5cb90d-ea10-4d4b-8799-8d5ba8c59073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:18.039334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed5cb90d-ea10-4d4b-8799-8d5ba8c59073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:18.063665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ed5cb90d-ea10-4d4b-8799-8d5ba8c59073 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30/ips" status: 200 len: 149 microversion: 2.1 time: 0.037610 Jul 25 19:49:18.064259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1194/2547] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Jul 25 19:49:18 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:49:18.672730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9def32d3-ceed-4e5e-bc08-b1e2be94c0cf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:18.673487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9def32d3-ceed-4e5e-bc08-b1e2be94c0cf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:18.683379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9def32d3-ceed-4e5e-bc08-b1e2be94c0cf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:18.684255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9def32d3-ceed-4e5e-bc08-b1e2be94c0cf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:18.684555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b9cdb2b9-71fc-4497-80c7-62604f868e69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:18.685166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b9cdb2b9-71fc-4497-80c7-62604f868e69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:18.685391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9def32d3-ceed-4e5e-bc08-b1e2be94c0cf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:18.685995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9def32d3-ceed-4e5e-bc08-b1e2be94c0cf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:18.692384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9cdb2b9-71fc-4497-80c7-62604f868e69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:18.692862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9cdb2b9-71fc-4497-80c7-62604f868e69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:18.693629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9cdb2b9-71fc-4497-80c7-62604f868e69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:18.694060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9cdb2b9-71fc-4497-80c7-62604f868e69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:18.916607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9def32d3-ceed-4e5e-bc08-b1e2be94c0cf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:18.923931 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9cdb2b9-71fc-4497-80c7-62604f868e69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:18.927012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9def32d3-ceed-4e5e-bc08-b1e2be94c0cf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.258551 Jul 25 19:49:18.927637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1354/2548] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:18 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:18.933219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9cdb2b9-71fc-4497-80c7-62604f868e69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:18.934702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9cdb2b9-71fc-4497-80c7-62604f868e69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:18.935891 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b9cdb2b9-71fc-4497-80c7-62604f868e69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.255811 Jul 25 19:49:18.936455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1195/2549] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:19.949853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-527befae-bd39-4b0a-8575-9eca24206ded tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:19.950745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-527befae-bd39-4b0a-8575-9eca24206ded tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:19.960014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-527befae-bd39-4b0a-8575-9eca24206ded tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:19.960682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-527befae-bd39-4b0a-8575-9eca24206ded tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:19.961600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-527befae-bd39-4b0a-8575-9eca24206ded tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:19.962043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-527befae-bd39-4b0a-8575-9eca24206ded tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:19.963072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5644f7a-c9c7-43f2-a9ca-a3248ae62505 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:19.964206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d5644f7a-c9c7-43f2-a9ca-a3248ae62505 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:19.973372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5644f7a-c9c7-43f2-a9ca-a3248ae62505 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:19.973859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5644f7a-c9c7-43f2-a9ca-a3248ae62505 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:19.975000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5644f7a-c9c7-43f2-a9ca-a3248ae62505 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:19.975656 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5644f7a-c9c7-43f2-a9ca-a3248ae62505 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:20.216627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-527befae-bd39-4b0a-8575-9eca24206ded tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:20.225986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-527befae-bd39-4b0a-8575-9eca24206ded tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.280268 Jul 25 19:49:20.226575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1355/2550] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:19 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:20.231862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5644f7a-c9c7-43f2-a9ca-a3248ae62505 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:20.244817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5644f7a-c9c7-43f2-a9ca-a3248ae62505 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:20.246436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5644f7a-c9c7-43f2-a9ca-a3248ae62505 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:20.247873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d5644f7a-c9c7-43f2-a9ca-a3248ae62505 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.290820 Jul 25 19:49:20.248352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1196/2551] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:21.265667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fa8c7927-428d-493e-85d1-da1be69bd2f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:21.267259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fa8c7927-428d-493e-85d1-da1be69bd2f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:21.278282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa8c7927-428d-493e-85d1-da1be69bd2f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:21.278739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa8c7927-428d-493e-85d1-da1be69bd2f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:21.279539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa8c7927-428d-493e-85d1-da1be69bd2f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:21.279714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-09b1e504-b19e-4ab5-ab83-b36863baf615 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:21.280318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa8c7927-428d-493e-85d1-da1be69bd2f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:21.281253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-09b1e504-b19e-4ab5-ab83-b36863baf615 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:21.292887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09b1e504-b19e-4ab5-ab83-b36863baf615 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:21.293705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09b1e504-b19e-4ab5-ab83-b36863baf615 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:21.295038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09b1e504-b19e-4ab5-ab83-b36863baf615 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:21.295904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09b1e504-b19e-4ab5-ab83-b36863baf615 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:21.324043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:49:21.528177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fa8c7927-428d-493e-85d1-da1be69bd2f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:21.538620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-09b1e504-b19e-4ab5-ab83-b36863baf615 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:21.542833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fa8c7927-428d-493e-85d1-da1be69bd2f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.282266 Jul 25 19:49:21.543952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1356/2552] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:21 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:21.551704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-09b1e504-b19e-4ab5-ab83-b36863baf615 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:21.553452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-09b1e504-b19e-4ab5-ab83-b36863baf615 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:21.554642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-09b1e504-b19e-4ab5-ab83-b36863baf615 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.284175 Jul 25 19:49:21.555226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1197/2553] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:22.566457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-256c016d-7c95-465d-92cf-60b60929e822 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:22.567086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-256c016d-7c95-465d-92cf-60b60929e822 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:22.574142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-256c016d-7c95-465d-92cf-60b60929e822 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:22.574591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-256c016d-7c95-465d-92cf-60b60929e822 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:22.575400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-256c016d-7c95-465d-92cf-60b60929e822 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:22.575861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-256c016d-7c95-465d-92cf-60b60929e822 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:22.579255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd01147e-2f01-486a-9d1b-9761daee32f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:22.579971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd01147e-2f01-486a-9d1b-9761daee32f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:22.586859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd01147e-2f01-486a-9d1b-9761daee32f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:22.587316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd01147e-2f01-486a-9d1b-9761daee32f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:22.588130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd01147e-2f01-486a-9d1b-9761daee32f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:22.588591 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd01147e-2f01-486a-9d1b-9761daee32f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:22.791897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-256c016d-7c95-465d-92cf-60b60929e822 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:22.801311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-256c016d-7c95-465d-92cf-60b60929e822 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.239529 Jul 25 19:49:22.801917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1357/2554] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:22 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:22.804398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd01147e-2f01-486a-9d1b-9761daee32f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:22.815534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd01147e-2f01-486a-9d1b-9761daee32f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:22.817131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd01147e-2f01-486a-9d1b-9761daee32f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:22.818247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd01147e-2f01-486a-9d1b-9761daee32f2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.243494 Jul 25 19:49:22.818903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1198/2555] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:23.824324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e814068a-62ed-4803-a871-d9db723068df tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:23.824927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e814068a-62ed-4803-a871-d9db723068df tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:23.834474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e814068a-62ed-4803-a871-d9db723068df tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:23.835001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e814068a-62ed-4803-a871-d9db723068df tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:23.835919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e814068a-62ed-4803-a871-d9db723068df tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:23.836623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e814068a-62ed-4803-a871-d9db723068df tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:23.842250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e5b49810-2a36-4bf4-9f18-59bd9a2019c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:23.843417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e5b49810-2a36-4bf4-9f18-59bd9a2019c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:23.850425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5b49810-2a36-4bf4-9f18-59bd9a2019c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:23.850879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5b49810-2a36-4bf4-9f18-59bd9a2019c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:23.851699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5b49810-2a36-4bf4-9f18-59bd9a2019c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:23.852145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5b49810-2a36-4bf4-9f18-59bd9a2019c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:24.055447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e5b49810-2a36-4bf4-9f18-59bd9a2019c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:24.058725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e814068a-62ed-4803-a871-d9db723068df tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:24.064582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e5b49810-2a36-4bf4-9f18-59bd9a2019c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:24.066779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e5b49810-2a36-4bf4-9f18-59bd9a2019c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:24.067460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e814068a-62ed-4803-a871-d9db723068df tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.246902 Jul 25 19:49:24.068093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1358/2556] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:23 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:24.068436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e5b49810-2a36-4bf4-9f18-59bd9a2019c9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.229954 Jul 25 19:49:24.069087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1199/2557] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:25.102277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-70c8bcd7-8f77-4e5f-b91a-c10ed2a62e2b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:25.102930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-70c8bcd7-8f77-4e5f-b91a-c10ed2a62e2b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:25.105260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6859bedc-d7f9-44ea-8ce4-12d99758f138 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:25.105867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6859bedc-d7f9-44ea-8ce4-12d99758f138 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:25.110592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70c8bcd7-8f77-4e5f-b91a-c10ed2a62e2b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:25.111045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70c8bcd7-8f77-4e5f-b91a-c10ed2a62e2b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:25.111862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70c8bcd7-8f77-4e5f-b91a-c10ed2a62e2b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:25.112559 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-70c8bcd7-8f77-4e5f-b91a-c10ed2a62e2b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:25.121886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6859bedc-d7f9-44ea-8ce4-12d99758f138 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:25.122453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6859bedc-d7f9-44ea-8ce4-12d99758f138 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:25.123291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6859bedc-d7f9-44ea-8ce4-12d99758f138 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:25.123770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6859bedc-d7f9-44ea-8ce4-12d99758f138 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:25.326962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-70c8bcd7-8f77-4e5f-b91a-c10ed2a62e2b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:25.335046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6859bedc-d7f9-44ea-8ce4-12d99758f138 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:25.335748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-70c8bcd7-8f77-4e5f-b91a-c10ed2a62e2b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.237556 Jul 25 19:49:25.336346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1359/2558] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:25 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:25.344513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6859bedc-d7f9-44ea-8ce4-12d99758f138 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:25.346006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6859bedc-d7f9-44ea-8ce4-12d99758f138 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:25.347258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6859bedc-d7f9-44ea-8ce4-12d99758f138 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.245753 Jul 25 19:49:25.347809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1200/2559] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:25 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:26.359688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0b0c5673-7015-4f0c-bb25-335fa68dd138 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:26.360673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0b0c5673-7015-4f0c-bb25-335fa68dd138 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:26.367889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b0c5673-7015-4f0c-bb25-335fa68dd138 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:26.368406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b0c5673-7015-4f0c-bb25-335fa68dd138 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:26.369188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b0c5673-7015-4f0c-bb25-335fa68dd138 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:26.369620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b0c5673-7015-4f0c-bb25-335fa68dd138 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:26.373648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-578b5912-1574-41d0-acfe-aeea79b2b86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:26.375040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-578b5912-1574-41d0-acfe-aeea79b2b86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:26.381717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-578b5912-1574-41d0-acfe-aeea79b2b86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:26.382171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-578b5912-1574-41d0-acfe-aeea79b2b86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:26.382949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-578b5912-1574-41d0-acfe-aeea79b2b86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:26.383393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-578b5912-1574-41d0-acfe-aeea79b2b86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:26.587670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0b0c5673-7015-4f0c-bb25-335fa68dd138 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:26.590260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-578b5912-1574-41d0-acfe-aeea79b2b86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:26.597975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0b0c5673-7015-4f0c-bb25-335fa68dd138 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.243264 Jul 25 19:49:26.598724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1360/2560] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:26 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:26.599771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-578b5912-1574-41d0-acfe-aeea79b2b86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:26.601398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-578b5912-1574-41d0-acfe-aeea79b2b86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:26.602587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-578b5912-1574-41d0-acfe-aeea79b2b86a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.232887 Jul 25 19:49:26.603148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1201/2561] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:27.620521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0127c6d9-3f9f-4873-9afa-f868f50d72bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:27.621228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0127c6d9-3f9f-4873-9afa-f868f50d72bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:27.626842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62a6f6ca-183a-4a32-bf2f-ecbe96294dc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:27.627450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62a6f6ca-183a-4a32-bf2f-ecbe96294dc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:27.628780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0127c6d9-3f9f-4873-9afa-f868f50d72bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:27.629239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0127c6d9-3f9f-4873-9afa-f868f50d72bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:27.630102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0127c6d9-3f9f-4873-9afa-f868f50d72bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:27.630517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0127c6d9-3f9f-4873-9afa-f868f50d72bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:27.635127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a6f6ca-183a-4a32-bf2f-ecbe96294dc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:27.635594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a6f6ca-183a-4a32-bf2f-ecbe96294dc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:27.636370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a6f6ca-183a-4a32-bf2f-ecbe96294dc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:27.636803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a6f6ca-183a-4a32-bf2f-ecbe96294dc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:27.837103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0127c6d9-3f9f-4873-9afa-f868f50d72bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:27.840720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62a6f6ca-183a-4a32-bf2f-ecbe96294dc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:27.846521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0127c6d9-3f9f-4873-9afa-f868f50d72bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.229697 Jul 25 19:49:27.847112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1361/2562] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:27 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:27.851557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62a6f6ca-183a-4a32-bf2f-ecbe96294dc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:27.853074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62a6f6ca-183a-4a32-bf2f-ecbe96294dc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:27.854242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62a6f6ca-183a-4a32-bf2f-ecbe96294dc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.231987 Jul 25 19:49:27.854801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1202/2563] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:28.869316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2638e3ca-ef2e-41a8-b0f2-ecb9403189fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:28.869936 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2638e3ca-ef2e-41a8-b0f2-ecb9403189fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:28.878722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-434002c0-14e3-4795-9782-16cc92d19dcd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:28.879273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2638e3ca-ef2e-41a8-b0f2-ecb9403189fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:28.879381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-434002c0-14e3-4795-9782-16cc92d19dcd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:28.879718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2638e3ca-ef2e-41a8-b0f2-ecb9403189fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:28.880489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2638e3ca-ef2e-41a8-b0f2-ecb9403189fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:28.880924 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2638e3ca-ef2e-41a8-b0f2-ecb9403189fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:28.886815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-434002c0-14e3-4795-9782-16cc92d19dcd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:28.887262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-434002c0-14e3-4795-9782-16cc92d19dcd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:28.888062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-434002c0-14e3-4795-9782-16cc92d19dcd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:28.888495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-434002c0-14e3-4795-9782-16cc92d19dcd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:29.092346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2638e3ca-ef2e-41a8-b0f2-ecb9403189fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:29.096321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-434002c0-14e3-4795-9782-16cc92d19dcd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:29.101312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2638e3ca-ef2e-41a8-b0f2-ecb9403189fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.235845 Jul 25 19:49:29.101901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1362/2564] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:28 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:29.105823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-434002c0-14e3-4795-9782-16cc92d19dcd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:29.107310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-434002c0-14e3-4795-9782-16cc92d19dcd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:29.109114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-434002c0-14e3-4795-9782-16cc92d19dcd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.235034 Jul 25 19:49:29.110479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1203/2565] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:28 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:30.123687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8eb5673d-f568-4f2a-a1b5-080da18157c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:30.124445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8eb5673d-f568-4f2a-a1b5-080da18157c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:30.134133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8eb5673d-f568-4f2a-a1b5-080da18157c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:30.134361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b746671a-b408-409b-bf43-8022d30482fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:30.134863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8eb5673d-f568-4f2a-a1b5-080da18157c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:30.134966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b746671a-b408-409b-bf43-8022d30482fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:30.135343 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8eb5673d-f568-4f2a-a1b5-080da18157c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:30.135816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8eb5673d-f568-4f2a-a1b5-080da18157c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:30.143447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b746671a-b408-409b-bf43-8022d30482fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:30.144111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b746671a-b408-409b-bf43-8022d30482fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:30.144894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b746671a-b408-409b-bf43-8022d30482fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:30.145334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b746671a-b408-409b-bf43-8022d30482fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:30.340011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8eb5673d-f568-4f2a-a1b5-080da18157c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:30.348111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b746671a-b408-409b-bf43-8022d30482fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:30.348898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8eb5673d-f568-4f2a-a1b5-080da18157c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.229084 Jul 25 19:49:30.349490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1363/2566] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:30 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:30.356838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b746671a-b408-409b-bf43-8022d30482fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:30.359280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b746671a-b408-409b-bf43-8022d30482fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:30.360238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b746671a-b408-409b-bf43-8022d30482fb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.229853 Jul 25 19:49:30.361353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1204/2567] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:31.371042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e8ea5beb-18fd-4c7f-b60d-7f5b05b957fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:31.371800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e8ea5beb-18fd-4c7f-b60d-7f5b05b957fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:31.378630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8ea5beb-18fd-4c7f-b60d-7f5b05b957fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:31.379076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8ea5beb-18fd-4c7f-b60d-7f5b05b957fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:31.379892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8ea5beb-18fd-4c7f-b60d-7f5b05b957fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:31.380359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8ea5beb-18fd-4c7f-b60d-7f5b05b957fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:31.385439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9e816903-af61-4438-9570-b6176bd885a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:31.386060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9e816903-af61-4438-9570-b6176bd885a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:31.394081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e816903-af61-4438-9570-b6176bd885a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:31.394532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e816903-af61-4438-9570-b6176bd885a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:31.395312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e816903-af61-4438-9570-b6176bd885a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:31.395811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e816903-af61-4438-9570-b6176bd885a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:31.598929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e8ea5beb-18fd-4c7f-b60d-7f5b05b957fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:31.603704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e816903-af61-4438-9570-b6176bd885a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:31.607708 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e8ea5beb-18fd-4c7f-b60d-7f5b05b957fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.240465 Jul 25 19:49:31.608358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1364/2568] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:31 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:31.613170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e816903-af61-4438-9570-b6176bd885a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:31.614703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e816903-af61-4438-9570-b6176bd885a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:31.616130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9e816903-af61-4438-9570-b6176bd885a2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.235951 Jul 25 19:49:31.616733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1205/2569] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:32.632379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6c283dd8-1916-4d4e-81fc-9e7d154b0fd1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:32.633070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6c283dd8-1916-4d4e-81fc-9e7d154b0fd1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:32.641973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c283dd8-1916-4d4e-81fc-9e7d154b0fd1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:32.642490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c283dd8-1916-4d4e-81fc-9e7d154b0fd1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:32.643431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c283dd8-1916-4d4e-81fc-9e7d154b0fd1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:32.643800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c32d38bf-85b7-45e2-86ca-4ee22352df36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:32.644428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c283dd8-1916-4d4e-81fc-9e7d154b0fd1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:32.644575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c32d38bf-85b7-45e2-86ca-4ee22352df36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:32.651594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32d38bf-85b7-45e2-86ca-4ee22352df36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:32.652039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32d38bf-85b7-45e2-86ca-4ee22352df36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:32.652812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32d38bf-85b7-45e2-86ca-4ee22352df36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:32.653253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32d38bf-85b7-45e2-86ca-4ee22352df36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:32.868923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6c283dd8-1916-4d4e-81fc-9e7d154b0fd1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:32.882340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6c283dd8-1916-4d4e-81fc-9e7d154b0fd1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.254630 Jul 25 19:49:32.883019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1365/2570] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:32 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:32.892115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c32d38bf-85b7-45e2-86ca-4ee22352df36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:32.904808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c32d38bf-85b7-45e2-86ca-4ee22352df36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:32.907040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c32d38bf-85b7-45e2-86ca-4ee22352df36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:32.908289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c32d38bf-85b7-45e2-86ca-4ee22352df36 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.269761 Jul 25 19:49:32.908871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1206/2571] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:32 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:33.906005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ff90d3f5-2701-4008-81f0-21d27ef3f9dd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:33.906638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ff90d3f5-2701-4008-81f0-21d27ef3f9dd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:33.913588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff90d3f5-2701-4008-81f0-21d27ef3f9dd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:33.914042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff90d3f5-2701-4008-81f0-21d27ef3f9dd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:33.914828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff90d3f5-2701-4008-81f0-21d27ef3f9dd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:33.915270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ff90d3f5-2701-4008-81f0-21d27ef3f9dd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:33.935555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c3690c2c-0b71-4229-9158-7ed47784f4a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:33.936513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c3690c2c-0b71-4229-9158-7ed47784f4a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:33.944239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3690c2c-0b71-4229-9158-7ed47784f4a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:33.944716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3690c2c-0b71-4229-9158-7ed47784f4a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:33.945519 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3690c2c-0b71-4229-9158-7ed47784f4a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:33.945972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3690c2c-0b71-4229-9158-7ed47784f4a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:34.151379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ff90d3f5-2701-4008-81f0-21d27ef3f9dd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:34.155678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:49:34.158966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c3690c2c-0b71-4229-9158-7ed47784f4a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:34.163874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ff90d3f5-2701-4008-81f0-21d27ef3f9dd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.261584 Jul 25 19:49:34.165534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1366/2572] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:33 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:34.173819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c3690c2c-0b71-4229-9158-7ed47784f4a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:34.175355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c3690c2c-0b71-4229-9158-7ed47784f4a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:34.176736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c3690c2c-0b71-4229-9158-7ed47784f4a5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.245584 Jul 25 19:49:34.177167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1207/2573] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:33 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:35.189676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ae6f86de-b1fc-4f8d-8068-752e6145da74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:35.190506 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ae6f86de-b1fc-4f8d-8068-752e6145da74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:35.199476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae6f86de-b1fc-4f8d-8068-752e6145da74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:35.204077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae6f86de-b1fc-4f8d-8068-752e6145da74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:35.204077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae6f86de-b1fc-4f8d-8068-752e6145da74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:35.204077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae6f86de-b1fc-4f8d-8068-752e6145da74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:35.206518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8aee4ce-1e7c-4411-94ed-99e3feb1842f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:35.207678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8aee4ce-1e7c-4411-94ed-99e3feb1842f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:35.220812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8aee4ce-1e7c-4411-94ed-99e3feb1842f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:35.221601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8aee4ce-1e7c-4411-94ed-99e3feb1842f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:35.223344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8aee4ce-1e7c-4411-94ed-99e3feb1842f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:35.224365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8aee4ce-1e7c-4411-94ed-99e3feb1842f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:35.448033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ae6f86de-b1fc-4f8d-8068-752e6145da74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:35.453465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a8aee4ce-1e7c-4411-94ed-99e3feb1842f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:35.461947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ae6f86de-b1fc-4f8d-8068-752e6145da74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.276453 Jul 25 19:49:35.462789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a8aee4ce-1e7c-4411-94ed-99e3feb1842f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:35.475606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1367/2574] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:35 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:35.475827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a8aee4ce-1e7c-4411-94ed-99e3feb1842f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:35.475827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8aee4ce-1e7c-4411-94ed-99e3feb1842f tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.267532 Jul 25 19:49:35.475827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1208/2575] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:36.488533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-678ac5af-87d4-4bbc-8d0b-bf1f1d6be7a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:36.489171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-678ac5af-87d4-4bbc-8d0b-bf1f1d6be7a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:36.491489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a09c241-b500-4ba1-9acd-c7b53b3e4332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:36.492135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a09c241-b500-4ba1-9acd-c7b53b3e4332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:36.495651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-678ac5af-87d4-4bbc-8d0b-bf1f1d6be7a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:36.496097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-678ac5af-87d4-4bbc-8d0b-bf1f1d6be7a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:36.496856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-678ac5af-87d4-4bbc-8d0b-bf1f1d6be7a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:36.497286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-678ac5af-87d4-4bbc-8d0b-bf1f1d6be7a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:36.499197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a09c241-b500-4ba1-9acd-c7b53b3e4332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:36.499678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a09c241-b500-4ba1-9acd-c7b53b3e4332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:36.500449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a09c241-b500-4ba1-9acd-c7b53b3e4332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:36.500878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a09c241-b500-4ba1-9acd-c7b53b3e4332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:36.704859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-678ac5af-87d4-4bbc-8d0b-bf1f1d6be7a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:36.709031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a09c241-b500-4ba1-9acd-c7b53b3e4332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:36.715951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-678ac5af-87d4-4bbc-8d0b-bf1f1d6be7a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.232529 Jul 25 19:49:36.719838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a09c241-b500-4ba1-9acd-c7b53b3e4332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:36.721568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a09c241-b500-4ba1-9acd-c7b53b3e4332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:36.722092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1368/2576] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:36 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:36.723026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a09c241-b500-4ba1-9acd-c7b53b3e4332 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.235760 Jul 25 19:49:36.723662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1209/2577] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:37.739106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a2936c8a-1992-4bca-acfd-4d6920456c4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:37.740091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a2936c8a-1992-4bca-acfd-4d6920456c4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:37.747203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2936c8a-1992-4bca-acfd-4d6920456c4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:37.747675 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2936c8a-1992-4bca-acfd-4d6920456c4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:37.748448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2936c8a-1992-4bca-acfd-4d6920456c4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:37.749237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2936c8a-1992-4bca-acfd-4d6920456c4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:37.755762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-06a84327-15e8-40ea-b696-617b78b15d42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:37.756406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-06a84327-15e8-40ea-b696-617b78b15d42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:37.763799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06a84327-15e8-40ea-b696-617b78b15d42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:37.764247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06a84327-15e8-40ea-b696-617b78b15d42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:37.765561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06a84327-15e8-40ea-b696-617b78b15d42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:37.766017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06a84327-15e8-40ea-b696-617b78b15d42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:37.972251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a2936c8a-1992-4bca-acfd-4d6920456c4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:37.979775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-06a84327-15e8-40ea-b696-617b78b15d42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:37.983316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a2936c8a-1992-4bca-acfd-4d6920456c4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.248767 Jul 25 19:49:37.984751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1369/2578] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:37 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:49:37.996573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-06a84327-15e8-40ea-b696-617b78b15d42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:37.998442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-06a84327-15e8-40ea-b696-617b78b15d42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:38.000047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-06a84327-15e8-40ea-b696-617b78b15d42 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.249088 Jul 25 19:49:38.000626 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1210/2579] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:39.010615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d06498d8-b7b8-4fad-82b6-a6f626fd23ba tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:39.011259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d06498d8-b7b8-4fad-82b6-a6f626fd23ba tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:39.018570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d06498d8-b7b8-4fad-82b6-a6f626fd23ba tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:39.019010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d06498d8-b7b8-4fad-82b6-a6f626fd23ba tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:39.019812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d06498d8-b7b8-4fad-82b6-a6f626fd23ba tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:39.020246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d06498d8-b7b8-4fad-82b6-a6f626fd23ba tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:39.025043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d3c5a259-b391-4215-9683-038e8fe81c72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:39.025689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d3c5a259-b391-4215-9683-038e8fe81c72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:39.033906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3c5a259-b391-4215-9683-038e8fe81c72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:39.034430 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3c5a259-b391-4215-9683-038e8fe81c72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:39.035210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3c5a259-b391-4215-9683-038e8fe81c72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:39.035677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3c5a259-b391-4215-9683-038e8fe81c72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:39.233843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d06498d8-b7b8-4fad-82b6-a6f626fd23ba tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:39.239553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d3c5a259-b391-4215-9683-038e8fe81c72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:39.244205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d06498d8-b7b8-4fad-82b6-a6f626fd23ba tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.239923 Jul 25 19:49:39.244790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1370/2580] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:39 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:39.249615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d3c5a259-b391-4215-9683-038e8fe81c72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:39.251277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d3c5a259-b391-4215-9683-038e8fe81c72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:39.252564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d3c5a259-b391-4215-9683-038e8fe81c72 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.231992 Jul 25 19:49:39.253131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1211/2581] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:40.267186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-265f57ea-d68c-4c79-8930-b21df6a3fa6b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:40.268238 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-265f57ea-d68c-4c79-8930-b21df6a3fa6b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:40.275388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-265f57ea-d68c-4c79-8930-b21df6a3fa6b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:40.275849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-265f57ea-d68c-4c79-8930-b21df6a3fa6b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:40.276611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-265f57ea-d68c-4c79-8930-b21df6a3fa6b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:40.276863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-26ffbdf8-99b4-41d4-8aee-fbb2e702ec69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:40.277369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-265f57ea-d68c-4c79-8930-b21df6a3fa6b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:40.277508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-26ffbdf8-99b4-41d4-8aee-fbb2e702ec69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:40.285006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26ffbdf8-99b4-41d4-8aee-fbb2e702ec69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:40.285459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26ffbdf8-99b4-41d4-8aee-fbb2e702ec69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:40.286236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26ffbdf8-99b4-41d4-8aee-fbb2e702ec69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:40.286767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26ffbdf8-99b4-41d4-8aee-fbb2e702ec69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:40.489031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-265f57ea-d68c-4c79-8930-b21df6a3fa6b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:40.493792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26ffbdf8-99b4-41d4-8aee-fbb2e702ec69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:40.497878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-265f57ea-d68c-4c79-8930-b21df6a3fa6b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.235142 Jul 25 19:49:40.498470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1371/2582] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:40 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:40.502624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26ffbdf8-99b4-41d4-8aee-fbb2e702ec69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:40.504168 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26ffbdf8-99b4-41d4-8aee-fbb2e702ec69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:40.505340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-26ffbdf8-99b4-41d4-8aee-fbb2e702ec69 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.232413 Jul 25 19:49:40.505902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1212/2583] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:41.520188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4d80f299-0483-4562-87b6-2c2a22085371 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:41.521272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4d80f299-0483-4562-87b6-2c2a22085371 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:41.528065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d80f299-0483-4562-87b6-2c2a22085371 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:41.528999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d80f299-0483-4562-87b6-2c2a22085371 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:41.529278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d80f299-0483-4562-87b6-2c2a22085371 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:41.529718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d80f299-0483-4562-87b6-2c2a22085371 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:41.532720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-739c5865-8071-4147-aa38-d0ec12d76d93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:41.533355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-739c5865-8071-4147-aa38-d0ec12d76d93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:41.539714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-739c5865-8071-4147-aa38-d0ec12d76d93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:41.540173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-739c5865-8071-4147-aa38-d0ec12d76d93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:41.540959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-739c5865-8071-4147-aa38-d0ec12d76d93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:41.541399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-739c5865-8071-4147-aa38-d0ec12d76d93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:41.750182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4d80f299-0483-4562-87b6-2c2a22085371 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:41.758533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-739c5865-8071-4147-aa38-d0ec12d76d93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:41.761287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4d80f299-0483-4562-87b6-2c2a22085371 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.245131 Jul 25 19:49:41.761880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1372/2584] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:41 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:49:41.768497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-739c5865-8071-4147-aa38-d0ec12d76d93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:41.769986 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-739c5865-8071-4147-aa38-d0ec12d76d93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:41.771231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-739c5865-8071-4147-aa38-d0ec12d76d93 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.244464 Jul 25 19:49:41.771743 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1213/2585] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:42.785638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a3087fe2-b65f-4991-b5ee-dcdd1ddf60f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:42.786239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a3087fe2-b65f-4991-b5ee-dcdd1ddf60f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:42.793214 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3087fe2-b65f-4991-b5ee-dcdd1ddf60f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:42.793660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3087fe2-b65f-4991-b5ee-dcdd1ddf60f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:42.794367 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cca61c85-a377-4e85-bb32-9831a1df56bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:42.794854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3087fe2-b65f-4991-b5ee-dcdd1ddf60f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:42.794854 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3087fe2-b65f-4991-b5ee-dcdd1ddf60f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:42.795130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cca61c85-a377-4e85-bb32-9831a1df56bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:42.802309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca61c85-a377-4e85-bb32-9831a1df56bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:42.802763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca61c85-a377-4e85-bb32-9831a1df56bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:42.803576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca61c85-a377-4e85-bb32-9831a1df56bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:42.804019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca61c85-a377-4e85-bb32-9831a1df56bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:42.808522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:49:43.015102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a3087fe2-b65f-4991-b5ee-dcdd1ddf60f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:43.023386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cca61c85-a377-4e85-bb32-9831a1df56bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:43.023760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a3087fe2-b65f-4991-b5ee-dcdd1ddf60f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.243341 Jul 25 19:49:43.024621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1373/2586] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:42 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:43.033400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cca61c85-a377-4e85-bb32-9831a1df56bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:43.034913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cca61c85-a377-4e85-bb32-9831a1df56bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:43.036134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cca61c85-a377-4e85-bb32-9831a1df56bc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.245555 Jul 25 19:49:43.036701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1214/2587] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:44.046160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a2b30f2b-f0bd-4bd1-ba62-9a38763093b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:44.046862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a2b30f2b-f0bd-4bd1-ba62-9a38763093b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:44.049147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=48 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:49:44.054463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2b30f2b-f0bd-4bd1-ba62-9a38763093b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:44.054929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2b30f2b-f0bd-4bd1-ba62-9a38763093b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:44.055742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2b30f2b-f0bd-4bd1-ba62-9a38763093b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:44.056169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2b30f2b-f0bd-4bd1-ba62-9a38763093b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:44.059919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-947f1827-cbb6-4ce1-9a83-29e8bb26e1f0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:44.060531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-947f1827-cbb6-4ce1-9a83-29e8bb26e1f0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:44.067435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-947f1827-cbb6-4ce1-9a83-29e8bb26e1f0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:44.067940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-947f1827-cbb6-4ce1-9a83-29e8bb26e1f0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:44.068719 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-947f1827-cbb6-4ce1-9a83-29e8bb26e1f0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:44.069160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-947f1827-cbb6-4ce1-9a83-29e8bb26e1f0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:44.299059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a2b30f2b-f0bd-4bd1-ba62-9a38763093b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:44.305304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-947f1827-cbb6-4ce1-9a83-29e8bb26e1f0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:44.308058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a2b30f2b-f0bd-4bd1-ba62-9a38763093b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.265681 Jul 25 19:49:44.308540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1374/2588] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:44 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:44.314360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-947f1827-cbb6-4ce1-9a83-29e8bb26e1f0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:44.315970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-947f1827-cbb6-4ce1-9a83-29e8bb26e1f0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:44.317199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-947f1827-cbb6-4ce1-9a83-29e8bb26e1f0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.261109 Jul 25 19:49:44.317832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1215/2589] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:45.330748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bd25dadb-d479-4e59-aa46-0721613e7fbf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:45.331391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bd25dadb-d479-4e59-aa46-0721613e7fbf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:45.338173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bd25dadb-d479-4e59-aa46-0721613e7fbf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:45.338619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bd25dadb-d479-4e59-aa46-0721613e7fbf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:45.339396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bd25dadb-d479-4e59-aa46-0721613e7fbf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:45.339857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bd25dadb-d479-4e59-aa46-0721613e7fbf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:45.342084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1d040140-e92d-4e07-bfbb-3da89976357e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:45.343447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1d040140-e92d-4e07-bfbb-3da89976357e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:45.346585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=50 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:49:45.353301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d040140-e92d-4e07-bfbb-3da89976357e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:45.353674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d040140-e92d-4e07-bfbb-3da89976357e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:45.354457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d040140-e92d-4e07-bfbb-3da89976357e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:45.354906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d040140-e92d-4e07-bfbb-3da89976357e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:45.554131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bd25dadb-d479-4e59-aa46-0721613e7fbf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:45.561492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1d040140-e92d-4e07-bfbb-3da89976357e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:45.563598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bd25dadb-d479-4e59-aa46-0721613e7fbf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.236727 Jul 25 19:49:45.564387 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1375/2590] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:45 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:45.570906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1d040140-e92d-4e07-bfbb-3da89976357e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:45.572452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1d040140-e92d-4e07-bfbb-3da89976357e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:45.573618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1d040140-e92d-4e07-bfbb-3da89976357e tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.236165 Jul 25 19:49:45.574297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1216/2591] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:46.586488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5dbe05b1-ec5f-45cc-9de6-0ffb128e8966 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:46.587130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5dbe05b1-ec5f-45cc-9de6-0ffb128e8966 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:46.594207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5dbe05b1-ec5f-45cc-9de6-0ffb128e8966 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:46.594654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5dbe05b1-ec5f-45cc-9de6-0ffb128e8966 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:46.595446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5dbe05b1-ec5f-45cc-9de6-0ffb128e8966 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:46.596093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5dbe05b1-ec5f-45cc-9de6-0ffb128e8966 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:46.598894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dcdd7424-c7ea-4805-a05e-424a154140cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:46.599498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dcdd7424-c7ea-4805-a05e-424a154140cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:46.606618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcdd7424-c7ea-4805-a05e-424a154140cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:46.607058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcdd7424-c7ea-4805-a05e-424a154140cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:46.608151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcdd7424-c7ea-4805-a05e-424a154140cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:46.608537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcdd7424-c7ea-4805-a05e-424a154140cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:47.107585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5dbe05b1-ec5f-45cc-9de6-0ffb128e8966 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:47.112754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dcdd7424-c7ea-4805-a05e-424a154140cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:47.116248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5dbe05b1-ec5f-45cc-9de6-0ffb128e8966 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.534687 Jul 25 19:49:47.116902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1376/2592] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:46 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:47.123487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dcdd7424-c7ea-4805-a05e-424a154140cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:47.126362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dcdd7424-c7ea-4805-a05e-424a154140cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:47.127714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dcdd7424-c7ea-4805-a05e-424a154140cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.532642 Jul 25 19:49:47.128403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1217/2593] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:48.140774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-386a0cb3-11ca-46df-bb21-7932f97addc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:48.141439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-386a0cb3-11ca-46df-bb21-7932f97addc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:48.149785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-386a0cb3-11ca-46df-bb21-7932f97addc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:48.150397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-386a0cb3-11ca-46df-bb21-7932f97addc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:48.151172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-386a0cb3-11ca-46df-bb21-7932f97addc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:48.151663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-386a0cb3-11ca-46df-bb21-7932f97addc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:48.154334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3f479d95-7dc9-49dc-bb4d-ab5b3e2f2130 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:48.156173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3f479d95-7dc9-49dc-bb4d-ab5b3e2f2130 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:48.162951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f479d95-7dc9-49dc-bb4d-ab5b3e2f2130 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:48.163722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f479d95-7dc9-49dc-bb4d-ab5b3e2f2130 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:48.164726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f479d95-7dc9-49dc-bb4d-ab5b3e2f2130 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:48.165370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f479d95-7dc9-49dc-bb4d-ab5b3e2f2130 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:48.368155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-386a0cb3-11ca-46df-bb21-7932f97addc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:48.377764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-386a0cb3-11ca-46df-bb21-7932f97addc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.241410 Jul 25 19:49:48.378632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1377/2594] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:48 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:48.385610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3f479d95-7dc9-49dc-bb4d-ab5b3e2f2130 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:48.395471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3f479d95-7dc9-49dc-bb4d-ab5b3e2f2130 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:48.396927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3f479d95-7dc9-49dc-bb4d-ab5b3e2f2130 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:48.398096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3f479d95-7dc9-49dc-bb4d-ab5b3e2f2130 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.250355 Jul 25 19:49:48.398661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1218/2595] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:48 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:49.399815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-13329a96-7792-4408-b682-29850e2cf1a6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:49.400436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-13329a96-7792-4408-b682-29850e2cf1a6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:49.409548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13329a96-7792-4408-b682-29850e2cf1a6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:49.409996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13329a96-7792-4408-b682-29850e2cf1a6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:49.411145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13329a96-7792-4408-b682-29850e2cf1a6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:49.411611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-13329a96-7792-4408-b682-29850e2cf1a6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:49.423910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d391263c-fbec-4541-82a3-187e578a5d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:49.424831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d391263c-fbec-4541-82a3-187e578a5d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:49.433042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d391263c-fbec-4541-82a3-187e578a5d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:49.433530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d391263c-fbec-4541-82a3-187e578a5d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:49.434267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d391263c-fbec-4541-82a3-187e578a5d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:49.434708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d391263c-fbec-4541-82a3-187e578a5d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:49.634441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-13329a96-7792-4408-b682-29850e2cf1a6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:49.642795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d391263c-fbec-4541-82a3-187e578a5d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:49.644464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-13329a96-7792-4408-b682-29850e2cf1a6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.248540 Jul 25 19:49:49.645057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1378/2596] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:49 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:49.652125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d391263c-fbec-4541-82a3-187e578a5d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:49.653835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d391263c-fbec-4541-82a3-187e578a5d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:49.655199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d391263c-fbec-4541-82a3-187e578a5d61 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.236498 Jul 25 19:49:49.656049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1219/2597] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:50.666666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f60b2445-19ac-44f0-8561-fb7ac22b28a5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:50.667629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f60b2445-19ac-44f0-8561-fb7ac22b28a5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:50.677702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f60b2445-19ac-44f0-8561-fb7ac22b28a5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:50.678392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f60b2445-19ac-44f0-8561-fb7ac22b28a5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:50.678518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4aab08bb-a614-4939-9517-29cb36f40167 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:50.679079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4aab08bb-a614-4939-9517-29cb36f40167 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:50.679712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f60b2445-19ac-44f0-8561-fb7ac22b28a5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:50.680443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f60b2445-19ac-44f0-8561-fb7ac22b28a5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:50.686173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aab08bb-a614-4939-9517-29cb36f40167 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:50.686531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aab08bb-a614-4939-9517-29cb36f40167 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:50.688101 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aab08bb-a614-4939-9517-29cb36f40167 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:50.688658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aab08bb-a614-4939-9517-29cb36f40167 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:50.891407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f60b2445-19ac-44f0-8561-fb7ac22b28a5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:50.903298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f60b2445-19ac-44f0-8561-fb7ac22b28a5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.241046 Jul 25 19:49:50.911234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1379/2598] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:50 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:50.912564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4aab08bb-a614-4939-9517-29cb36f40167 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:50.923383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4aab08bb-a614-4939-9517-29cb36f40167 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:50.924890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4aab08bb-a614-4939-9517-29cb36f40167 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:50.926088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4aab08bb-a614-4939-9517-29cb36f40167 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.251724 Jul 25 19:49:50.926664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1220/2599] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:51.926231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-97aa47a6-3b98-4af8-a7bf-1bc9e9f1fd88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:51.927148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-97aa47a6-3b98-4af8-a7bf-1bc9e9f1fd88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:51.933785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97aa47a6-3b98-4af8-a7bf-1bc9e9f1fd88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:51.934195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97aa47a6-3b98-4af8-a7bf-1bc9e9f1fd88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:51.935048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97aa47a6-3b98-4af8-a7bf-1bc9e9f1fd88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:51.935491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-97aa47a6-3b98-4af8-a7bf-1bc9e9f1fd88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:51.952794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a2c3a874-cba7-4538-8687-19f3ab739580 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:51.953978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a2c3a874-cba7-4538-8687-19f3ab739580 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:51.962884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2c3a874-cba7-4538-8687-19f3ab739580 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:51.963594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2c3a874-cba7-4538-8687-19f3ab739580 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:51.964795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2c3a874-cba7-4538-8687-19f3ab739580 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:51.965799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2c3a874-cba7-4538-8687-19f3ab739580 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:52.186172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-97aa47a6-3b98-4af8-a7bf-1bc9e9f1fd88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:52.193158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a2c3a874-cba7-4538-8687-19f3ab739580 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:52.196125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-97aa47a6-3b98-4af8-a7bf-1bc9e9f1fd88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.273824 Jul 25 19:49:52.197025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1380/2600] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:51 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:49:52.208110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a2c3a874-cba7-4538-8687-19f3ab739580 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:52.210833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a2c3a874-cba7-4538-8687-19f3ab739580 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:52.213262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a2c3a874-cba7-4538-8687-19f3ab739580 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.265602 Jul 25 19:49:52.214298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1221/2601] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:53.220187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-912eb7c4-20c5-48cc-bd5f-7ab47174837d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:53.221627 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-912eb7c4-20c5-48cc-bd5f-7ab47174837d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:53.229041 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-912eb7c4-20c5-48cc-bd5f-7ab47174837d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:53.229487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-912eb7c4-20c5-48cc-bd5f-7ab47174837d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:53.230389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-912eb7c4-20c5-48cc-bd5f-7ab47174837d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:53.230820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-912eb7c4-20c5-48cc-bd5f-7ab47174837d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:53.252220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de51e576-9dce-4664-b88f-be3b8e5507c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:53.252992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de51e576-9dce-4664-b88f-be3b8e5507c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:53.259822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de51e576-9dce-4664-b88f-be3b8e5507c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:53.260280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de51e576-9dce-4664-b88f-be3b8e5507c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:53.261059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de51e576-9dce-4664-b88f-be3b8e5507c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:53.261569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de51e576-9dce-4664-b88f-be3b8e5507c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:53.442983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-912eb7c4-20c5-48cc-bd5f-7ab47174837d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:53.453311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-912eb7c4-20c5-48cc-bd5f-7ab47174837d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.237722 Jul 25 19:49:53.454486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1381/2602] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:53 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:49:53.462189 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de51e576-9dce-4664-b88f-be3b8e5507c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:53.471921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de51e576-9dce-4664-b88f-be3b8e5507c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:53.473414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de51e576-9dce-4664-b88f-be3b8e5507c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:53.474577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de51e576-9dce-4664-b88f-be3b8e5507c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.226715 Jul 25 19:49:53.475142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1222/2603] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:53 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:54.485575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-74e8cc36-b240-4335-99ee-2fe7ab8a1bcb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:54.486147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-74e8cc36-b240-4335-99ee-2fe7ab8a1bcb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:54.493164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74e8cc36-b240-4335-99ee-2fe7ab8a1bcb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:54.493616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74e8cc36-b240-4335-99ee-2fe7ab8a1bcb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:54.494383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74e8cc36-b240-4335-99ee-2fe7ab8a1bcb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:54.495133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74e8cc36-b240-4335-99ee-2fe7ab8a1bcb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:54.504670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5c0456c-9cf2-462b-8649-a2e0e89be472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:54.505364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d5c0456c-9cf2-462b-8649-a2e0e89be472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:54.512325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5c0456c-9cf2-462b-8649-a2e0e89be472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:54.512770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5c0456c-9cf2-462b-8649-a2e0e89be472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:54.513547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5c0456c-9cf2-462b-8649-a2e0e89be472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:54.513980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5c0456c-9cf2-462b-8649-a2e0e89be472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:54.739960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-74e8cc36-b240-4335-99ee-2fe7ab8a1bcb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:54.743918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5c0456c-9cf2-462b-8649-a2e0e89be472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:54.754073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5c0456c-9cf2-462b-8649-a2e0e89be472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:54.755235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-74e8cc36-b240-4335-99ee-2fe7ab8a1bcb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.274100 Jul 25 19:49:54.755766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5c0456c-9cf2-462b-8649-a2e0e89be472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:54.756366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1382/2604] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:54 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:54.757001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d5c0456c-9cf2-462b-8649-a2e0e89be472 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.260319 Jul 25 19:49:54.757562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1223/2605] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:54 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:55.782444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a49b7ba7-9cb6-4351-a100-02270a039fa6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:55.783116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a49b7ba7-9cb6-4351-a100-02270a039fa6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:55.790659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a49b7ba7-9cb6-4351-a100-02270a039fa6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:55.791168 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a49b7ba7-9cb6-4351-a100-02270a039fa6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:55.792067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a49b7ba7-9cb6-4351-a100-02270a039fa6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:55.792583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a49b7ba7-9cb6-4351-a100-02270a039fa6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:55.792879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-00de6881-2cd9-49f7-81d2-c2aa7d8290d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:55.793511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-00de6881-2cd9-49f7-81d2-c2aa7d8290d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:55.801274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00de6881-2cd9-49f7-81d2-c2aa7d8290d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:55.801728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00de6881-2cd9-49f7-81d2-c2aa7d8290d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:55.802510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00de6881-2cd9-49f7-81d2-c2aa7d8290d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:55.802952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00de6881-2cd9-49f7-81d2-c2aa7d8290d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:55.813397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:49:56.024940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-00de6881-2cd9-49f7-81d2-c2aa7d8290d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:56.031497 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a49b7ba7-9cb6-4351-a100-02270a039fa6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:56.038926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-00de6881-2cd9-49f7-81d2-c2aa7d8290d8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.250340 Jul 25 19:49:56.039867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1224/2606] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:55 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:49:56.042639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a49b7ba7-9cb6-4351-a100-02270a039fa6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:56.046410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a49b7ba7-9cb6-4351-a100-02270a039fa6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:56.049163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a49b7ba7-9cb6-4351-a100-02270a039fa6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.270303 Jul 25 19:49:56.050311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1383/2607] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:55 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:49:57.063610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-889ae452-7541-4a0d-8f05-c1d2fc5fa611 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:57.064214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-889ae452-7541-4a0d-8f05-c1d2fc5fa611 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:57.070965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-889ae452-7541-4a0d-8f05-c1d2fc5fa611 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:57.071412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-889ae452-7541-4a0d-8f05-c1d2fc5fa611 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:57.072209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-889ae452-7541-4a0d-8f05-c1d2fc5fa611 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:57.072647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-889ae452-7541-4a0d-8f05-c1d2fc5fa611 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:57.092961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1a93a1af-e63e-4b48-af98-0ee51bf22772 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:57.093684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1a93a1af-e63e-4b48-af98-0ee51bf22772 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:57.100719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1a93a1af-e63e-4b48-af98-0ee51bf22772 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:57.101272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1a93a1af-e63e-4b48-af98-0ee51bf22772 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:57.102413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1a93a1af-e63e-4b48-af98-0ee51bf22772 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:57.103069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1a93a1af-e63e-4b48-af98-0ee51bf22772 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:57.287765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-889ae452-7541-4a0d-8f05-c1d2fc5fa611 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:57.297107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-889ae452-7541-4a0d-8f05-c1d2fc5fa611 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.238545 Jul 25 19:49:57.297703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1225/2608] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:57 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:57.301386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1a93a1af-e63e-4b48-af98-0ee51bf22772 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:57.310542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1a93a1af-e63e-4b48-af98-0ee51bf22772 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:57.312243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1a93a1af-e63e-4b48-af98-0ee51bf22772 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:57.313586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1a93a1af-e63e-4b48-af98-0ee51bf22772 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.225182 Jul 25 19:49:57.314513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1384/2609] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:57 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:58.319911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e26267d6-e826-41b5-abf3-4f10945373a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:58.320691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e26267d6-e826-41b5-abf3-4f10945373a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:58.327544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e26267d6-e826-41b5-abf3-4f10945373a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:58.327995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e26267d6-e826-41b5-abf3-4f10945373a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:58.328784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e26267d6-e826-41b5-abf3-4f10945373a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:58.329223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e26267d6-e826-41b5-abf3-4f10945373a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:58.338265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0086fea6-1121-4c50-a35d-074c592989bf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:58.339022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0086fea6-1121-4c50-a35d-074c592989bf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:58.346765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0086fea6-1121-4c50-a35d-074c592989bf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:58.347319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0086fea6-1121-4c50-a35d-074c592989bf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:58.348128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0086fea6-1121-4c50-a35d-074c592989bf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:58.348645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0086fea6-1121-4c50-a35d-074c592989bf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:58.551608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e26267d6-e826-41b5-abf3-4f10945373a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:58.560436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e26267d6-e826-41b5-abf3-4f10945373a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.244784 Jul 25 19:49:58.562126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1226/2610] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:58 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:58.564759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0086fea6-1121-4c50-a35d-074c592989bf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:58.574067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0086fea6-1121-4c50-a35d-074c592989bf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:58.575674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0086fea6-1121-4c50-a35d-074c592989bf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:58.577483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0086fea6-1121-4c50-a35d-074c592989bf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.242774 Jul 25 19:49:58.578093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1385/2611] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:58 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:49:59.582139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-40f7ab27-d88a-4a49-846a-a16e2cc858b7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:59.582740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-40f7ab27-d88a-4a49-846a-a16e2cc858b7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:59.589615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40f7ab27-d88a-4a49-846a-a16e2cc858b7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:59.590060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40f7ab27-d88a-4a49-846a-a16e2cc858b7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:59.590849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40f7ab27-d88a-4a49-846a-a16e2cc858b7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:59.591267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40f7ab27-d88a-4a49-846a-a16e2cc858b7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:59.601998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9ec40f18-f7a1-48ec-b939-3587defc2701 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:49:59.602595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9ec40f18-f7a1-48ec-b939-3587defc2701 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:49:59.610799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ec40f18-f7a1-48ec-b939-3587defc2701 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:59.611249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ec40f18-f7a1-48ec-b939-3587defc2701 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:59.612064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ec40f18-f7a1-48ec-b939-3587defc2701 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:49:59.612764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ec40f18-f7a1-48ec-b939-3587defc2701 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:49:59.816433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-40f7ab27-d88a-4a49-846a-a16e2cc858b7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:59.825261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-40f7ab27-d88a-4a49-846a-a16e2cc858b7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.246877 Jul 25 19:49:59.825863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1227/2612] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:49:59 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:49:59.830742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9ec40f18-f7a1-48ec-b939-3587defc2701 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:59.840805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9ec40f18-f7a1-48ec-b939-3587defc2701 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:59.842832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9ec40f18-f7a1-48ec-b939-3587defc2701 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:49:59.844107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9ec40f18-f7a1-48ec-b939-3587defc2701 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.246047 Jul 25 19:49:59.844695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1386/2613] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:49:59 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:00.862547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-32f73007-d393-41c5-8ad9-bd284e49c1a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:00.863169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-32f73007-d393-41c5-8ad9-bd284e49c1a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:00.870117 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d918cb61-9297-4487-93a4-0e3944ed6483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:00.870762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d918cb61-9297-4487-93a4-0e3944ed6483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:00.874239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32f73007-d393-41c5-8ad9-bd284e49c1a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:00.875099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32f73007-d393-41c5-8ad9-bd284e49c1a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:00.876148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32f73007-d393-41c5-8ad9-bd284e49c1a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:00.876670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32f73007-d393-41c5-8ad9-bd284e49c1a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:00.879026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d918cb61-9297-4487-93a4-0e3944ed6483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:00.879473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d918cb61-9297-4487-93a4-0e3944ed6483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:00.880350 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d918cb61-9297-4487-93a4-0e3944ed6483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:00.880795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d918cb61-9297-4487-93a4-0e3944ed6483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:01.098472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-32f73007-d393-41c5-8ad9-bd284e49c1a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:01.107179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d918cb61-9297-4487-93a4-0e3944ed6483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:01.108412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-32f73007-d393-41c5-8ad9-bd284e49c1a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.250739 Jul 25 19:50:01.109600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1228/2614] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:00 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:01.116719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d918cb61-9297-4487-93a4-0e3944ed6483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:01.118147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d918cb61-9297-4487-93a4-0e3944ed6483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:01.119375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d918cb61-9297-4487-93a4-0e3944ed6483 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.253213 Jul 25 19:50:01.119979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1387/2615] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:00 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:02.130156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc1e7554-4cb2-42e1-81e9-a0c0db741623 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:02.130876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cc1e7554-4cb2-42e1-81e9-a0c0db741623 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:02.138551 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc1e7554-4cb2-42e1-81e9-a0c0db741623 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:02.139670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc1e7554-4cb2-42e1-81e9-a0c0db741623 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:02.140592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc1e7554-4cb2-42e1-81e9-a0c0db741623 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:02.141026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc1e7554-4cb2-42e1-81e9-a0c0db741623 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:02.145186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-42da104d-ebd1-47ef-861c-7a32235e21fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:02.145798 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-42da104d-ebd1-47ef-861c-7a32235e21fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:02.152494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42da104d-ebd1-47ef-861c-7a32235e21fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:02.152943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42da104d-ebd1-47ef-861c-7a32235e21fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:02.153734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42da104d-ebd1-47ef-861c-7a32235e21fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:02.154155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-42da104d-ebd1-47ef-861c-7a32235e21fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:02.378663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cc1e7554-4cb2-42e1-81e9-a0c0db741623 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:02.383412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-42da104d-ebd1-47ef-861c-7a32235e21fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:02.387471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cc1e7554-4cb2-42e1-81e9-a0c0db741623 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.261245 Jul 25 19:50:02.388101 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1229/2616] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:02 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:02.395134 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-42da104d-ebd1-47ef-861c-7a32235e21fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:02.396727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-42da104d-ebd1-47ef-861c-7a32235e21fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:02.397938 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-42da104d-ebd1-47ef-861c-7a32235e21fc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.256813 Jul 25 19:50:02.398507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1388/2617] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:02 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:03.410886 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-19c68635-587f-4138-9a18-c676b0a8d6ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:03.411497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-19c68635-587f-4138-9a18-c676b0a8d6ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:03.417996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19c68635-587f-4138-9a18-c676b0a8d6ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:03.418446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19c68635-587f-4138-9a18-c676b0a8d6ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:03.419224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19c68635-587f-4138-9a18-c676b0a8d6ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:03.419764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19c68635-587f-4138-9a18-c676b0a8d6ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:03.423639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf5b6ebc-f67f-4529-80ed-4f2c8a243bd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:03.424462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cf5b6ebc-f67f-4529-80ed-4f2c8a243bd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:03.430834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf5b6ebc-f67f-4529-80ed-4f2c8a243bd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:03.431272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf5b6ebc-f67f-4529-80ed-4f2c8a243bd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:03.432071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf5b6ebc-f67f-4529-80ed-4f2c8a243bd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:03.432503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf5b6ebc-f67f-4529-80ed-4f2c8a243bd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:03.637252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-19c68635-587f-4138-9a18-c676b0a8d6ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:03.641331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:50:03.641581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf5b6ebc-f67f-4529-80ed-4f2c8a243bd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:03.647334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-19c68635-587f-4138-9a18-c676b0a8d6ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.240555 Jul 25 19:50:03.648132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1230/2618] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:03 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:03.650592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf5b6ebc-f67f-4529-80ed-4f2c8a243bd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:03.652141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf5b6ebc-f67f-4529-80ed-4f2c8a243bd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:03.653308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cf5b6ebc-f67f-4529-80ed-4f2c8a243bd8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.235539 Jul 25 19:50:03.653866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1389/2619] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:03 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:04.669356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6ede6823-3f40-4415-8ce1-6ba6ebabede7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:04.670005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ede6823-3f40-4415-8ce1-6ba6ebabede7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:04.676831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ede6823-3f40-4415-8ce1-6ba6ebabede7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:04.677084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-618a2e8f-9467-4cab-9a6b-9fcc5909046d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:04.677622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ede6823-3f40-4415-8ce1-6ba6ebabede7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:04.677835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-618a2e8f-9467-4cab-9a6b-9fcc5909046d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:04.678222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ede6823-3f40-4415-8ce1-6ba6ebabede7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:04.678476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ede6823-3f40-4415-8ce1-6ba6ebabede7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:04.684837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-618a2e8f-9467-4cab-9a6b-9fcc5909046d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:04.685285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-618a2e8f-9467-4cab-9a6b-9fcc5909046d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:04.686664 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-618a2e8f-9467-4cab-9a6b-9fcc5909046d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:04.687444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-618a2e8f-9467-4cab-9a6b-9fcc5909046d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:04.878191 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6ede6823-3f40-4415-8ce1-6ba6ebabede7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:04.886763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6ede6823-3f40-4415-8ce1-6ba6ebabede7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.221413 Jul 25 19:50:04.887461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1231/2620] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:04 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:04.894307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-618a2e8f-9467-4cab-9a6b-9fcc5909046d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:04.904429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-618a2e8f-9467-4cab-9a6b-9fcc5909046d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:04.906377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-618a2e8f-9467-4cab-9a6b-9fcc5909046d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:04.907574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-618a2e8f-9467-4cab-9a6b-9fcc5909046d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.234749 Jul 25 19:50:04.908137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1390/2621] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:04 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:05.908002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e7658431-8641-4557-b806-2745223b5577 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:05.908637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e7658431-8641-4557-b806-2745223b5577 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:05.915696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7658431-8641-4557-b806-2745223b5577 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:05.916293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7658431-8641-4557-b806-2745223b5577 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:05.916924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7658431-8641-4557-b806-2745223b5577 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:05.917368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7658431-8641-4557-b806-2745223b5577 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:05.932522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6e25672d-f708-4044-ad53-63335e00bf52 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:05.933382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6e25672d-f708-4044-ad53-63335e00bf52 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:05.941200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e25672d-f708-4044-ad53-63335e00bf52 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:05.941672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e25672d-f708-4044-ad53-63335e00bf52 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:05.942590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e25672d-f708-4044-ad53-63335e00bf52 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:05.943038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e25672d-f708-4044-ad53-63335e00bf52 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:06.150989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e7658431-8641-4557-b806-2745223b5577 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:06.161819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e7658431-8641-4557-b806-2745223b5577 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.257941 Jul 25 19:50:06.162324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1232/2622] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:05 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:06.168714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6e25672d-f708-4044-ad53-63335e00bf52 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:06.178183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6e25672d-f708-4044-ad53-63335e00bf52 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:06.180359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6e25672d-f708-4044-ad53-63335e00bf52 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:06.182568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6e25672d-f708-4044-ad53-63335e00bf52 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.253716 Jul 25 19:50:06.183659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1391/2623] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:05 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:07.184721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-265d286c-1237-453a-800a-1e82a60660c9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:07.185403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-265d286c-1237-453a-800a-1e82a60660c9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:07.196093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-265d286c-1237-453a-800a-1e82a60660c9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:07.196545 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-265d286c-1237-453a-800a-1e82a60660c9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:07.197331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-265d286c-1237-453a-800a-1e82a60660c9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:07.197773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-265d286c-1237-453a-800a-1e82a60660c9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:07.209648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7431d3d8-1828-4076-b6c6-c5b4adffa49c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:07.210247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7431d3d8-1828-4076-b6c6-c5b4adffa49c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:07.217676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7431d3d8-1828-4076-b6c6-c5b4adffa49c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:07.218130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7431d3d8-1828-4076-b6c6-c5b4adffa49c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:07.218911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7431d3d8-1828-4076-b6c6-c5b4adffa49c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:07.219341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7431d3d8-1828-4076-b6c6-c5b4adffa49c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:07.425994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-265d286c-1237-453a-800a-1e82a60660c9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:07.430410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7431d3d8-1828-4076-b6c6-c5b4adffa49c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:07.434455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-265d286c-1237-453a-800a-1e82a60660c9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.253800 Jul 25 19:50:07.435035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1233/2624] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:07 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:07.442006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7431d3d8-1828-4076-b6c6-c5b4adffa49c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:07.443545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7431d3d8-1828-4076-b6c6-c5b4adffa49c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:07.444738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7431d3d8-1828-4076-b6c6-c5b4adffa49c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.241660 Jul 25 19:50:07.445652 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1392/2625] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:07 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:08.458587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f1609c80-ce3e-4669-987e-32592abe7a74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:08.459127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f1609c80-ce3e-4669-987e-32592abe7a74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:08.466027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1609c80-ce3e-4669-987e-32592abe7a74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:08.466478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1609c80-ce3e-4669-987e-32592abe7a74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:08.468001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1609c80-ce3e-4669-987e-32592abe7a74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:08.468654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1609c80-ce3e-4669-987e-32592abe7a74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:08.470640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8f4c1076-64ac-4842-a6cf-7efcc57f0674 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:08.471544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8f4c1076-64ac-4842-a6cf-7efcc57f0674 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:08.479088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f4c1076-64ac-4842-a6cf-7efcc57f0674 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:08.479541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f4c1076-64ac-4842-a6cf-7efcc57f0674 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:08.480321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f4c1076-64ac-4842-a6cf-7efcc57f0674 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:08.480820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f4c1076-64ac-4842-a6cf-7efcc57f0674 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:08.740748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f1609c80-ce3e-4669-987e-32592abe7a74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:08.743398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8f4c1076-64ac-4842-a6cf-7efcc57f0674 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:08.749284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f1609c80-ce3e-4669-987e-32592abe7a74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.294493 Jul 25 19:50:08.749977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1234/2626] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:08 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:08.753043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8f4c1076-64ac-4842-a6cf-7efcc57f0674 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:08.754941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8f4c1076-64ac-4842-a6cf-7efcc57f0674 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:08.756307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8f4c1076-64ac-4842-a6cf-7efcc57f0674 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.290069 Jul 25 19:50:08.756979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1393/2627] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:08 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:09.772532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f45ac643-64c2-44a1-872f-fec1ac1cf839 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:09.773138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f45ac643-64c2-44a1-872f-fec1ac1cf839 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:09.781250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f45ac643-64c2-44a1-872f-fec1ac1cf839 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:09.781699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f45ac643-64c2-44a1-872f-fec1ac1cf839 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:09.781978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e91eeb50-aec3-498a-808e-ff7fc5f9b422 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:09.782479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f45ac643-64c2-44a1-872f-fec1ac1cf839 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:09.782599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e91eeb50-aec3-498a-808e-ff7fc5f9b422 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:09.782918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f45ac643-64c2-44a1-872f-fec1ac1cf839 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:09.789510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e91eeb50-aec3-498a-808e-ff7fc5f9b422 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:09.789954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e91eeb50-aec3-498a-808e-ff7fc5f9b422 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:09.790734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e91eeb50-aec3-498a-808e-ff7fc5f9b422 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:09.791172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e91eeb50-aec3-498a-808e-ff7fc5f9b422 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:09.991810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f45ac643-64c2-44a1-872f-fec1ac1cf839 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:09.999744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e91eeb50-aec3-498a-808e-ff7fc5f9b422 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:10.000691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f45ac643-64c2-44a1-872f-fec1ac1cf839 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.231976 Jul 25 19:50:10.001306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1235/2628] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:09 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:10.009334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e91eeb50-aec3-498a-808e-ff7fc5f9b422 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:10.011210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e91eeb50-aec3-498a-808e-ff7fc5f9b422 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:10.012528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e91eeb50-aec3-498a-808e-ff7fc5f9b422 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.235102 Jul 25 19:50:10.013107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1394/2629] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:09 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:11.022907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-38572010-7349-49c9-b698-1c3a52ca81c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:11.023429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-38572010-7349-49c9-b698-1c3a52ca81c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:11.030151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38572010-7349-49c9-b698-1c3a52ca81c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:11.030597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38572010-7349-49c9-b698-1c3a52ca81c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:11.031378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38572010-7349-49c9-b698-1c3a52ca81c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:11.031842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38572010-7349-49c9-b698-1c3a52ca81c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:11.041597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6fa1d1cf-3eaa-49f9-852c-d67875b80426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:11.042342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6fa1d1cf-3eaa-49f9-852c-d67875b80426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:11.050837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fa1d1cf-3eaa-49f9-852c-d67875b80426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:11.051285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fa1d1cf-3eaa-49f9-852c-d67875b80426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:11.052291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fa1d1cf-3eaa-49f9-852c-d67875b80426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:11.052724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6fa1d1cf-3eaa-49f9-852c-d67875b80426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:11.269753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-38572010-7349-49c9-b698-1c3a52ca81c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:11.277877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6fa1d1cf-3eaa-49f9-852c-d67875b80426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:11.284444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-38572010-7349-49c9-b698-1c3a52ca81c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.265540 Jul 25 19:50:11.299457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1236/2630] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:11 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:11.306385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6fa1d1cf-3eaa-49f9-852c-d67875b80426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:11.309186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6fa1d1cf-3eaa-49f9-852c-d67875b80426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:11.309825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6fa1d1cf-3eaa-49f9-852c-d67875b80426 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.273580 Jul 25 19:50:11.310389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1395/2631] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:11 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:12.306220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c9fdcc8-4617-44c7-85bc-cf7cca9b1f26 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:12.306829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c9fdcc8-4617-44c7-85bc-cf7cca9b1f26 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:12.313791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c9fdcc8-4617-44c7-85bc-cf7cca9b1f26 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:12.314238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c9fdcc8-4617-44c7-85bc-cf7cca9b1f26 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:12.314994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c9fdcc8-4617-44c7-85bc-cf7cca9b1f26 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:12.315425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c9fdcc8-4617-44c7-85bc-cf7cca9b1f26 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:12.337014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ae752d87-bebb-4591-b6eb-8362b1241aa3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:12.337785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ae752d87-bebb-4591-b6eb-8362b1241aa3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:12.345084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae752d87-bebb-4591-b6eb-8362b1241aa3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:12.345532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae752d87-bebb-4591-b6eb-8362b1241aa3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:12.346309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae752d87-bebb-4591-b6eb-8362b1241aa3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:12.346746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ae752d87-bebb-4591-b6eb-8362b1241aa3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:12.529705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c9fdcc8-4617-44c7-85bc-cf7cca9b1f26 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:12.533096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ae752d87-bebb-4591-b6eb-8362b1241aa3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:12.538451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c9fdcc8-4617-44c7-85bc-cf7cca9b1f26 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.235953 Jul 25 19:50:12.539135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1237/2632] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:12 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:12.542515 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ae752d87-bebb-4591-b6eb-8362b1241aa3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:12.544038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ae752d87-bebb-4591-b6eb-8362b1241aa3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:12.545684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ae752d87-bebb-4591-b6eb-8362b1241aa3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.212125 Jul 25 19:50:12.546245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1396/2633] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:12 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:13.564157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1c20c941-1e96-4777-aa36-6ca120a8c326 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:13.564905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1c20c941-1e96-4777-aa36-6ca120a8c326 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:13.570433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-357ed51e-e8b3-411b-9b67-135705ddd611 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:13.571079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-357ed51e-e8b3-411b-9b67-135705ddd611 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:13.571864 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c20c941-1e96-4777-aa36-6ca120a8c326 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:13.572314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c20c941-1e96-4777-aa36-6ca120a8c326 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:13.573085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c20c941-1e96-4777-aa36-6ca120a8c326 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:13.573624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c20c941-1e96-4777-aa36-6ca120a8c326 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:13.577953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-357ed51e-e8b3-411b-9b67-135705ddd611 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:13.578410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-357ed51e-e8b3-411b-9b67-135705ddd611 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:13.579192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-357ed51e-e8b3-411b-9b67-135705ddd611 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:13.579663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-357ed51e-e8b3-411b-9b67-135705ddd611 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:13.786286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1c20c941-1e96-4777-aa36-6ca120a8c326 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:13.788852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-357ed51e-e8b3-411b-9b67-135705ddd611 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:13.794669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1c20c941-1e96-4777-aa36-6ca120a8c326 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.235110 Jul 25 19:50:13.796284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1238/2634] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:13 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:50:13.797940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-357ed51e-e8b3-411b-9b67-135705ddd611 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:13.799433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-357ed51e-e8b3-411b-9b67-135705ddd611 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:13.800647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-357ed51e-e8b3-411b-9b67-135705ddd611 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.234076 Jul 25 19:50:13.801188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1397/2635] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:13 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:14.817930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b8e6e728-268a-4e3c-bca4-ac4bb56f5b6c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:14.818794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b8e6e728-268a-4e3c-bca4-ac4bb56f5b6c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:14.824218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-122e99b7-8a6f-45be-a4a0-29bebca2a5ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:14.824832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-122e99b7-8a6f-45be-a4a0-29bebca2a5ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:14.826426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8e6e728-268a-4e3c-bca4-ac4bb56f5b6c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:14.827199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=48 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:50:14.827344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8e6e728-268a-4e3c-bca4-ac4bb56f5b6c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:14.828023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8e6e728-268a-4e3c-bca4-ac4bb56f5b6c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:14.828532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8e6e728-268a-4e3c-bca4-ac4bb56f5b6c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:14.833121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-122e99b7-8a6f-45be-a4a0-29bebca2a5ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:14.833560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-122e99b7-8a6f-45be-a4a0-29bebca2a5ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:14.834334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-122e99b7-8a6f-45be-a4a0-29bebca2a5ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:14.834763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-122e99b7-8a6f-45be-a4a0-29bebca2a5ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:15.039049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b8e6e728-268a-4e3c-bca4-ac4bb56f5b6c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:15.048163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b8e6e728-268a-4e3c-bca4-ac4bb56f5b6c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.234085 Jul 25 19:50:15.049093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1239/2636] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:14 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:15.052523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-122e99b7-8a6f-45be-a4a0-29bebca2a5ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:15.062160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-122e99b7-8a6f-45be-a4a0-29bebca2a5ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:15.063711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-122e99b7-8a6f-45be-a4a0-29bebca2a5ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:15.064906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-122e99b7-8a6f-45be-a4a0-29bebca2a5ba tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.245019 Jul 25 19:50:15.065471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1398/2637] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:14 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:16.073789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c5dfb4ee-cb0a-461d-8eca-ad224e1d25ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:16.074392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c5dfb4ee-cb0a-461d-8eca-ad224e1d25ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:16.076996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=48 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:50:16.082661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5dfb4ee-cb0a-461d-8eca-ad224e1d25ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:16.083100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5dfb4ee-cb0a-461d-8eca-ad224e1d25ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:16.083911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5dfb4ee-cb0a-461d-8eca-ad224e1d25ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:16.084337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5dfb4ee-cb0a-461d-8eca-ad224e1d25ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:16.089683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6124ab9c-7477-4070-bf03-5b745baa55c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:16.090373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6124ab9c-7477-4070-bf03-5b745baa55c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:16.096748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6124ab9c-7477-4070-bf03-5b745baa55c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:16.097197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6124ab9c-7477-4070-bf03-5b745baa55c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:16.097965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6124ab9c-7477-4070-bf03-5b745baa55c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:16.098410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6124ab9c-7477-4070-bf03-5b745baa55c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:16.362024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c5dfb4ee-cb0a-461d-8eca-ad224e1d25ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:16.370507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c5dfb4ee-cb0a-461d-8eca-ad224e1d25ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.300956 Jul 25 19:50:16.371759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1240/2638] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:16 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:16.374470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6124ab9c-7477-4070-bf03-5b745baa55c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:16.384070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6124ab9c-7477-4070-bf03-5b745baa55c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:16.385551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6124ab9c-7477-4070-bf03-5b745baa55c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:16.386700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6124ab9c-7477-4070-bf03-5b745baa55c3 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.300883 Jul 25 19:50:16.387253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1399/2639] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:16 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:17.393686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0737ab41-afa8-4080-8fef-137e3761a88c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:17.394416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0737ab41-afa8-4080-8fef-137e3761a88c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:17.400844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0737ab41-afa8-4080-8fef-137e3761a88c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:17.401290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0737ab41-afa8-4080-8fef-137e3761a88c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:17.402056 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0737ab41-afa8-4080-8fef-137e3761a88c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:17.402492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0737ab41-afa8-4080-8fef-137e3761a88c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:17.410828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0c382338-3060-43e2-8aa1-9bded9a6ecd2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:17.411433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0c382338-3060-43e2-8aa1-9bded9a6ecd2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:17.418033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0c382338-3060-43e2-8aa1-9bded9a6ecd2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:17.418480 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0c382338-3060-43e2-8aa1-9bded9a6ecd2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:17.419252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0c382338-3060-43e2-8aa1-9bded9a6ecd2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:17.419783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0c382338-3060-43e2-8aa1-9bded9a6ecd2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:17.424709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:50:17.609303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0737ab41-afa8-4080-8fef-137e3761a88c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:17.618507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0737ab41-afa8-4080-8fef-137e3761a88c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.228580 Jul 25 19:50:17.619110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1241/2640] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:17 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:17.622424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0c382338-3060-43e2-8aa1-9bded9a6ecd2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:17.633735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0c382338-3060-43e2-8aa1-9bded9a6ecd2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:17.635067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0c382338-3060-43e2-8aa1-9bded9a6ecd2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:17.636291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0c382338-3060-43e2-8aa1-9bded9a6ecd2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.229465 Jul 25 19:50:17.636876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1400/2641] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:18.645072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e7d86356-366c-40be-9789-816fee4fac00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:18.645843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e7d86356-366c-40be-9789-816fee4fac00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:18.653119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7d86356-366c-40be-9789-816fee4fac00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:18.653592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7d86356-366c-40be-9789-816fee4fac00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:18.655587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7d86356-366c-40be-9789-816fee4fac00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:18.656127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7d86356-366c-40be-9789-816fee4fac00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:18.662115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-36b49905-b4fd-4344-8f8e-85aaa426f2cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:18.662974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-36b49905-b4fd-4344-8f8e-85aaa426f2cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:18.674055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36b49905-b4fd-4344-8f8e-85aaa426f2cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:18.674495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36b49905-b4fd-4344-8f8e-85aaa426f2cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:18.675298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36b49905-b4fd-4344-8f8e-85aaa426f2cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:18.675826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36b49905-b4fd-4344-8f8e-85aaa426f2cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:18.897475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-36b49905-b4fd-4344-8f8e-85aaa426f2cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:18.901442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e7d86356-366c-40be-9789-816fee4fac00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:18.907188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-36b49905-b4fd-4344-8f8e-85aaa426f2cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:18.908743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-36b49905-b4fd-4344-8f8e-85aaa426f2cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:18.909692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e7d86356-366c-40be-9789-816fee4fac00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.268818 Jul 25 19:50:18.909918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-36b49905-b4fd-4344-8f8e-85aaa426f2cc tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.252163 Jul 25 19:50:18.911244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1242/2642] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:18 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:18.911454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1401/2643] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:18 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:19.021176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:50:19.021861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:50:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:50:19.933643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af333a90-52b3-480b-9940-41c32fbb7ef7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:19.934244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-80eac452-46b7-4190-824b-0cf25768715d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:19.934621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af333a90-52b3-480b-9940-41c32fbb7ef7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:19.934764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-80eac452-46b7-4190-824b-0cf25768715d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:19.942389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af333a90-52b3-480b-9940-41c32fbb7ef7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:19.942878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af333a90-52b3-480b-9940-41c32fbb7ef7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:19.943268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-80eac452-46b7-4190-824b-0cf25768715d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:19.943736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-80eac452-46b7-4190-824b-0cf25768715d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:19.943904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af333a90-52b3-480b-9940-41c32fbb7ef7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:19.944172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af333a90-52b3-480b-9940-41c32fbb7ef7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:19.944514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-80eac452-46b7-4190-824b-0cf25768715d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:19.944948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-80eac452-46b7-4190-824b-0cf25768715d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:20.149018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-80eac452-46b7-4190-824b-0cf25768715d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:20.152972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-af333a90-52b3-480b-9940-41c32fbb7ef7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:20.158658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-80eac452-46b7-4190-824b-0cf25768715d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:20.160178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-80eac452-46b7-4190-824b-0cf25768715d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:20.161388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-80eac452-46b7-4190-824b-0cf25768715d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.231142 Jul 25 19:50:20.161948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1402/2644] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:19 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:20.162261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af333a90-52b3-480b-9940-41c32fbb7ef7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.232535 Jul 25 19:50:20.162848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1243/2645] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:19 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:21.185644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4cd84aba-7a6c-401f-82d6-07384d343668 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:21.186530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4cd84aba-7a6c-401f-82d6-07384d343668 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:21.186699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f52424fb-f6e9-4d78-9baf-2f62c2f291cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:21.187368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f52424fb-f6e9-4d78-9baf-2f62c2f291cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:21.193456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cd84aba-7a6c-401f-82d6-07384d343668 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:21.193909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cd84aba-7a6c-401f-82d6-07384d343668 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:21.194686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cd84aba-7a6c-401f-82d6-07384d343668 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:21.195126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4cd84aba-7a6c-401f-82d6-07384d343668 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:21.198707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f52424fb-f6e9-4d78-9baf-2f62c2f291cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:21.199676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f52424fb-f6e9-4d78-9baf-2f62c2f291cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:21.201526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f52424fb-f6e9-4d78-9baf-2f62c2f291cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:21.202340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f52424fb-f6e9-4d78-9baf-2f62c2f291cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:21.403356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4cd84aba-7a6c-401f-82d6-07384d343668 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:21.413108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4cd84aba-7a6c-401f-82d6-07384d343668 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.231124 Jul 25 19:50:21.413834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1403/2646] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:21 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:21.416296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f52424fb-f6e9-4d78-9baf-2f62c2f291cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:21.426804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f52424fb-f6e9-4d78-9baf-2f62c2f291cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:21.428460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f52424fb-f6e9-4d78-9baf-2f62c2f291cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:21.429648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f52424fb-f6e9-4d78-9baf-2f62c2f291cd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.247698 Jul 25 19:50:21.430368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1244/2647] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:21 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:22.435723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2a5c4b87-1bae-47d5-8fa3-a01a7bd68128 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:22.436405 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2a5c4b87-1bae-47d5-8fa3-a01a7bd68128 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:22.444500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2a5c4b87-1bae-47d5-8fa3-a01a7bd68128 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:22.444951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2a5c4b87-1bae-47d5-8fa3-a01a7bd68128 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:22.445749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2a5c4b87-1bae-47d5-8fa3-a01a7bd68128 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:22.446187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2a5c4b87-1bae-47d5-8fa3-a01a7bd68128 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:22.453987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-419933b6-2ebf-4c15-abe1-3fd36bab7c45 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:22.454588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-419933b6-2ebf-4c15-abe1-3fd36bab7c45 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:22.461585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-419933b6-2ebf-4c15-abe1-3fd36bab7c45 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:22.462163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-419933b6-2ebf-4c15-abe1-3fd36bab7c45 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:22.462819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-419933b6-2ebf-4c15-abe1-3fd36bab7c45 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:22.463263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-419933b6-2ebf-4c15-abe1-3fd36bab7c45 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:22.668420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2a5c4b87-1bae-47d5-8fa3-a01a7bd68128 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:22.673511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-419933b6-2ebf-4c15-abe1-3fd36bab7c45 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:22.677348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2a5c4b87-1bae-47d5-8fa3-a01a7bd68128 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.245509 Jul 25 19:50:22.677934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1404/2648] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:22 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:22.683263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-419933b6-2ebf-4c15-abe1-3fd36bab7c45 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:22.684798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-419933b6-2ebf-4c15-abe1-3fd36bab7c45 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:22.686087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-419933b6-2ebf-4c15-abe1-3fd36bab7c45 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.236222 Jul 25 19:50:22.686583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1245/2649] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:22 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:23.700305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e4d0897b-863e-4552-99da-e303ba7dd921 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:23.702693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e4d0897b-863e-4552-99da-e303ba7dd921 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:23.708677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4d0897b-863e-4552-99da-e303ba7dd921 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:23.709119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4d0897b-863e-4552-99da-e303ba7dd921 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:23.709889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-09285603-b715-41e5-a110-9f03f6ac5433 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:23.710393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4d0897b-863e-4552-99da-e303ba7dd921 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:23.710393 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4d0897b-863e-4552-99da-e303ba7dd921 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:23.710586 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-09285603-b715-41e5-a110-9f03f6ac5433 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:23.718552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09285603-b715-41e5-a110-9f03f6ac5433 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:23.719002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09285603-b715-41e5-a110-9f03f6ac5433 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:23.719818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09285603-b715-41e5-a110-9f03f6ac5433 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:23.720261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09285603-b715-41e5-a110-9f03f6ac5433 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:23.925594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e4d0897b-863e-4552-99da-e303ba7dd921 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:23.936332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e4d0897b-863e-4552-99da-e303ba7dd921 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.239529 Jul 25 19:50:23.937282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1405/2650] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:23 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:23.939100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-09285603-b715-41e5-a110-9f03f6ac5433 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:23.948333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-09285603-b715-41e5-a110-9f03f6ac5433 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:23.949826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-09285603-b715-41e5-a110-9f03f6ac5433 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:23.951900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-09285603-b715-41e5-a110-9f03f6ac5433 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.245227 Jul 25 19:50:23.952332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1246/2651] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:23 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:24.958926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-76e1ba8b-df5a-4ae7-bbc3-2f8d44fc0d4b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:24.959582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-76e1ba8b-df5a-4ae7-bbc3-2f8d44fc0d4b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:24.966665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e1ba8b-df5a-4ae7-bbc3-2f8d44fc0d4b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:24.967108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e1ba8b-df5a-4ae7-bbc3-2f8d44fc0d4b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:24.968121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e1ba8b-df5a-4ae7-bbc3-2f8d44fc0d4b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:24.968545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-76e1ba8b-df5a-4ae7-bbc3-2f8d44fc0d4b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:24.974410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e817e364-4484-4eb8-b80c-d73fa6a35730 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:24.975177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e817e364-4484-4eb8-b80c-d73fa6a35730 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:24.983374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e817e364-4484-4eb8-b80c-d73fa6a35730 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:24.983855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e817e364-4484-4eb8-b80c-d73fa6a35730 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:24.984692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e817e364-4484-4eb8-b80c-d73fa6a35730 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:24.985130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e817e364-4484-4eb8-b80c-d73fa6a35730 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:25.006134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:50:25.195140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-76e1ba8b-df5a-4ae7-bbc3-2f8d44fc0d4b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:25.204327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-76e1ba8b-df5a-4ae7-bbc3-2f8d44fc0d4b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.249675 Jul 25 19:50:25.204921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1406/2652] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:24 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:50:25.206601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e817e364-4484-4eb8-b80c-d73fa6a35730 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:25.216413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e817e364-4484-4eb8-b80c-d73fa6a35730 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:25.218459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e817e364-4484-4eb8-b80c-d73fa6a35730 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:25.219712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e817e364-4484-4eb8-b80c-d73fa6a35730 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.249252 Jul 25 19:50:25.220275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1247/2653] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:24 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:26.226723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7759668f-761b-4565-a474-ebbf0876d8e8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:26.227364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7759668f-761b-4565-a474-ebbf0876d8e8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:26.235963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7759668f-761b-4565-a474-ebbf0876d8e8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:26.236377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7759668f-761b-4565-a474-ebbf0876d8e8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:26.237178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7759668f-761b-4565-a474-ebbf0876d8e8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:26.237900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7759668f-761b-4565-a474-ebbf0876d8e8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:26.243861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1797a4f8-dd22-4259-98ef-03144518c677 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:26.244858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1797a4f8-dd22-4259-98ef-03144518c677 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:26.252177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1797a4f8-dd22-4259-98ef-03144518c677 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:26.252839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1797a4f8-dd22-4259-98ef-03144518c677 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:26.253651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1797a4f8-dd22-4259-98ef-03144518c677 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:26.254088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1797a4f8-dd22-4259-98ef-03144518c677 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:26.459153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7759668f-761b-4565-a474-ebbf0876d8e8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:26.469495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7759668f-761b-4565-a474-ebbf0876d8e8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.246793 Jul 25 19:50:26.470245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1407/2654] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:26 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:26.475770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1797a4f8-dd22-4259-98ef-03144518c677 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:26.485712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1797a4f8-dd22-4259-98ef-03144518c677 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:26.487377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1797a4f8-dd22-4259-98ef-03144518c677 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:26.488874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1797a4f8-dd22-4259-98ef-03144518c677 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.249770 Jul 25 19:50:26.489513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1248/2655] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:26 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:27.491624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8f47ae68-1649-4494-b290-d5fe9aecedd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:27.492187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8f47ae68-1649-4494-b290-d5fe9aecedd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:27.499555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f47ae68-1649-4494-b290-d5fe9aecedd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:27.499999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f47ae68-1649-4494-b290-d5fe9aecedd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:27.500765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f47ae68-1649-4494-b290-d5fe9aecedd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:27.501197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f47ae68-1649-4494-b290-d5fe9aecedd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:27.514444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1728ff5c-aea0-4b85-88b9-702fcb7e4a49 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:27.515131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1728ff5c-aea0-4b85-88b9-702fcb7e4a49 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:27.522569 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1728ff5c-aea0-4b85-88b9-702fcb7e4a49 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:27.523016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1728ff5c-aea0-4b85-88b9-702fcb7e4a49 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:27.523825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1728ff5c-aea0-4b85-88b9-702fcb7e4a49 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:27.524271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1728ff5c-aea0-4b85-88b9-702fcb7e4a49 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:27.983299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8f47ae68-1649-4494-b290-d5fe9aecedd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:27.991803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8f47ae68-1649-4494-b290-d5fe9aecedd3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.504636 Jul 25 19:50:27.992414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1408/2656] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:27 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:28.008137 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1728ff5c-aea0-4b85-88b9-702fcb7e4a49 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:28.017928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1728ff5c-aea0-4b85-88b9-702fcb7e4a49 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:28.019418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1728ff5c-aea0-4b85-88b9-702fcb7e4a49 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:28.020681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1728ff5c-aea0-4b85-88b9-702fcb7e4a49 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.510864 Jul 25 19:50:28.021234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1249/2657] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:27 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:29.014358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4c9679a0-4bbe-4788-8de1-43e05948593b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:29.014912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4c9679a0-4bbe-4788-8de1-43e05948593b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:29.021439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c9679a0-4bbe-4788-8de1-43e05948593b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:29.021880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c9679a0-4bbe-4788-8de1-43e05948593b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:29.022644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c9679a0-4bbe-4788-8de1-43e05948593b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:29.023075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c9679a0-4bbe-4788-8de1-43e05948593b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:29.044242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3c6ea7a6-3a22-491a-974b-464e84dd76c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:29.045398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3c6ea7a6-3a22-491a-974b-464e84dd76c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:29.052247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c6ea7a6-3a22-491a-974b-464e84dd76c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:29.052700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c6ea7a6-3a22-491a-974b-464e84dd76c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:29.053591 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c6ea7a6-3a22-491a-974b-464e84dd76c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:29.054066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c6ea7a6-3a22-491a-974b-464e84dd76c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:29.239851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4c9679a0-4bbe-4788-8de1-43e05948593b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:29.247057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3c6ea7a6-3a22-491a-974b-464e84dd76c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:29.250585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4c9679a0-4bbe-4788-8de1-43e05948593b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.240185 Jul 25 19:50:29.251172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1409/2658] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:29 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:29.256392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3c6ea7a6-3a22-491a-974b-464e84dd76c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:29.257898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3c6ea7a6-3a22-491a-974b-464e84dd76c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:29.259073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3c6ea7a6-3a22-491a-974b-464e84dd76c6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.218905 Jul 25 19:50:29.260614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1250/2659] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:29 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:30.273793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bc61ca85-3d0b-446c-8822-59490edb470f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:30.274378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bc61ca85-3d0b-446c-8822-59490edb470f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:30.282236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc61ca85-3d0b-446c-8822-59490edb470f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:30.282725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc61ca85-3d0b-446c-8822-59490edb470f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:30.283519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc61ca85-3d0b-446c-8822-59490edb470f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:30.283964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bc61ca85-3d0b-446c-8822-59490edb470f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:30.286615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-950d5ab2-1371-42fb-83ea-9e150ffb7bf5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:30.287224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-950d5ab2-1371-42fb-83ea-9e150ffb7bf5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:30.293859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-950d5ab2-1371-42fb-83ea-9e150ffb7bf5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:30.294401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-950d5ab2-1371-42fb-83ea-9e150ffb7bf5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:30.295794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-950d5ab2-1371-42fb-83ea-9e150ffb7bf5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:30.296236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-950d5ab2-1371-42fb-83ea-9e150ffb7bf5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:30.496004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bc61ca85-3d0b-446c-8822-59490edb470f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:30.500080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-950d5ab2-1371-42fb-83ea-9e150ffb7bf5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:30.505445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bc61ca85-3d0b-446c-8822-59490edb470f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.235649 Jul 25 19:50:30.506072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1410/2660] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:30 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:30.512522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-950d5ab2-1371-42fb-83ea-9e150ffb7bf5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:30.514600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-950d5ab2-1371-42fb-83ea-9e150ffb7bf5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:30.516000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-950d5ab2-1371-42fb-83ea-9e150ffb7bf5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.233310 Jul 25 19:50:30.516618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1251/2661] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:30 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:31.529789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-66732571-8585-4856-b9c3-783c51bbd351 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:31.530356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-66732571-8585-4856-b9c3-783c51bbd351 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:31.537280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66732571-8585-4856-b9c3-783c51bbd351 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:31.537724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66732571-8585-4856-b9c3-783c51bbd351 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:31.538492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66732571-8585-4856-b9c3-783c51bbd351 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:31.538960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66732571-8585-4856-b9c3-783c51bbd351 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:31.540480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-08ff1e22-3099-4eea-af6f-8e43ce8e3133 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:31.541086 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-08ff1e22-3099-4eea-af6f-8e43ce8e3133 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:31.548452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08ff1e22-3099-4eea-af6f-8e43ce8e3133 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:31.548899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08ff1e22-3099-4eea-af6f-8e43ce8e3133 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:31.549676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08ff1e22-3099-4eea-af6f-8e43ce8e3133 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:31.550161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08ff1e22-3099-4eea-af6f-8e43ce8e3133 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:31.751984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-66732571-8585-4856-b9c3-783c51bbd351 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:31.760105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08ff1e22-3099-4eea-af6f-8e43ce8e3133 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:31.761539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-66732571-8585-4856-b9c3-783c51bbd351 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.236474 Jul 25 19:50:31.762325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1411/2662] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:31 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:31.769968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08ff1e22-3099-4eea-af6f-8e43ce8e3133 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:31.771458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08ff1e22-3099-4eea-af6f-8e43ce8e3133 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:31.772659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-08ff1e22-3099-4eea-af6f-8e43ce8e3133 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.236335 Jul 25 19:50:31.773219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1252/2663] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:31 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:32.784498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aee2a32f-39ed-4ffc-8bb5-ca38b429a0ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:32.785142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aee2a32f-39ed-4ffc-8bb5-ca38b429a0ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:32.791797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee2a32f-39ed-4ffc-8bb5-ca38b429a0ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:32.792244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee2a32f-39ed-4ffc-8bb5-ca38b429a0ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:32.793046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee2a32f-39ed-4ffc-8bb5-ca38b429a0ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:32.793481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aee2a32f-39ed-4ffc-8bb5-ca38b429a0ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:32.801233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-94f0ade8-9fdd-4a3e-8edb-d9e89941b2f9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:32.801836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-94f0ade8-9fdd-4a3e-8edb-d9e89941b2f9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:32.808571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94f0ade8-9fdd-4a3e-8edb-d9e89941b2f9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:32.809012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94f0ade8-9fdd-4a3e-8edb-d9e89941b2f9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:32.809778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94f0ade8-9fdd-4a3e-8edb-d9e89941b2f9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:32.810267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94f0ade8-9fdd-4a3e-8edb-d9e89941b2f9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:32.999310 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-aee2a32f-39ed-4ffc-8bb5-ca38b429a0ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:33.008362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aee2a32f-39ed-4ffc-8bb5-ca38b429a0ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.227675 Jul 25 19:50:33.008956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1412/2664] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:32 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:33.014420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-94f0ade8-9fdd-4a3e-8edb-d9e89941b2f9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:33.023234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-94f0ade8-9fdd-4a3e-8edb-d9e89941b2f9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:33.024769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-94f0ade8-9fdd-4a3e-8edb-d9e89941b2f9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:33.025932 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-94f0ade8-9fdd-4a3e-8edb-d9e89941b2f9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.228565 Jul 25 19:50:33.026492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1253/2665] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:32 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:34.030097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9d0e9b15-83e1-4b9c-a51d-db376be4fb00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:34.030676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9d0e9b15-83e1-4b9c-a51d-db376be4fb00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:34.038476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d0e9b15-83e1-4b9c-a51d-db376be4fb00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:34.038916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d0e9b15-83e1-4b9c-a51d-db376be4fb00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:34.039723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d0e9b15-83e1-4b9c-a51d-db376be4fb00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:34.040185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d0e9b15-83e1-4b9c-a51d-db376be4fb00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:34.051556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb81b7ec-6093-4eda-abda-c357f2f2a552 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:34.052170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb81b7ec-6093-4eda-abda-c357f2f2a552 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:34.058950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb81b7ec-6093-4eda-abda-c357f2f2a552 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:34.059475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb81b7ec-6093-4eda-abda-c357f2f2a552 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:34.060419 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb81b7ec-6093-4eda-abda-c357f2f2a552 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:34.060933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb81b7ec-6093-4eda-abda-c357f2f2a552 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:34.268887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9d0e9b15-83e1-4b9c-a51d-db376be4fb00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:34.277509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9d0e9b15-83e1-4b9c-a51d-db376be4fb00 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.251650 Jul 25 19:50:34.278218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1413/2666] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:34 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:34.285960 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb81b7ec-6093-4eda-abda-c357f2f2a552 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:34.295166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb81b7ec-6093-4eda-abda-c357f2f2a552 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:34.296840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb81b7ec-6093-4eda-abda-c357f2f2a552 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:34.298004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb81b7ec-6093-4eda-abda-c357f2f2a552 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.250615 Jul 25 19:50:34.298563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1254/2667] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:34 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:34.587857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:50:34.588107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:50:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:50:35.300926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e98b9189-1764-4b29-972a-6863793d1f4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:35.301465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e98b9189-1764-4b29-972a-6863793d1f4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:35.308669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e98b9189-1764-4b29-972a-6863793d1f4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:35.309115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e98b9189-1764-4b29-972a-6863793d1f4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:35.310427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e98b9189-1764-4b29-972a-6863793d1f4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:35.311013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e98b9189-1764-4b29-972a-6863793d1f4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:35.324330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b9f3dee4-f69d-4784-95f0-1632b55090b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:35.324924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b9f3dee4-f69d-4784-95f0-1632b55090b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:35.332956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9f3dee4-f69d-4784-95f0-1632b55090b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:35.333404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9f3dee4-f69d-4784-95f0-1632b55090b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:35.334182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9f3dee4-f69d-4784-95f0-1632b55090b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:35.334619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9f3dee4-f69d-4784-95f0-1632b55090b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:35.605904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e98b9189-1764-4b29-972a-6863793d1f4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:35.614697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e98b9189-1764-4b29-972a-6863793d1f4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.317850 Jul 25 19:50:35.615423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1414/2668] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:35 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:35.648530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9f3dee4-f69d-4784-95f0-1632b55090b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:35.658793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9f3dee4-f69d-4784-95f0-1632b55090b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:35.659784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9f3dee4-f69d-4784-95f0-1632b55090b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:35.660980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b9f3dee4-f69d-4784-95f0-1632b55090b6 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.340520 Jul 25 19:50:35.661557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1255/2669] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:35 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:36.637502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-59d47c30-7e68-43f9-810f-404d60e79ca2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:36.638763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-59d47c30-7e68-43f9-810f-404d60e79ca2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:36.645894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59d47c30-7e68-43f9-810f-404d60e79ca2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:36.646345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59d47c30-7e68-43f9-810f-404d60e79ca2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:36.647110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59d47c30-7e68-43f9-810f-404d60e79ca2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:36.647569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59d47c30-7e68-43f9-810f-404d60e79ca2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:36.686023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f1b8b08e-a558-4a53-9432-fa1896a4646c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:36.687008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f1b8b08e-a558-4a53-9432-fa1896a4646c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:36.694026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1b8b08e-a558-4a53-9432-fa1896a4646c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:36.694599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1b8b08e-a558-4a53-9432-fa1896a4646c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:36.695462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1b8b08e-a558-4a53-9432-fa1896a4646c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:36.696002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1b8b08e-a558-4a53-9432-fa1896a4646c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:36.852432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-59d47c30-7e68-43f9-810f-404d60e79ca2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:36.862859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-59d47c30-7e68-43f9-810f-404d60e79ca2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.228685 Jul 25 19:50:36.863489 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1415/2670] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:36 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:36.883480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f1b8b08e-a558-4a53-9432-fa1896a4646c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:36.893032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f1b8b08e-a558-4a53-9432-fa1896a4646c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:36.894454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f1b8b08e-a558-4a53-9432-fa1896a4646c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:36.895671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f1b8b08e-a558-4a53-9432-fa1896a4646c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.213972 Jul 25 19:50:36.896233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1256/2671] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:36 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:37.885225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e6316a3d-c8c6-418c-a533-8b47eecd4909 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:37.885850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e6316a3d-c8c6-418c-a533-8b47eecd4909 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:37.893352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e6316a3d-c8c6-418c-a533-8b47eecd4909 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:37.893793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e6316a3d-c8c6-418c-a533-8b47eecd4909 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:37.894626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e6316a3d-c8c6-418c-a533-8b47eecd4909 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:37.895053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e6316a3d-c8c6-418c-a533-8b47eecd4909 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:37.918276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b34917c-d84f-4918-b905-3e08e9f186c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:37.918924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b34917c-d84f-4918-b905-3e08e9f186c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:37.926473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b34917c-d84f-4918-b905-3e08e9f186c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:37.927000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b34917c-d84f-4918-b905-3e08e9f186c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:37.927711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b34917c-d84f-4918-b905-3e08e9f186c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:37.928140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b34917c-d84f-4918-b905-3e08e9f186c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:38.117240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e6316a3d-c8c6-418c-a533-8b47eecd4909 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:38.121043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:50:38.124691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b34917c-d84f-4918-b905-3e08e9f186c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:38.128152 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e6316a3d-c8c6-418c-a533-8b47eecd4909 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.246827 Jul 25 19:50:38.128746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1416/2672] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:37 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:38.141403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b34917c-d84f-4918-b905-3e08e9f186c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:38.144458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b34917c-d84f-4918-b905-3e08e9f186c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:38.146735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b34917c-d84f-4918-b905-3e08e9f186c0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.232032 Jul 25 19:50:38.147797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1257/2673] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:37 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:39.150750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a66896ab-69b1-489d-8df5-e96a1624ba31 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:39.151345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a66896ab-69b1-489d-8df5-e96a1624ba31 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:39.158365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a66896ab-69b1-489d-8df5-e96a1624ba31 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:39.158808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a66896ab-69b1-489d-8df5-e96a1624ba31 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:39.159597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a66896ab-69b1-489d-8df5-e96a1624ba31 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:39.160035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a66896ab-69b1-489d-8df5-e96a1624ba31 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:39.171875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0e5f0dd9-81ef-48bd-9a88-47f36d3784f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:39.172509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0e5f0dd9-81ef-48bd-9a88-47f36d3784f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:39.180512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e5f0dd9-81ef-48bd-9a88-47f36d3784f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:39.180955 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e5f0dd9-81ef-48bd-9a88-47f36d3784f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:39.181720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e5f0dd9-81ef-48bd-9a88-47f36d3784f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:39.182192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e5f0dd9-81ef-48bd-9a88-47f36d3784f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:39.383180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a66896ab-69b1-489d-8df5-e96a1624ba31 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:39.388480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0e5f0dd9-81ef-48bd-9a88-47f36d3784f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:39.392141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a66896ab-69b1-489d-8df5-e96a1624ba31 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.245159 Jul 25 19:50:39.392725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1417/2674] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:39 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:50:39.397247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0e5f0dd9-81ef-48bd-9a88-47f36d3784f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:39.398793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0e5f0dd9-81ef-48bd-9a88-47f36d3784f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:39.399987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0e5f0dd9-81ef-48bd-9a88-47f36d3784f1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.233485 Jul 25 19:50:39.400543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1258/2675] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:39 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:40.414809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c8ac3647-8d20-4c40-98c3-e0f81c022d01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:40.415417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c8ac3647-8d20-4c40-98c3-e0f81c022d01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:40.423960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8ac3647-8d20-4c40-98c3-e0f81c022d01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:40.424147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f1ab6db-a148-4628-ab51-50e1c7c71e48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:40.424598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8ac3647-8d20-4c40-98c3-e0f81c022d01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:40.424768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2f1ab6db-a148-4628-ab51-50e1c7c71e48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:40.425080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8ac3647-8d20-4c40-98c3-e0f81c022d01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:40.425521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c8ac3647-8d20-4c40-98c3-e0f81c022d01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:40.431362 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f1ab6db-a148-4628-ab51-50e1c7c71e48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:40.431843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f1ab6db-a148-4628-ab51-50e1c7c71e48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:40.432620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f1ab6db-a148-4628-ab51-50e1c7c71e48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:40.433061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f1ab6db-a148-4628-ab51-50e1c7c71e48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:40.642730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2f1ab6db-a148-4628-ab51-50e1c7c71e48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:40.646172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c8ac3647-8d20-4c40-98c3-e0f81c022d01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:40.651733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2f1ab6db-a148-4628-ab51-50e1c7c71e48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:40.654024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2f1ab6db-a148-4628-ab51-50e1c7c71e48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:40.655067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c8ac3647-8d20-4c40-98c3-e0f81c022d01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.244415 Jul 25 19:50:40.655203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2f1ab6db-a148-4628-ab51-50e1c7c71e48 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.234935 Jul 25 19:50:40.655859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1418/2676] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:40 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:40.656022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1259/2677] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:40 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:41.677452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aa08f961-73f7-400c-842a-2db44297ec71 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:41.678426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee61e8bd-9056-4e56-8f24-1afbbf7c6cb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:41.679081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aa08f961-73f7-400c-842a-2db44297ec71 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:41.679307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee61e8bd-9056-4e56-8f24-1afbbf7c6cb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:41.685841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee61e8bd-9056-4e56-8f24-1afbbf7c6cb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:41.686300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee61e8bd-9056-4e56-8f24-1afbbf7c6cb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:41.686464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa08f961-73f7-400c-842a-2db44297ec71 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:41.686767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa08f961-73f7-400c-842a-2db44297ec71 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:41.687064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee61e8bd-9056-4e56-8f24-1afbbf7c6cb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:41.687494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee61e8bd-9056-4e56-8f24-1afbbf7c6cb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:41.687634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa08f961-73f7-400c-842a-2db44297ec71 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:41.687999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aa08f961-73f7-400c-842a-2db44297ec71 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:41.891339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee61e8bd-9056-4e56-8f24-1afbbf7c6cb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:41.898747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-aa08f961-73f7-400c-842a-2db44297ec71 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:41.902176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee61e8bd-9056-4e56-8f24-1afbbf7c6cb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:41.904110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee61e8bd-9056-4e56-8f24-1afbbf7c6cb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:41.905396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee61e8bd-9056-4e56-8f24-1afbbf7c6cb8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.231179 Jul 25 19:50:41.905881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1260/2678] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:41 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:41.908142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aa08f961-73f7-400c-842a-2db44297ec71 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.235096 Jul 25 19:50:41.908718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1419/2679] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:41 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:42.929627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fda10df2-6926-4848-ab20-335d9d015bd5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:42.930323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fda10df2-6926-4848-ab20-335d9d015bd5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:42.930554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-31fa428d-53d8-40ba-95cb-9c6b3ce7a1e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:42.931341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-31fa428d-53d8-40ba-95cb-9c6b3ce7a1e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:42.939087 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31fa428d-53d8-40ba-95cb-9c6b3ce7a1e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:42.939552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31fa428d-53d8-40ba-95cb-9c6b3ce7a1e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:42.939750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fda10df2-6926-4848-ab20-335d9d015bd5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:42.940201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fda10df2-6926-4848-ab20-335d9d015bd5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:42.940324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31fa428d-53d8-40ba-95cb-9c6b3ce7a1e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:42.940743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31fa428d-53d8-40ba-95cb-9c6b3ce7a1e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:42.940965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fda10df2-6926-4848-ab20-335d9d015bd5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:42.941397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fda10df2-6926-4848-ab20-335d9d015bd5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:43.150293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fda10df2-6926-4848-ab20-335d9d015bd5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:43.155501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-31fa428d-53d8-40ba-95cb-9c6b3ce7a1e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:43.160266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fda10df2-6926-4848-ab20-335d9d015bd5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:43.161934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fda10df2-6926-4848-ab20-335d9d015bd5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:43.163218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fda10df2-6926-4848-ab20-335d9d015bd5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.237522 Jul 25 19:50:43.163906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1261/2680] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:42 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:43.165453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-31fa428d-53d8-40ba-95cb-9c6b3ce7a1e9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.238707 Jul 25 19:50:43.166124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1420/2681] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:42 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:50:44.188647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b2db42d3-0286-4e87-83c8-4ba820943d3c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:44.189226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ba1e452e-9269-4ffd-a5e3-fdd718f97bcd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:44.189615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b2db42d3-0286-4e87-83c8-4ba820943d3c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:44.189721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ba1e452e-9269-4ffd-a5e3-fdd718f97bcd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:44.196118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba1e452e-9269-4ffd-a5e3-fdd718f97bcd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:44.196343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2db42d3-0286-4e87-83c8-4ba820943d3c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:44.196565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba1e452e-9269-4ffd-a5e3-fdd718f97bcd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:44.196678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2db42d3-0286-4e87-83c8-4ba820943d3c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:44.197338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba1e452e-9269-4ffd-a5e3-fdd718f97bcd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:44.197444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2db42d3-0286-4e87-83c8-4ba820943d3c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:44.197773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba1e452e-9269-4ffd-a5e3-fdd718f97bcd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:44.197883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2db42d3-0286-4e87-83c8-4ba820943d3c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:44.406135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2db42d3-0286-4e87-83c8-4ba820943d3c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:44.413895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ba1e452e-9269-4ffd-a5e3-fdd718f97bcd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:44.416207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2db42d3-0286-4e87-83c8-4ba820943d3c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:44.417709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2db42d3-0286-4e87-83c8-4ba820943d3c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:44.418923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b2db42d3-0286-4e87-83c8-4ba820943d3c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.235125 Jul 25 19:50:44.420357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1262/2682] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:44 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:44.423859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ba1e452e-9269-4ffd-a5e3-fdd718f97bcd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.239930 Jul 25 19:50:44.424536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1421/2683] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:44 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:45.443858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fe73efa1-7803-4d0a-ac43-38afffa68635 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:45.444448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fe73efa1-7803-4d0a-ac43-38afffa68635 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:45.445456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e360f80c-3363-43e1-b668-ea7fa7be2fb8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:45.446080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e360f80c-3363-43e1-b668-ea7fa7be2fb8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:45.449495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=48 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:50:45.453439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe73efa1-7803-4d0a-ac43-38afffa68635 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:45.453887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe73efa1-7803-4d0a-ac43-38afffa68635 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:45.454257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e360f80c-3363-43e1-b668-ea7fa7be2fb8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:45.454757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe73efa1-7803-4d0a-ac43-38afffa68635 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:45.454911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e360f80c-3363-43e1-b668-ea7fa7be2fb8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:45.455196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe73efa1-7803-4d0a-ac43-38afffa68635 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:45.455649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e360f80c-3363-43e1-b668-ea7fa7be2fb8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:45.456140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e360f80c-3363-43e1-b668-ea7fa7be2fb8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:45.663327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe73efa1-7803-4d0a-ac43-38afffa68635 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:45.670884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e360f80c-3363-43e1-b668-ea7fa7be2fb8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:45.673412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe73efa1-7803-4d0a-ac43-38afffa68635 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:45.674922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe73efa1-7803-4d0a-ac43-38afffa68635 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:45.676121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fe73efa1-7803-4d0a-ac43-38afffa68635 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.236387 Jul 25 19:50:45.676706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1263/2684] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:45 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:45.679637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e360f80c-3363-43e1-b668-ea7fa7be2fb8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.237840 Jul 25 19:50:45.680219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1422/2685] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:45 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:46.702571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-10fdcdae-9a89-4545-9bfc-c775672af1eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:46.703209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-00b36563-f40f-4d74-a935-60c90f84adec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:46.703622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-10fdcdae-9a89-4545-9bfc-c775672af1eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:46.703726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-00b36563-f40f-4d74-a935-60c90f84adec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:46.705930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=48 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:50:46.711083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00b36563-f40f-4d74-a935-60c90f84adec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:46.711320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00b36563-f40f-4d74-a935-60c90f84adec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:46.711443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10fdcdae-9a89-4545-9bfc-c775672af1eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:46.711880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10fdcdae-9a89-4545-9bfc-c775672af1eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:46.712098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00b36563-f40f-4d74-a935-60c90f84adec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:46.712586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-00b36563-f40f-4d74-a935-60c90f84adec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:46.712693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10fdcdae-9a89-4545-9bfc-c775672af1eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:46.713085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10fdcdae-9a89-4545-9bfc-c775672af1eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:46.718181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:50:46.922291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10fdcdae-9a89-4545-9bfc-c775672af1eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:46.929482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-00b36563-f40f-4d74-a935-60c90f84adec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:46.930592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-10fdcdae-9a89-4545-9bfc-c775672af1eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.232326 Jul 25 19:50:46.931181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1264/2686] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:46 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:46.939678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-00b36563-f40f-4d74-a935-60c90f84adec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:46.941486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-00b36563-f40f-4d74-a935-60c90f84adec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:46.942780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-00b36563-f40f-4d74-a935-60c90f84adec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.244702 Jul 25 19:50:46.943386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1423/2687] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:46 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:47.952858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c3d3540-8290-4610-82c5-94e196dd1269 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:47.953466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7c3d3540-8290-4610-82c5-94e196dd1269 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:47.960251 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c3d3540-8290-4610-82c5-94e196dd1269 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:47.960699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c3d3540-8290-4610-82c5-94e196dd1269 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:47.961556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c3d3540-8290-4610-82c5-94e196dd1269 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:47.961999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c3d3540-8290-4610-82c5-94e196dd1269 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:47.967824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b0550f0c-b2b2-4b82-94a8-e15899144022 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:47.968809 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b0550f0c-b2b2-4b82-94a8-e15899144022 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:47.975106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b0550f0c-b2b2-4b82-94a8-e15899144022 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:47.975741 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b0550f0c-b2b2-4b82-94a8-e15899144022 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:47.976503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b0550f0c-b2b2-4b82-94a8-e15899144022 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:47.976935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b0550f0c-b2b2-4b82-94a8-e15899144022 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:48.182215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7c3d3540-8290-4610-82c5-94e196dd1269 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:48.184981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b0550f0c-b2b2-4b82-94a8-e15899144022 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:48.190618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c3d3540-8290-4610-82c5-94e196dd1269 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.242208 Jul 25 19:50:48.191292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1265/2688] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:47 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:48.193872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b0550f0c-b2b2-4b82-94a8-e15899144022 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:48.195380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b0550f0c-b2b2-4b82-94a8-e15899144022 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:48.196575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b0550f0c-b2b2-4b82-94a8-e15899144022 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.233625 Jul 25 19:50:48.197245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1424/2689] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:47 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:49.212762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b371cdf2-3010-4f88-981b-facc7cc02121 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:49.213371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b371cdf2-3010-4f88-981b-facc7cc02121 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:49.220799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a296bc8f-008c-4b1a-8a08-3b37aa373bc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:49.221487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a296bc8f-008c-4b1a-8a08-3b37aa373bc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:49.221681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b371cdf2-3010-4f88-981b-facc7cc02121 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:49.222344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b371cdf2-3010-4f88-981b-facc7cc02121 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:49.223985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b371cdf2-3010-4f88-981b-facc7cc02121 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:49.224971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b371cdf2-3010-4f88-981b-facc7cc02121 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:49.228065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a296bc8f-008c-4b1a-8a08-3b37aa373bc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:49.228507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a296bc8f-008c-4b1a-8a08-3b37aa373bc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:49.229392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a296bc8f-008c-4b1a-8a08-3b37aa373bc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:49.229867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a296bc8f-008c-4b1a-8a08-3b37aa373bc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:49.432326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b371cdf2-3010-4f88-981b-facc7cc02121 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:49.441435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b371cdf2-3010-4f88-981b-facc7cc02121 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.232546 Jul 25 19:50:49.448830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1266/2690] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:49 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:50:49.449125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a296bc8f-008c-4b1a-8a08-3b37aa373bc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:49.455282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a296bc8f-008c-4b1a-8a08-3b37aa373bc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:49.457158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a296bc8f-008c-4b1a-8a08-3b37aa373bc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:49.458328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a296bc8f-008c-4b1a-8a08-3b37aa373bc4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.241529 Jul 25 19:50:49.458894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1425/2691] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:49 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:50.463260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-828d9f53-390d-4127-8c24-3cc64f1d16f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:50.464036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-828d9f53-390d-4127-8c24-3cc64f1d16f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:50.472208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-828d9f53-390d-4127-8c24-3cc64f1d16f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:50.472659 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-828d9f53-390d-4127-8c24-3cc64f1d16f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:50.473437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-828d9f53-390d-4127-8c24-3cc64f1d16f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:50.473873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-828d9f53-390d-4127-8c24-3cc64f1d16f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:50.483909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-102caadc-d548-46db-8ed8-bb9b7618877c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:50.484517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-102caadc-d548-46db-8ed8-bb9b7618877c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:50.491718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-102caadc-d548-46db-8ed8-bb9b7618877c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:50.492161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-102caadc-d548-46db-8ed8-bb9b7618877c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:50.492926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-102caadc-d548-46db-8ed8-bb9b7618877c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:50.493359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-102caadc-d548-46db-8ed8-bb9b7618877c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:50.680162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-828d9f53-390d-4127-8c24-3cc64f1d16f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:50.692518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-102caadc-d548-46db-8ed8-bb9b7618877c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:50.694407 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-828d9f53-390d-4127-8c24-3cc64f1d16f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.235026 Jul 25 19:50:50.694849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1267/2692] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:50 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:50.701970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-102caadc-d548-46db-8ed8-bb9b7618877c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:50.703474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-102caadc-d548-46db-8ed8-bb9b7618877c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:50.704704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-102caadc-d548-46db-8ed8-bb9b7618877c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.226235 Jul 25 19:50:50.705348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1426/2693] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:50 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:51.715370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6af71ad6-aca2-46ad-be4e-42eaa9bf203b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:51.716552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6af71ad6-aca2-46ad-be4e-42eaa9bf203b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:51.723809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6af71ad6-aca2-46ad-be4e-42eaa9bf203b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:51.724257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6af71ad6-aca2-46ad-be4e-42eaa9bf203b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:51.725134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6af71ad6-aca2-46ad-be4e-42eaa9bf203b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:51.725566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6af71ad6-aca2-46ad-be4e-42eaa9bf203b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:51.732078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-129b17f3-566b-43f4-8f24-b775677a621d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:51.733376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-129b17f3-566b-43f4-8f24-b775677a621d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:51.742806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-129b17f3-566b-43f4-8f24-b775677a621d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:51.746237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-129b17f3-566b-43f4-8f24-b775677a621d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:51.746237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-129b17f3-566b-43f4-8f24-b775677a621d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:51.746237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-129b17f3-566b-43f4-8f24-b775677a621d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:51.994543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6af71ad6-aca2-46ad-be4e-42eaa9bf203b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:52.004238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6af71ad6-aca2-46ad-be4e-42eaa9bf203b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.292631 Jul 25 19:50:52.004902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1268/2694] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:51 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:52.009034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-129b17f3-566b-43f4-8f24-b775677a621d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:52.019791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-129b17f3-566b-43f4-8f24-b775677a621d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:52.021379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-129b17f3-566b-43f4-8f24-b775677a621d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:52.022620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-129b17f3-566b-43f4-8f24-b775677a621d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 200 len: 1802 microversion: 2.20 time: 0.297240 Jul 25 19:50:52.023246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1427/2695] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:51 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 1802 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:52.070619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a06ce456-ee5e-4aab-b58e-34ab58cdb1c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '.version_select at 0x7feb0c3ebee0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:52.077000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a06ce456-ee5e-4aab-b58e-34ab58cdb1c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [328b3fa1-ce51-4d0e-961e-f9b376db3494] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 19:50:53.033129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-41d53577-569d-4345-9600-7a798356c264 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:53.033823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-41d53577-569d-4345-9600-7a798356c264 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:53.040397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41d53577-569d-4345-9600-7a798356c264 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:53.040847 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41d53577-569d-4345-9600-7a798356c264 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:53.041615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41d53577-569d-4345-9600-7a798356c264 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:53.042056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41d53577-569d-4345-9600-7a798356c264 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:53.086973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [None req-a06ce456-ee5e-4aab-b58e-34ab58cdb1c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [328b3fa1-ce51-4d0e-961e-f9b376db3494] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40912. Jul 25 19:50:53.118063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a06ce456-ee5e-4aab-b58e-34ab58cdb1c1 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287126177" status: 204 len: 0 microversion: 2.20 time: 1.058265 Jul 25 19:50:53.119942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1269/2696] 10.222.0.18 () {60 vars in 1262 bytes} [Mon Jul 25 19:50:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287126177 => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 19:50:53.221416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-41d53577-569d-4345-9600-7a798356c264 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:53.230093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-41d53577-569d-4345-9600-7a798356c264 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.201596 Jul 25 19:50:53.230690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1428/2697] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:53 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:50:54.256491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-75e4a767-03ca-43a4-912e-f218d322e51e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:54.257148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-75e4a767-03ca-43a4-912e-f218d322e51e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:54.269262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75e4a767-03ca-43a4-912e-f218d322e51e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:54.269714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75e4a767-03ca-43a4-912e-f218d322e51e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:54.270747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75e4a767-03ca-43a4-912e-f218d322e51e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:54.271193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75e4a767-03ca-43a4-912e-f218d322e51e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:54.423668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-75e4a767-03ca-43a4-912e-f218d322e51e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:54.433846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-75e4a767-03ca-43a4-912e-f218d322e51e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.183098 Jul 25 19:50:54.435062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1270/2698] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:54 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:54.581228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-20ba478d-a249-4994-9001-605bd2e0068d req-fd063771-2d66-45e6-b8b0-53d9cadd30dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1007369a-dd3c-4837-95f4-e8326d600031", "tag": "33faefb9-12a5-4e86-b189-357d316c5553"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:50:54.592047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-20ba478d-a249-4994-9001-605bd2e0068d req-fd063771-2d66-45e6-b8b0-53d9cadd30dc service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:54.592662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-20ba478d-a249-4994-9001-605bd2e0068d req-fd063771-2d66-45e6-b8b0-53d9cadd30dc service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:54.605529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-20ba478d-a249-4994-9001-605bd2e0068d req-fd063771-2d66-45e6-b8b0-53d9cadd30dc service nova] Creating event network-changed:33faefb9-12a5-4e86-b189-357d316c5553 for instance 1007369a-dd3c-4837-95f4-e8326d600031 on hv-cinder-85093 Jul 25 19:50:54.612905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-20ba478d-a249-4994-9001-605bd2e0068d req-fd063771-2d66-45e6-b8b0-53d9cadd30dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134278 Jul 25 19:50:54.617355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1429/2699] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:50:54.718581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6de09b1f-e372-41de-83f1-cd45d4a1e0fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Action: 'create', calling method: .version_select at 0x7feb0c3a20d0>, body: {"keypair": {"name": "tempest-keypair-7386311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi/DKdEavaHUXksnOG3MHViC/736q81+Y29biX4xmj1NevfckRCxRyWrRowz8PWFUtWf2lbYK/0kYmuoau3BLZHuI4PN42+njMAXG4XuNC0+nayxLU5JFuMthCP7dfYrQ=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:50:54.753965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-6de09b1f-e372-41de-83f1-cd45d4a1e0fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Getting quotas for project 5ef063ca1eb846d78ff8901d2a3fc0a3. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:50:54.770512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-6de09b1f-e372-41de-83f1-cd45d4a1e0fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Getting quotas for user ac2e584f88cd46f280b7fe04aa1382fd and project 5ef063ca1eb846d78ff8901d2a3fc0a3. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:50:54.807394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6de09b1f-e372-41de-83f1-cd45d4a1e0fd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.20 time: 0.097228 Jul 25 19:50:54.808148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1271/2700] 10.222.0.18 () {62 vars in 1200 bytes} [Mon Jul 25 19:50:54 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 19:50:55.457692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d1565e7a-eb37-4ef5-a533-a4d95c06ffb2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:55.458654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d1565e7a-eb37-4ef5-a533-a4d95c06ffb2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:55.471901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d1565e7a-eb37-4ef5-a533-a4d95c06ffb2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:55.472751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d1565e7a-eb37-4ef5-a533-a4d95c06ffb2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:55.473796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d1565e7a-eb37-4ef5-a533-a4d95c06ffb2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:55.474604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d1565e7a-eb37-4ef5-a533-a4d95c06ffb2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:55.744541 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d1565e7a-eb37-4ef5-a533-a4d95c06ffb2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:55.758155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d1565e7a-eb37-4ef5-a533-a4d95c06ffb2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.305113 Jul 25 19:50:55.766655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1430/2701] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:55 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:50:56.407542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-44934320", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37f737e5-0e29-4d81-b926-6469f3832816"}], "security_groups": [{"name": "tempest-securitygroup--584993513"}], "key_name": "tempest-keypair-7386311", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:50:56.523064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] validate_networks() for [('37f737e5-0e29-4d81-b926-6469f3832816', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:50:56.789689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f8e32a88-f06c-4b7a-b696-a395ebe77d7a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:56.790306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f8e32a88-f06c-4b7a-b696-a395ebe77d7a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:56.797988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8e32a88-f06c-4b7a-b696-a395ebe77d7a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:56.798436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8e32a88-f06c-4b7a-b696-a395ebe77d7a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:56.799254 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8e32a88-f06c-4b7a-b696-a395ebe77d7a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:56.799837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8e32a88-f06c-4b7a-b696-a395ebe77d7a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:57.035365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f8e32a88-f06c-4b7a-b696-a395ebe77d7a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:57.045442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f8e32a88-f06c-4b7a-b696-a395ebe77d7a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.259242 Jul 25 19:50:57.046204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1431/2702] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:56 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:50:57.073691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:50:57.074123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:50:57.074599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:50:57.075122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:50:57.075672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:50:57.084872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:57.085320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:57.086120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:57.086561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:57.105557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Getting quotas for project 5ef063ca1eb846d78ff8901d2a3fc0a3. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:50:57.111675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Getting quotas for user ac2e584f88cd46f280b7fe04aa1382fd and project 5ef063ca1eb846d78ff8901d2a3fc0a3. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:50:57.129448 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:50:57.133378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:50:57.186593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f6a78785-b04c-46d7-8c0d-337371cd015c tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.784666 Jul 25 19:50:57.187460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1272/2703] 10.222.0.18 () {62 vars in 1188 bytes} [Mon Jul 25 19:50:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 19:50:57.199037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a88890d4-0c39-44b3-8b70-8bceb520f514 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:57.199669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a88890d4-0c39-44b3-8b70-8bceb520f514 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:57.261282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a88890d4-0c39-44b3-8b70-8bceb520f514 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:57.272070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a88890d4-0c39-44b3-8b70-8bceb520f514 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:57.273820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a88890d4-0c39-44b3-8b70-8bceb520f514 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:57.275160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a88890d4-0c39-44b3-8b70-8bceb520f514 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1277 microversion: 2.20 time: 0.080015 Jul 25 19:50:57.275932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1432/2704] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:57 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1277 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:50:58.068672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bff6708b-fc02-42aa-8bf1-b532e5c63703 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:58.069274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bff6708b-fc02-42aa-8bf1-b532e5c63703 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:58.077249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bff6708b-fc02-42aa-8bf1-b532e5c63703 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:58.077703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bff6708b-fc02-42aa-8bf1-b532e5c63703 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:58.078483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bff6708b-fc02-42aa-8bf1-b532e5c63703 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:58.078925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bff6708b-fc02-42aa-8bf1-b532e5c63703 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:58.299388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-75e8cdbc-ba4f-47d0-bea0-76617303300a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:58.300128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-75e8cdbc-ba4f-47d0-bea0-76617303300a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:58.308055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75e8cdbc-ba4f-47d0-bea0-76617303300a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:58.308509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75e8cdbc-ba4f-47d0-bea0-76617303300a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:58.309517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75e8cdbc-ba4f-47d0-bea0-76617303300a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:58.309977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-75e8cdbc-ba4f-47d0-bea0-76617303300a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:58.472051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-75e8cdbc-ba4f-47d0-bea0-76617303300a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:58.486351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-75e8cdbc-ba4f-47d0-bea0-76617303300a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:58.488713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-75e8cdbc-ba4f-47d0-bea0-76617303300a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:58.490113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-75e8cdbc-ba4f-47d0-bea0-76617303300a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1329 microversion: 2.20 time: 0.194659 Jul 25 19:50:58.503750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1433/2705] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:58 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1329 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:58.610791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bff6708b-fc02-42aa-8bf1-b532e5c63703 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:58.626661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bff6708b-fc02-42aa-8bf1-b532e5c63703 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.561940 Jul 25 19:50:58.627636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1273/2706] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:58 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:50:59.519054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ef82f8d4-100d-4bcf-982c-8d62e39f72e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:59.520110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ef82f8d4-100d-4bcf-982c-8d62e39f72e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:59.528278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef82f8d4-100d-4bcf-982c-8d62e39f72e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:59.528880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef82f8d4-100d-4bcf-982c-8d62e39f72e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:59.529651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef82f8d4-100d-4bcf-982c-8d62e39f72e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:59.530084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef82f8d4-100d-4bcf-982c-8d62e39f72e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:59.650133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-024a227d-dd6a-4c89-8ad5-f64577a6fc45 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:59.650987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-024a227d-dd6a-4c89-8ad5-f64577a6fc45 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:50:59.658489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-024a227d-dd6a-4c89-8ad5-f64577a6fc45 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:59.659243 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-024a227d-dd6a-4c89-8ad5-f64577a6fc45 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:59.660352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-024a227d-dd6a-4c89-8ad5-f64577a6fc45 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:59.661173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-024a227d-dd6a-4c89-8ad5-f64577a6fc45 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:59.881406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ef82f8d4-100d-4bcf-982c-8d62e39f72e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:59.889713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ef82f8d4-100d-4bcf-982c-8d62e39f72e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:59.891279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ef82f8d4-100d-4bcf-982c-8d62e39f72e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:59.892428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ef82f8d4-100d-4bcf-982c-8d62e39f72e0 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1402 microversion: 2.20 time: 0.378109 Jul 25 19:50:59.895433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1434/2707] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:50:59 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1402 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:50:59.951065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-024a227d-dd6a-4c89-8ad5-f64577a6fc45 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:50:59.959593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-024a227d-dd6a-4c89-8ad5-f64577a6fc45 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.313566 Jul 25 19:50:59.960273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1274/2708] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:50:59 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:00.366256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-8a97a857-b85f-4047-b7fc-d13ca1b1ad21 req-429bfbeb-8036-484d-ac75-4f75e23a3d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df24471-2352-4e79-be15-e395eabf66e8", "tag": "a3db8d82-3435-4460-803e-926d12177856"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:51:00.390413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-8a97a857-b85f-4047-b7fc-d13ca1b1ad21 req-429bfbeb-8036-484d-ac75-4f75e23a3d15 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:00.390787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-8a97a857-b85f-4047-b7fc-d13ca1b1ad21 req-429bfbeb-8036-484d-ac75-4f75e23a3d15 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:00.395607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:00.405644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-8a97a857-b85f-4047-b7fc-d13ca1b1ad21 req-429bfbeb-8036-484d-ac75-4f75e23a3d15 service nova] Creating event network-changed:a3db8d82-3435-4460-803e-926d12177856 for instance 2df24471-2352-4e79-be15-e395eabf66e8 on hv-cinder-85093 Jul 25 19:51:00.411482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-8a97a857-b85f-4047-b7fc-d13ca1b1ad21 req-429bfbeb-8036-484d-ac75-4f75e23a3d15 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062525 Jul 25 19:51:00.412451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1435/2709] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:51:00.918424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c8ba44b8-bca9-4e35-8b01-29ced9a54bdb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:00.919589 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c8ba44b8-bca9-4e35-8b01-29ced9a54bdb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:00.926652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8ba44b8-bca9-4e35-8b01-29ced9a54bdb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:00.927140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8ba44b8-bca9-4e35-8b01-29ced9a54bdb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:00.927959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8ba44b8-bca9-4e35-8b01-29ced9a54bdb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:00.928397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8ba44b8-bca9-4e35-8b01-29ced9a54bdb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:00.988980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9bead6a2-37b8-4297-993e-18e8d4c17d7c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:00.990084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9bead6a2-37b8-4297-993e-18e8d4c17d7c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:00.997151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9bead6a2-37b8-4297-993e-18e8d4c17d7c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:00.997706 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9bead6a2-37b8-4297-993e-18e8d4c17d7c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:00.998501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9bead6a2-37b8-4297-993e-18e8d4c17d7c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:00.998929 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9bead6a2-37b8-4297-993e-18e8d4c17d7c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:01.166560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c8ba44b8-bca9-4e35-8b01-29ced9a54bdb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:01.176213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c8ba44b8-bca9-4e35-8b01-29ced9a54bdb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:01.177785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c8ba44b8-bca9-4e35-8b01-29ced9a54bdb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:01.178974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c8ba44b8-bca9-4e35-8b01-29ced9a54bdb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1402 microversion: 2.20 time: 0.264616 Jul 25 19:51:01.179571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1275/2710] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:51:00 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1402 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:51:01.198104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9bead6a2-37b8-4297-993e-18e8d4c17d7c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:01.208231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9bead6a2-37b8-4297-993e-18e8d4c17d7c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.229742 Jul 25 19:51:01.208865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1436/2711] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:00 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:02.202770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a0df94c1-8841-4435-bccf-c4122a0714ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:02.203377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a0df94c1-8841-4435-bccf-c4122a0714ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:02.211046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0df94c1-8841-4435-bccf-c4122a0714ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:02.211621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0df94c1-8841-4435-bccf-c4122a0714ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:02.212417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0df94c1-8841-4435-bccf-c4122a0714ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:02.212863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0df94c1-8841-4435-bccf-c4122a0714ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:02.235085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f9e6486a-3ac3-44ff-b6ee-3a64555822f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:02.236632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f9e6486a-3ac3-44ff-b6ee-3a64555822f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:02.253360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9e6486a-3ac3-44ff-b6ee-3a64555822f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:02.254319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9e6486a-3ac3-44ff-b6ee-3a64555822f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:02.255883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9e6486a-3ac3-44ff-b6ee-3a64555822f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:02.256689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f9e6486a-3ac3-44ff-b6ee-3a64555822f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:02.565578 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0df94c1-8841-4435-bccf-c4122a0714ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:02.577541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0df94c1-8841-4435-bccf-c4122a0714ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:02.578209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f9e6486a-3ac3-44ff-b6ee-3a64555822f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:02.579880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0df94c1-8841-4435-bccf-c4122a0714ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:02.581772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a0df94c1-8841-4435-bccf-c4122a0714ac tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1402 microversion: 2.20 time: 0.383408 Jul 25 19:51:02.582943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1276/2712] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:51:02 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1402 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:51:02.605435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f9e6486a-3ac3-44ff-b6ee-3a64555822f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.378379 Jul 25 19:51:02.606993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1437/2713] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:02 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:03.608622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e68c8c79-fe58-48fc-b6c4-bb67067d35a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:03.609640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e68c8c79-fe58-48fc-b6c4-bb67067d35a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:03.617019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e68c8c79-fe58-48fc-b6c4-bb67067d35a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:03.617506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e68c8c79-fe58-48fc-b6c4-bb67067d35a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:03.618514 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e68c8c79-fe58-48fc-b6c4-bb67067d35a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:03.618992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e68c8c79-fe58-48fc-b6c4-bb67067d35a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:03.643180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-86ac1072-b44a-43b6-a301-86f3c963f6d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:03.644023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-86ac1072-b44a-43b6-a301-86f3c963f6d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:03.651237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86ac1072-b44a-43b6-a301-86f3c963f6d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:03.651711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86ac1072-b44a-43b6-a301-86f3c963f6d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:03.652504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86ac1072-b44a-43b6-a301-86f3c963f6d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:03.652934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86ac1072-b44a-43b6-a301-86f3c963f6d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:03.858309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e68c8c79-fe58-48fc-b6c4-bb67067d35a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:03.863772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86ac1072-b44a-43b6-a301-86f3c963f6d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:03.873084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-86ac1072-b44a-43b6-a301-86f3c963f6d6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.234073 Jul 25 19:51:03.874144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1438/2714] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:03 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:03.876176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e68c8c79-fe58-48fc-b6c4-bb67067d35a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:03.877731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e68c8c79-fe58-48fc-b6c4-bb67067d35a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:03.878884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e68c8c79-fe58-48fc-b6c4-bb67067d35a8 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1402 microversion: 2.20 time: 0.276674 Jul 25 19:51:03.879904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1277/2715] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:51:03 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1402 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:51:04.906855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-82b1ad97-fadf-4e19-9534-efa5e0a89af4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:04.907776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-82b1ad97-fadf-4e19-9534-efa5e0a89af4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:04.907963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4a75b01e-3686-47c7-b339-07bcf01305f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:04.908657 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4a75b01e-3686-47c7-b339-07bcf01305f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:04.916381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a75b01e-3686-47c7-b339-07bcf01305f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:04.916827 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a75b01e-3686-47c7-b339-07bcf01305f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:04.917599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a75b01e-3686-47c7-b339-07bcf01305f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:04.918034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a75b01e-3686-47c7-b339-07bcf01305f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:04.920884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82b1ad97-fadf-4e19-9534-efa5e0a89af4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:04.921327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82b1ad97-fadf-4e19-9534-efa5e0a89af4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:04.922118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82b1ad97-fadf-4e19-9534-efa5e0a89af4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:04.922561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82b1ad97-fadf-4e19-9534-efa5e0a89af4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:05.151466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4a75b01e-3686-47c7-b339-07bcf01305f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:05.157282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-82b1ad97-fadf-4e19-9534-efa5e0a89af4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:05.161622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4a75b01e-3686-47c7-b339-07bcf01305f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.258352 Jul 25 19:51:05.162700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1278/2716] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:04 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:05.179461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-82b1ad97-fadf-4e19-9534-efa5e0a89af4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:05.180656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-82b1ad97-fadf-4e19-9534-efa5e0a89af4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:05.181813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-82b1ad97-fadf-4e19-9534-efa5e0a89af4 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1402 microversion: 2.20 time: 0.280185 Jul 25 19:51:05.182377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1439/2717] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:51:04 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1402 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:51:05.229353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-332afe4f-84e0-4deb-9aae-9d7a921f9549 req-ab222bca-700e-495f-8fb0-9b59af55c18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df24471-2352-4e79-be15-e395eabf66e8", "name": "network-vif-plugged", "status": "completed", "tag": "a3db8d82-3435-4460-803e-926d12177856"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:51:05.241485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-332afe4f-84e0-4deb-9aae-9d7a921f9549 req-ab222bca-700e-495f-8fb0-9b59af55c18d service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:05.241962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-332afe4f-84e0-4deb-9aae-9d7a921f9549 req-ab222bca-700e-495f-8fb0-9b59af55c18d service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:05.255297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-332afe4f-84e0-4deb-9aae-9d7a921f9549 req-ab222bca-700e-495f-8fb0-9b59af55c18d service nova] Creating event network-vif-plugged:a3db8d82-3435-4460-803e-926d12177856 for instance 2df24471-2352-4e79-be15-e395eabf66e8 on hv-cinder-85093 Jul 25 19:51:05.262890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-332afe4f-84e0-4deb-9aae-9d7a921f9549 req-ab222bca-700e-495f-8fb0-9b59af55c18d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037146 Jul 25 19:51:05.264405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1279/2718] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:51:06.183766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a5db05c6-915e-4ef0-8717-9adb82226d88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:06.184441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a5db05c6-915e-4ef0-8717-9adb82226d88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:06.193168 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5db05c6-915e-4ef0-8717-9adb82226d88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:06.193696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5db05c6-915e-4ef0-8717-9adb82226d88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:06.194475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5db05c6-915e-4ef0-8717-9adb82226d88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:06.195081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5db05c6-915e-4ef0-8717-9adb82226d88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:06.223274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0f81499b-a30e-4cb8-a792-37b0dfb53c4b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:06.223999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0f81499b-a30e-4cb8-a792-37b0dfb53c4b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:06.231019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f81499b-a30e-4cb8-a792-37b0dfb53c4b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:06.232022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f81499b-a30e-4cb8-a792-37b0dfb53c4b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:06.232795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f81499b-a30e-4cb8-a792-37b0dfb53c4b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:06.233226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f81499b-a30e-4cb8-a792-37b0dfb53c4b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:06.432392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a5db05c6-915e-4ef0-8717-9adb82226d88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:06.441639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a5db05c6-915e-4ef0-8717-9adb82226d88 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.261573 Jul 25 19:51:06.442593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1440/2719] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:06 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:06.447342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f81499b-a30e-4cb8-a792-37b0dfb53c4b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:06.462739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f81499b-a30e-4cb8-a792-37b0dfb53c4b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:06.466135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f81499b-a30e-4cb8-a792-37b0dfb53c4b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:06.468387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0f81499b-a30e-4cb8-a792-37b0dfb53c4b tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1402 microversion: 2.20 time: 0.249473 Jul 25 19:51:06.469435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1280/2720] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:51:06 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1402 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:51:07.466193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8203258d-38ac-442b-91fa-d7958bd14a4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:07.467008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8203258d-38ac-442b-91fa-d7958bd14a4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:07.470005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:07.477983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8203258d-38ac-442b-91fa-d7958bd14a4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:07.478577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8203258d-38ac-442b-91fa-d7958bd14a4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:07.479482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8203258d-38ac-442b-91fa-d7958bd14a4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:07.480189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8203258d-38ac-442b-91fa-d7958bd14a4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:07.494366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5692a65d-0026-4425-a1dc-2b6d36f34adb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:07.495242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5692a65d-0026-4425-a1dc-2b6d36f34adb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:07.497325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:07.498542 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=10 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:07.508570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5692a65d-0026-4425-a1dc-2b6d36f34adb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:07.509017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5692a65d-0026-4425-a1dc-2b6d36f34adb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:07.509824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5692a65d-0026-4425-a1dc-2b6d36f34adb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:07.510264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5692a65d-0026-4425-a1dc-2b6d36f34adb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:07.752065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8203258d-38ac-442b-91fa-d7958bd14a4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:07.770317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5692a65d-0026-4425-a1dc-2b6d36f34adb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:07.771093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8203258d-38ac-442b-91fa-d7958bd14a4f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.308395 Jul 25 19:51:07.771993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1441/2721] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:07 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:07.790475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5692a65d-0026-4425-a1dc-2b6d36f34adb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:07.795724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5692a65d-0026-4425-a1dc-2b6d36f34adb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:07.798164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5692a65d-0026-4425-a1dc-2b6d36f34adb tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1595 microversion: 2.20 time: 0.307753 Jul 25 19:51:07.799257 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1281/2722] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:51:07 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1595 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:51:07.830078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a5276677-211d-49b6-a980-ca4c5ec98fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:07.830561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a5276677-211d-49b6-a980-ca4c5ec98fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:07.840461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5276677-211d-49b6-a980-ca4c5ec98fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:07.841548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5276677-211d-49b6-a980-ca4c5ec98fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:07.842370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5276677-211d-49b6-a980-ca4c5ec98fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:07.843179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a5276677-211d-49b6-a980-ca4c5ec98fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:07.941834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a5276677-211d-49b6-a980-ca4c5ec98fc5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.115351 Jul 25 19:51:07.942814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1442/2723] 10.222.0.18 () {60 vars in 1316 bytes} [Mon Jul 25 19:51:07 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:51:08.800520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f76ecef7-c5a8-4b55-ae4f-c925009e4e5a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:08.801163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f76ecef7-c5a8-4b55-ae4f-c925009e4e5a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:08.809534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f76ecef7-c5a8-4b55-ae4f-c925009e4e5a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:08.809966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f76ecef7-c5a8-4b55-ae4f-c925009e4e5a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:08.811225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f76ecef7-c5a8-4b55-ae4f-c925009e4e5a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:08.811701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f76ecef7-c5a8-4b55-ae4f-c925009e4e5a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:08.984608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f76ecef7-c5a8-4b55-ae4f-c925009e4e5a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:08.993914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f76ecef7-c5a8-4b55-ae4f-c925009e4e5a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.199504 Jul 25 19:51:08.994824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1282/2724] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:08 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:09.390249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-d5d7aec3-1e64-40bb-9250-ea0a69782a67 req-9aacfa4b-fc6e-4df4-b0b4-6c54d2f6e854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df24471-2352-4e79-be15-e395eabf66e8", "tag": "a3db8d82-3435-4460-803e-926d12177856"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:51:09.402048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-d5d7aec3-1e64-40bb-9250-ea0a69782a67 req-9aacfa4b-fc6e-4df4-b0b4-6c54d2f6e854 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:09.402532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-d5d7aec3-1e64-40bb-9250-ea0a69782a67 req-9aacfa4b-fc6e-4df4-b0b4-6c54d2f6e854 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:09.417079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-d5d7aec3-1e64-40bb-9250-ea0a69782a67 req-9aacfa4b-fc6e-4df4-b0b4-6c54d2f6e854 service nova] Creating event network-changed:a3db8d82-3435-4460-803e-926d12177856 for instance 2df24471-2352-4e79-be15-e395eabf66e8 on hv-cinder-85093 Jul 25 19:51:09.424656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-d5d7aec3-1e64-40bb-9250-ea0a69782a67 req-9aacfa4b-fc6e-4df4-b0b4-6c54d2f6e854 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042656 Jul 25 19:51:09.425505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1443/2725] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:51:10.018149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-852824f7-7563-4318-b403-ad11f4b51108 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:10.018991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-852824f7-7563-4318-b403-ad11f4b51108 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:10.025516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-852824f7-7563-4318-b403-ad11f4b51108 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:10.025972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-852824f7-7563-4318-b403-ad11f4b51108 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:10.026775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-852824f7-7563-4318-b403-ad11f4b51108 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:10.027221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-852824f7-7563-4318-b403-ad11f4b51108 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:10.273926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-852824f7-7563-4318-b403-ad11f4b51108 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:10.285313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-852824f7-7563-4318-b403-ad11f4b51108 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.271213 Jul 25 19:51:10.285918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1283/2726] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:10 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:11.316507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4a86383e-5014-4af7-8079-adb099ebb86c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:11.317347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4a86383e-5014-4af7-8079-adb099ebb86c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:11.325615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a86383e-5014-4af7-8079-adb099ebb86c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:11.326278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a86383e-5014-4af7-8079-adb099ebb86c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:11.327297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a86383e-5014-4af7-8079-adb099ebb86c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:11.327789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4a86383e-5014-4af7-8079-adb099ebb86c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:11.509574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4a86383e-5014-4af7-8079-adb099ebb86c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:11.521304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4a86383e-5014-4af7-8079-adb099ebb86c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.209594 Jul 25 19:51:11.522073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1444/2727] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:11 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:12.547894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ffd2a269-914f-493f-947c-69e507b5ff5f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:12.548682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ffd2a269-914f-493f-947c-69e507b5ff5f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:12.555655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffd2a269-914f-493f-947c-69e507b5ff5f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:12.556109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffd2a269-914f-493f-947c-69e507b5ff5f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:12.556877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffd2a269-914f-493f-947c-69e507b5ff5f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:12.557314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffd2a269-914f-493f-947c-69e507b5ff5f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:12.562876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:12.708519 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ffd2a269-914f-493f-947c-69e507b5ff5f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:12.717778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ffd2a269-914f-493f-947c-69e507b5ff5f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.174762 Jul 25 19:51:12.718396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1284/2728] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:12 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:13.740609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a3cd049f-cc50-4c34-8257-3b9c5b173af0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:13.741276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a3cd049f-cc50-4c34-8257-3b9c5b173af0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:13.748807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3cd049f-cc50-4c34-8257-3b9c5b173af0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:13.749257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3cd049f-cc50-4c34-8257-3b9c5b173af0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:13.750045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3cd049f-cc50-4c34-8257-3b9c5b173af0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:13.750482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3cd049f-cc50-4c34-8257-3b9c5b173af0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:13.916116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a3cd049f-cc50-4c34-8257-3b9c5b173af0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:13.927261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a3cd049f-cc50-4c34-8257-3b9c5b173af0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.190919 Jul 25 19:51:13.927910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1445/2729] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:13 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:14.948658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-30b366cc-f64f-4102-8975-3444c8685832 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:14.949283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-30b366cc-f64f-4102-8975-3444c8685832 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:14.958417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30b366cc-f64f-4102-8975-3444c8685832 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:14.958992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30b366cc-f64f-4102-8975-3444c8685832 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:14.959849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30b366cc-f64f-4102-8975-3444c8685832 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:14.960292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30b366cc-f64f-4102-8975-3444c8685832 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:15.114686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-30b366cc-f64f-4102-8975-3444c8685832 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:15.124530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-30b366cc-f64f-4102-8975-3444c8685832 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.179712 Jul 25 19:51:15.125129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1285/2730] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:14 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:16.147257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6a85b211-e55c-40b3-85d9-4269cd8858c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:16.148075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6a85b211-e55c-40b3-85d9-4269cd8858c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:16.150000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=50 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:16.156479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a85b211-e55c-40b3-85d9-4269cd8858c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:16.156928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a85b211-e55c-40b3-85d9-4269cd8858c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:16.157841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a85b211-e55c-40b3-85d9-4269cd8858c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:16.158281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6a85b211-e55c-40b3-85d9-4269cd8858c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:16.323095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6a85b211-e55c-40b3-85d9-4269cd8858c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:16.332336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6a85b211-e55c-40b3-85d9-4269cd8858c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.189025 Jul 25 19:51:16.333037 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1446/2731] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:16 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:17.354726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c3d3eb5d-9fc2-4dd7-8350-b456a3097b34 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:17.355433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c3d3eb5d-9fc2-4dd7-8350-b456a3097b34 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:17.358077 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:17.364138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3d3eb5d-9fc2-4dd7-8350-b456a3097b34 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:17.364584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3d3eb5d-9fc2-4dd7-8350-b456a3097b34 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:17.365369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3d3eb5d-9fc2-4dd7-8350-b456a3097b34 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:17.365800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3d3eb5d-9fc2-4dd7-8350-b456a3097b34 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:17.536183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c3d3eb5d-9fc2-4dd7-8350-b456a3097b34 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:17.545729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c3d3eb5d-9fc2-4dd7-8350-b456a3097b34 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.194897 Jul 25 19:51:17.546341 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1286/2732] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:17 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:18.568416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-27aff0d5-75b4-485a-91aa-83c25d75e14c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:18.569094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-27aff0d5-75b4-485a-91aa-83c25d75e14c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:18.577360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27aff0d5-75b4-485a-91aa-83c25d75e14c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:18.577805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27aff0d5-75b4-485a-91aa-83c25d75e14c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:18.578589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27aff0d5-75b4-485a-91aa-83c25d75e14c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:18.579025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-27aff0d5-75b4-485a-91aa-83c25d75e14c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:18.758892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-27aff0d5-75b4-485a-91aa-83c25d75e14c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:18.767598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-27aff0d5-75b4-485a-91aa-83c25d75e14c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.203006 Jul 25 19:51:18.768184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1447/2733] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:18 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:19.795819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05cac4b9-eaee-49e3-81b6-5aee8db59b7d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:19.796915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05cac4b9-eaee-49e3-81b6-5aee8db59b7d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:19.808803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05cac4b9-eaee-49e3-81b6-5aee8db59b7d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:19.809601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05cac4b9-eaee-49e3-81b6-5aee8db59b7d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:19.811005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05cac4b9-eaee-49e3-81b6-5aee8db59b7d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:19.811807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05cac4b9-eaee-49e3-81b6-5aee8db59b7d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:19.982334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05cac4b9-eaee-49e3-81b6-5aee8db59b7d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:19.992359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05cac4b9-eaee-49e3-81b6-5aee8db59b7d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.204024 Jul 25 19:51:19.993213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1287/2734] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:19 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:21.028844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a82e2f96-3318-4861-bd94-dc0afad3ff14 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:21.029503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a82e2f96-3318-4861-bd94-dc0afad3ff14 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:21.037390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a82e2f96-3318-4861-bd94-dc0afad3ff14 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:21.037830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a82e2f96-3318-4861-bd94-dc0afad3ff14 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:21.038846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a82e2f96-3318-4861-bd94-dc0afad3ff14 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:21.039408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a82e2f96-3318-4861-bd94-dc0afad3ff14 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:21.201575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a82e2f96-3318-4861-bd94-dc0afad3ff14 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:21.211208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a82e2f96-3318-4861-bd94-dc0afad3ff14 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.187253 Jul 25 19:51:21.212000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1448/2735] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:21 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:22.236464 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e8af2db6-b1dc-4d73-8681-cde9d8772b62 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:22.237549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e8af2db6-b1dc-4d73-8681-cde9d8772b62 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:22.246846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8af2db6-b1dc-4d73-8681-cde9d8772b62 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:22.247543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8af2db6-b1dc-4d73-8681-cde9d8772b62 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:22.248475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8af2db6-b1dc-4d73-8681-cde9d8772b62 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:22.248921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8af2db6-b1dc-4d73-8681-cde9d8772b62 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:22.428231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e8af2db6-b1dc-4d73-8681-cde9d8772b62 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:22.437520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e8af2db6-b1dc-4d73-8681-cde9d8772b62 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.205577 Jul 25 19:51:22.438301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1288/2736] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:22 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:23.464717 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df13aebd-d0c9-4274-8433-2c0787c2bd42 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:23.465745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df13aebd-d0c9-4274-8433-2c0787c2bd42 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:23.476988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df13aebd-d0c9-4274-8433-2c0787c2bd42 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:23.477770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df13aebd-d0c9-4274-8433-2c0787c2bd42 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:23.479132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df13aebd-d0c9-4274-8433-2c0787c2bd42 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:23.479969 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df13aebd-d0c9-4274-8433-2c0787c2bd42 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:23.664153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df13aebd-d0c9-4274-8433-2c0787c2bd42 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:23.673470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df13aebd-d0c9-4274-8433-2c0787c2bd42 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.216755 Jul 25 19:51:23.674068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1449/2737] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:23 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:24.694893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c029b92b-078c-449d-ae66-7401cba1ee18 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:24.695505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c029b92b-078c-449d-ae66-7401cba1ee18 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:24.702631 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c029b92b-078c-449d-ae66-7401cba1ee18 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:24.703093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c029b92b-078c-449d-ae66-7401cba1ee18 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:24.703905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c029b92b-078c-449d-ae66-7401cba1ee18 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:24.704347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c029b92b-078c-449d-ae66-7401cba1ee18 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:24.847870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c029b92b-078c-449d-ae66-7401cba1ee18 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:24.859766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c029b92b-078c-449d-ae66-7401cba1ee18 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.168468 Jul 25 19:51:24.860358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1289/2738] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:24 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:25.643743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:51:25.644461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:51:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:51:25.882547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-047ed8b7-a64f-4030-a913-38cc62ad62ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:25.883178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-047ed8b7-a64f-4030-a913-38cc62ad62ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:25.890469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-047ed8b7-a64f-4030-a913-38cc62ad62ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:25.890909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-047ed8b7-a64f-4030-a913-38cc62ad62ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:25.891754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-047ed8b7-a64f-4030-a913-38cc62ad62ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:25.892435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-047ed8b7-a64f-4030-a913-38cc62ad62ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:26.052027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-047ed8b7-a64f-4030-a913-38cc62ad62ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:26.060246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-047ed8b7-a64f-4030-a913-38cc62ad62ad tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.181650 Jul 25 19:51:26.060833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1450/2739] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:25 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:27.081126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb57e67f-298e-4a44-a818-b6c7b656344c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:27.081974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb57e67f-298e-4a44-a818-b6c7b656344c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:27.088910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb57e67f-298e-4a44-a818-b6c7b656344c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:27.089385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb57e67f-298e-4a44-a818-b6c7b656344c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:27.090765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb57e67f-298e-4a44-a818-b6c7b656344c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:27.091253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb57e67f-298e-4a44-a818-b6c7b656344c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:27.245704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fb57e67f-298e-4a44-a818-b6c7b656344c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:27.255136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb57e67f-298e-4a44-a818-b6c7b656344c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.177928 Jul 25 19:51:27.255769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1290/2740] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:27 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:28.278005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6df325ca-7b01-49ea-8b65-a061662a72a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:28.278932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6df325ca-7b01-49ea-8b65-a061662a72a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:28.288163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6df325ca-7b01-49ea-8b65-a061662a72a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:28.288686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6df325ca-7b01-49ea-8b65-a061662a72a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:28.289581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6df325ca-7b01-49ea-8b65-a061662a72a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:28.290023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6df325ca-7b01-49ea-8b65-a061662a72a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:28.443681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6df325ca-7b01-49ea-8b65-a061662a72a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:28.452117 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6df325ca-7b01-49ea-8b65-a061662a72a4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.178357 Jul 25 19:51:28.452704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1451/2741] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:28 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:29.474469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1eada255-5cfa-49ab-8520-c8ed5f59b000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:29.475115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1eada255-5cfa-49ab-8520-c8ed5f59b000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:29.483304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1eada255-5cfa-49ab-8520-c8ed5f59b000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:29.483790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1eada255-5cfa-49ab-8520-c8ed5f59b000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:29.484570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1eada255-5cfa-49ab-8520-c8ed5f59b000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:29.485010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1eada255-5cfa-49ab-8520-c8ed5f59b000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:29.919398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1eada255-5cfa-49ab-8520-c8ed5f59b000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:29.928463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1eada255-5cfa-49ab-8520-c8ed5f59b000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.458127 Jul 25 19:51:29.929074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1291/2742] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:29 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:30.954904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4e670d2e-2c97-4b04-950e-17158452467d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:30.955683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4e670d2e-2c97-4b04-950e-17158452467d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:30.966905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e670d2e-2c97-4b04-950e-17158452467d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:30.967354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e670d2e-2c97-4b04-950e-17158452467d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:30.968191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e670d2e-2c97-4b04-950e-17158452467d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:30.968641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4e670d2e-2c97-4b04-950e-17158452467d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:30.972356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=91 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:31.112150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4e670d2e-2c97-4b04-950e-17158452467d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:31.120749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4e670d2e-2c97-4b04-950e-17158452467d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.172620 Jul 25 19:51:31.121414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1452/2743] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:30 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:32.143759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9890f20c-7937-481c-9191-6694ec7d9fbc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:32.144629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9890f20c-7937-481c-9191-6694ec7d9fbc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:32.151340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9890f20c-7937-481c-9191-6694ec7d9fbc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:32.151869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9890f20c-7937-481c-9191-6694ec7d9fbc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:32.153107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9890f20c-7937-481c-9191-6694ec7d9fbc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:32.153848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9890f20c-7937-481c-9191-6694ec7d9fbc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:32.300294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9890f20c-7937-481c-9191-6694ec7d9fbc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:32.310016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9890f20c-7937-481c-9191-6694ec7d9fbc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.169374 Jul 25 19:51:32.310393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1292/2744] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:32 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:33.332994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-28a93f6e-243d-4302-90c4-f02a5ae71388 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:33.333609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-28a93f6e-243d-4302-90c4-f02a5ae71388 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:33.342669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28a93f6e-243d-4302-90c4-f02a5ae71388 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:33.343127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28a93f6e-243d-4302-90c4-f02a5ae71388 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:33.343964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28a93f6e-243d-4302-90c4-f02a5ae71388 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:33.344399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-28a93f6e-243d-4302-90c4-f02a5ae71388 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:33.490797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-28a93f6e-243d-4302-90c4-f02a5ae71388 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:33.505566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-28a93f6e-243d-4302-90c4-f02a5ae71388 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.175982 Jul 25 19:51:33.506613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1453/2745] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:33 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:34.542011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-970ac5bd-8814-4156-9790-033079b29139 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:34.542585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-970ac5bd-8814-4156-9790-033079b29139 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:34.549690 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-970ac5bd-8814-4156-9790-033079b29139 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:34.550141 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-970ac5bd-8814-4156-9790-033079b29139 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:34.550920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-970ac5bd-8814-4156-9790-033079b29139 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:34.551360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-970ac5bd-8814-4156-9790-033079b29139 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:34.696413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-970ac5bd-8814-4156-9790-033079b29139 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:34.704533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-970ac5bd-8814-4156-9790-033079b29139 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.166597 Jul 25 19:51:34.705116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1293/2746] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:34 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:35.732859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f714d088-70db-414b-970d-b1b734ac460a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:35.733767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f714d088-70db-414b-970d-b1b734ac460a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:35.741291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f714d088-70db-414b-970d-b1b734ac460a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:35.741735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f714d088-70db-414b-970d-b1b734ac460a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:35.742502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f714d088-70db-414b-970d-b1b734ac460a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:35.742967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f714d088-70db-414b-970d-b1b734ac460a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:35.897327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f714d088-70db-414b-970d-b1b734ac460a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:35.909293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f714d088-70db-414b-970d-b1b734ac460a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.184252 Jul 25 19:51:35.909876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1454/2747] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:35 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:36.932548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4b1b60a0-d0bf-42da-babd-1d864b12f84c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:36.933136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4b1b60a0-d0bf-42da-babd-1d864b12f84c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:36.940774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b1b60a0-d0bf-42da-babd-1d864b12f84c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:36.941264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b1b60a0-d0bf-42da-babd-1d864b12f84c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:36.942137 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b1b60a0-d0bf-42da-babd-1d864b12f84c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:36.942640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b1b60a0-d0bf-42da-babd-1d864b12f84c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:37.086220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4b1b60a0-d0bf-42da-babd-1d864b12f84c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:37.096042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4b1b60a0-d0bf-42da-babd-1d864b12f84c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.167213 Jul 25 19:51:37.096630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1294/2748] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:36 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:38.118740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-49357f85-adfb-4f91-a884-a4d14046d3fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:38.119341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-49357f85-adfb-4f91-a884-a4d14046d3fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:38.126462 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49357f85-adfb-4f91-a884-a4d14046d3fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:38.126919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49357f85-adfb-4f91-a884-a4d14046d3fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:38.127737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49357f85-adfb-4f91-a884-a4d14046d3fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:38.128207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49357f85-adfb-4f91-a884-a4d14046d3fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:38.280490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-49357f85-adfb-4f91-a884-a4d14046d3fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:38.288893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-49357f85-adfb-4f91-a884-a4d14046d3fe tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.174256 Jul 25 19:51:38.289470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1455/2749] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:38 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:39.324676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-facc9e9c-6672-4040-97cd-62c1cfd78c33 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:39.325383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-facc9e9c-6672-4040-97cd-62c1cfd78c33 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:39.332383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-facc9e9c-6672-4040-97cd-62c1cfd78c33 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:39.332822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-facc9e9c-6672-4040-97cd-62c1cfd78c33 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:39.333584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-facc9e9c-6672-4040-97cd-62c1cfd78c33 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:39.334016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-facc9e9c-6672-4040-97cd-62c1cfd78c33 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:39.494910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-facc9e9c-6672-4040-97cd-62c1cfd78c33 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:39.505873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-facc9e9c-6672-4040-97cd-62c1cfd78c33 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.184979 Jul 25 19:51:39.506480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1295/2750] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:39 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:40.527638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c528a61f-b984-4ee3-82a3-30cdf9acae7f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:40.528465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c528a61f-b984-4ee3-82a3-30cdf9acae7f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:40.535279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c528a61f-b984-4ee3-82a3-30cdf9acae7f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:40.535757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c528a61f-b984-4ee3-82a3-30cdf9acae7f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:40.536547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c528a61f-b984-4ee3-82a3-30cdf9acae7f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:40.536991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c528a61f-b984-4ee3-82a3-30cdf9acae7f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:40.679277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c528a61f-b984-4ee3-82a3-30cdf9acae7f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:40.687947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c528a61f-b984-4ee3-82a3-30cdf9acae7f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.164721 Jul 25 19:51:40.688523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1456/2751] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:40 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:41.709662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f1bb2694-93cc-4d6e-ae26-7ecfce156b48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:41.710340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f1bb2694-93cc-4d6e-ae26-7ecfce156b48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:41.717831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1bb2694-93cc-4d6e-ae26-7ecfce156b48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:41.718347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1bb2694-93cc-4d6e-ae26-7ecfce156b48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:41.719123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1bb2694-93cc-4d6e-ae26-7ecfce156b48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:41.719722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1bb2694-93cc-4d6e-ae26-7ecfce156b48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:41.890301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f1bb2694-93cc-4d6e-ae26-7ecfce156b48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:41.899183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f1bb2694-93cc-4d6e-ae26-7ecfce156b48 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.193524 Jul 25 19:51:41.899782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1296/2752] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:41 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:42.921609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-92f8555e-2962-40f8-bfae-ecd29430bad8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:42.922394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-92f8555e-2962-40f8-bfae-ecd29430bad8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:42.929661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92f8555e-2962-40f8-bfae-ecd29430bad8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:42.930106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92f8555e-2962-40f8-bfae-ecd29430bad8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:42.930876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92f8555e-2962-40f8-bfae-ecd29430bad8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:42.931313 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-92f8555e-2962-40f8-bfae-ecd29430bad8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:43.072891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-92f8555e-2962-40f8-bfae-ecd29430bad8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:43.081547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-92f8555e-2962-40f8-bfae-ecd29430bad8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.164097 Jul 25 19:51:43.082125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1457/2753] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:42 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:44.103116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee0ab919-dd4d-4dd4-b525-58ad5dbc1f4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:44.103769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee0ab919-dd4d-4dd4-b525-58ad5dbc1f4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:44.111559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee0ab919-dd4d-4dd4-b525-58ad5dbc1f4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:44.112012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee0ab919-dd4d-4dd4-b525-58ad5dbc1f4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:44.112793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee0ab919-dd4d-4dd4-b525-58ad5dbc1f4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:44.113560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee0ab919-dd4d-4dd4-b525-58ad5dbc1f4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:44.116423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=77 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:44.271748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee0ab919-dd4d-4dd4-b525-58ad5dbc1f4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:44.280443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee0ab919-dd4d-4dd4-b525-58ad5dbc1f4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.181093 Jul 25 19:51:44.281177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1297/2754] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:44 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:45.302112 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dea81a34-4bc8-4b63-9590-ec1b9a91d58a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:45.302718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dea81a34-4bc8-4b63-9590-ec1b9a91d58a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:45.309748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dea81a34-4bc8-4b63-9590-ec1b9a91d58a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:45.310206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dea81a34-4bc8-4b63-9590-ec1b9a91d58a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:45.310988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dea81a34-4bc8-4b63-9590-ec1b9a91d58a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:45.311439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dea81a34-4bc8-4b63-9590-ec1b9a91d58a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:45.458367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-dea81a34-4bc8-4b63-9590-ec1b9a91d58a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:45.467585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dea81a34-4bc8-4b63-9590-ec1b9a91d58a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.169241 Jul 25 19:51:45.468252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1458/2755] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:45 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:46.489764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a0eaff87-9ec9-464c-8a72-c56d23a6fcda tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:46.490381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a0eaff87-9ec9-464c-8a72-c56d23a6fcda tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:46.497207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0eaff87-9ec9-464c-8a72-c56d23a6fcda tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:46.498003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0eaff87-9ec9-464c-8a72-c56d23a6fcda tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:46.498785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0eaff87-9ec9-464c-8a72-c56d23a6fcda tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:46.499224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0eaff87-9ec9-464c-8a72-c56d23a6fcda tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:46.645138 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0eaff87-9ec9-464c-8a72-c56d23a6fcda tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:46.654883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a0eaff87-9ec9-464c-8a72-c56d23a6fcda tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.169163 Jul 25 19:51:46.655473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1298/2756] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:46 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:47.678834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-53eaff1c-9bf3-488d-b572-c6c4d625d64e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:47.679450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-53eaff1c-9bf3-488d-b572-c6c4d625d64e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:47.681607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=26 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:47.687408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53eaff1c-9bf3-488d-b572-c6c4d625d64e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:47.687983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53eaff1c-9bf3-488d-b572-c6c4d625d64e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:47.688762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53eaff1c-9bf3-488d-b572-c6c4d625d64e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:47.689198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-53eaff1c-9bf3-488d-b572-c6c4d625d64e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:47.828760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-53eaff1c-9bf3-488d-b572-c6c4d625d64e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:47.837214 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-53eaff1c-9bf3-488d-b572-c6c4d625d64e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.162254 Jul 25 19:51:47.837802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1459/2757] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:47 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:48.858923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b1e810a3-bb87-4609-8998-2d025983b3d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:48.859771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b1e810a3-bb87-4609-8998-2d025983b3d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:48.862092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:48.868669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1e810a3-bb87-4609-8998-2d025983b3d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:48.869240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1e810a3-bb87-4609-8998-2d025983b3d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:48.870039 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1e810a3-bb87-4609-8998-2d025983b3d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:48.870499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1e810a3-bb87-4609-8998-2d025983b3d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:49.028449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1e810a3-bb87-4609-8998-2d025983b3d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:49.037892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b1e810a3-bb87-4609-8998-2d025983b3d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.183317 Jul 25 19:51:49.038491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1299/2758] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:48 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:50.062263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-013d3c21-a2b2-461c-aac5-ad675f0fde80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:50.062904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-013d3c21-a2b2-461c-aac5-ad675f0fde80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:50.070085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-013d3c21-a2b2-461c-aac5-ad675f0fde80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:50.070573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-013d3c21-a2b2-461c-aac5-ad675f0fde80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:50.071391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-013d3c21-a2b2-461c-aac5-ad675f0fde80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:50.072013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-013d3c21-a2b2-461c-aac5-ad675f0fde80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:50.234272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-013d3c21-a2b2-461c-aac5-ad675f0fde80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:50.244100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-013d3c21-a2b2-461c-aac5-ad675f0fde80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.186568 Jul 25 19:51:50.244799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1460/2759] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:50 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:51.267109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c6e3fcd3-ed60-44d0-9b06-95e604b997db tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:51.267823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c6e3fcd3-ed60-44d0-9b06-95e604b997db tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:51.276095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6e3fcd3-ed60-44d0-9b06-95e604b997db tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:51.276543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6e3fcd3-ed60-44d0-9b06-95e604b997db tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:51.278016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6e3fcd3-ed60-44d0-9b06-95e604b997db tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:51.278449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6e3fcd3-ed60-44d0-9b06-95e604b997db tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:51.459683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c6e3fcd3-ed60-44d0-9b06-95e604b997db tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:51.475044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c6e3fcd3-ed60-44d0-9b06-95e604b997db tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.212050 Jul 25 19:51:51.476290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1300/2760] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:51 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:52.499913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-305efa7c-a11b-4849-b995-b4854a35d131 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:52.501197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-305efa7c-a11b-4849-b995-b4854a35d131 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:52.509170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-305efa7c-a11b-4849-b995-b4854a35d131 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:52.509613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-305efa7c-a11b-4849-b995-b4854a35d131 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:52.510594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-305efa7c-a11b-4849-b995-b4854a35d131 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:52.511050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-305efa7c-a11b-4849-b995-b4854a35d131 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:52.670759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-305efa7c-a11b-4849-b995-b4854a35d131 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:52.685953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-305efa7c-a11b-4849-b995-b4854a35d131 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.190419 Jul 25 19:51:52.687019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1461/2761] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:52 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:53.721019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-359db534-d28c-4d07-9972-4baba44544b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:53.721852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-359db534-d28c-4d07-9972-4baba44544b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:53.728952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-359db534-d28c-4d07-9972-4baba44544b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:53.729442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-359db534-d28c-4d07-9972-4baba44544b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:53.730240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-359db534-d28c-4d07-9972-4baba44544b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:53.730739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-359db534-d28c-4d07-9972-4baba44544b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:53.911789 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-359db534-d28c-4d07-9972-4baba44544b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:53.921312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-359db534-d28c-4d07-9972-4baba44544b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.204361 Jul 25 19:51:53.921918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1301/2762] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:53 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:51:54.943558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5b6dd948-797a-4f1b-a20a-6fd13406abd0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:54.944115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5b6dd948-797a-4f1b-a20a-6fd13406abd0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:54.951301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b6dd948-797a-4f1b-a20a-6fd13406abd0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:54.951775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b6dd948-797a-4f1b-a20a-6fd13406abd0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:54.952540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b6dd948-797a-4f1b-a20a-6fd13406abd0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:54.953208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b6dd948-797a-4f1b-a20a-6fd13406abd0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:55.104478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5b6dd948-797a-4f1b-a20a-6fd13406abd0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:55.114614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5b6dd948-797a-4f1b-a20a-6fd13406abd0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.174917 Jul 25 19:51:55.115204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1462/2763] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:54 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:56.140277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cca9f37a-3e8a-4eeb-894b-04fdce7781bf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:56.141550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cca9f37a-3e8a-4eeb-894b-04fdce7781bf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:56.152153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca9f37a-3e8a-4eeb-894b-04fdce7781bf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:56.152972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca9f37a-3e8a-4eeb-894b-04fdce7781bf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:56.154360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca9f37a-3e8a-4eeb-894b-04fdce7781bf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:56.155128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca9f37a-3e8a-4eeb-894b-04fdce7781bf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:56.289392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2e1bb2bd-d232-4216-8ceb-e9d318e791bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:56.289999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2e1bb2bd-d232-4216-8ceb-e9d318e791bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:56.298415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e1bb2bd-d232-4216-8ceb-e9d318e791bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:56.298956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e1bb2bd-d232-4216-8ceb-e9d318e791bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:56.299869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e1bb2bd-d232-4216-8ceb-e9d318e791bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:56.300381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e1bb2bd-d232-4216-8ceb-e9d318e791bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:56.333266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2e1bb2bd-d232-4216-8ceb-e9d318e791bd tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8/ips" status: 200 len: 153 microversion: 2.20 time: 0.047361 Jul 25 19:51:56.334125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cca9f37a-3e8a-4eeb-894b-04fdce7781bf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:56.334360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1463/2764] 10.222.0.18 () {60 vars in 1289 bytes} [Mon Jul 25 19:51:56 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8/ips => generated 153 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:51:56.345854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cca9f37a-3e8a-4eeb-894b-04fdce7781bf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.212235 Jul 25 19:51:56.346505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1302/2765] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:56 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:57.369491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1915e8ba-e2d3-45e8-a3b3-6507721f5a3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:57.370126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1915e8ba-e2d3-45e8-a3b3-6507721f5a3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:57.378658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1915e8ba-e2d3-45e8-a3b3-6507721f5a3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:57.379105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1915e8ba-e2d3-45e8-a3b3-6507721f5a3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:57.379942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1915e8ba-e2d3-45e8-a3b3-6507721f5a3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:57.380376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1915e8ba-e2d3-45e8-a3b3-6507721f5a3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:57.540492 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1915e8ba-e2d3-45e8-a3b3-6507721f5a3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:57.550177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1915e8ba-e2d3-45e8-a3b3-6507721f5a3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.184654 Jul 25 19:51:57.550759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1464/2766] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:57 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:58.585167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1ab882c5-f1c3-44bb-976b-a1850fcc7f8e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:58.585805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1ab882c5-f1c3-44bb-976b-a1850fcc7f8e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:58.594035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ab882c5-f1c3-44bb-976b-a1850fcc7f8e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:58.594481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ab882c5-f1c3-44bb-976b-a1850fcc7f8e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:58.595263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ab882c5-f1c3-44bb-976b-a1850fcc7f8e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:58.595737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ab882c5-f1c3-44bb-976b-a1850fcc7f8e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:58.735086 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1ab882c5-f1c3-44bb-976b-a1850fcc7f8e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:58.743656 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1ab882c5-f1c3-44bb-976b-a1850fcc7f8e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.162331 Jul 25 19:51:58.744269 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1303/2767] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:58 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:59.766538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f1916e33-6822-4127-bb02-84c6d9d1a25c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:59.767187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f1916e33-6822-4127-bb02-84c6d9d1a25c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:51:59.774044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1916e33-6822-4127-bb02-84c6d9d1a25c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:59.774567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1916e33-6822-4127-bb02-84c6d9d1a25c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:59.775370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1916e33-6822-4127-bb02-84c6d9d1a25c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:51:59.775832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1916e33-6822-4127-bb02-84c6d9d1a25c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:51:59.932527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f1916e33-6822-4127-bb02-84c6d9d1a25c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:51:59.941194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f1916e33-6822-4127-bb02-84c6d9d1a25c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.178911 Jul 25 19:51:59.941771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1465/2768] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:51:59 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:00.965621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b908ae8-8989-49ed-9d04-32ceb50214b6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:00.966250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b908ae8-8989-49ed-9d04-32ceb50214b6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:00.973810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b908ae8-8989-49ed-9d04-32ceb50214b6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:00.974259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b908ae8-8989-49ed-9d04-32ceb50214b6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:00.975061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b908ae8-8989-49ed-9d04-32ceb50214b6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:00.975538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b908ae8-8989-49ed-9d04-32ceb50214b6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:01.127590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b908ae8-8989-49ed-9d04-32ceb50214b6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:01.137377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b908ae8-8989-49ed-9d04-32ceb50214b6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.176715 Jul 25 19:52:01.137972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1304/2769] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:00 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:02.160400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f3ddbdb8-2c1b-4555-a371-7d05844502bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:02.161040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f3ddbdb8-2c1b-4555-a371-7d05844502bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:02.168375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3ddbdb8-2c1b-4555-a371-7d05844502bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:02.168817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3ddbdb8-2c1b-4555-a371-7d05844502bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:02.169587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3ddbdb8-2c1b-4555-a371-7d05844502bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:02.170019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3ddbdb8-2c1b-4555-a371-7d05844502bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:02.172825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=82 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:02.308723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3ddbdb8-2c1b-4555-a371-7d05844502bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:02.317550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f3ddbdb8-2c1b-4555-a371-7d05844502bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.161728 Jul 25 19:52:02.318398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1466/2770] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:02 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:03.343489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0f9b009c-8616-4263-a014-4d4205f38358 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:03.346547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0f9b009c-8616-4263-a014-4d4205f38358 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:03.353050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f9b009c-8616-4263-a014-4d4205f38358 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:03.353498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f9b009c-8616-4263-a014-4d4205f38358 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:03.354295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f9b009c-8616-4263-a014-4d4205f38358 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:03.354850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f9b009c-8616-4263-a014-4d4205f38358 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:03.501241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f9b009c-8616-4263-a014-4d4205f38358 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:03.509573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0f9b009c-8616-4263-a014-4d4205f38358 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.171015 Jul 25 19:52:03.510157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1305/2771] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:03 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:04.532505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-64d1d4d0-eb99-4745-bd24-9fdfc234d37c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:04.533155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-64d1d4d0-eb99-4745-bd24-9fdfc234d37c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:04.540141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64d1d4d0-eb99-4745-bd24-9fdfc234d37c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:04.540416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64d1d4d0-eb99-4745-bd24-9fdfc234d37c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:04.541190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64d1d4d0-eb99-4745-bd24-9fdfc234d37c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:04.541626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-64d1d4d0-eb99-4745-bd24-9fdfc234d37c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:04.682195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-64d1d4d0-eb99-4745-bd24-9fdfc234d37c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:04.691463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-64d1d4d0-eb99-4745-bd24-9fdfc234d37c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.162773 Jul 25 19:52:04.692091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1467/2772] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:04 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:05.713287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c0836c94-585c-409e-aa08-9682d04190af tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:05.714634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c0836c94-585c-409e-aa08-9682d04190af tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:05.721745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0836c94-585c-409e-aa08-9682d04190af tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:05.722196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0836c94-585c-409e-aa08-9682d04190af tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:05.722969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0836c94-585c-409e-aa08-9682d04190af tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:05.723401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0836c94-585c-409e-aa08-9682d04190af tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:05.872505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c0836c94-585c-409e-aa08-9682d04190af tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:05.883334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c0836c94-585c-409e-aa08-9682d04190af tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.173474 Jul 25 19:52:05.884401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1306/2773] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:05 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:06.914791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-05b0971d-8957-4cd9-b76f-1741444cf80c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:06.915378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-05b0971d-8957-4cd9-b76f-1741444cf80c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:06.922524 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05b0971d-8957-4cd9-b76f-1741444cf80c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:06.922964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05b0971d-8957-4cd9-b76f-1741444cf80c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:06.923773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05b0971d-8957-4cd9-b76f-1741444cf80c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:06.924211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05b0971d-8957-4cd9-b76f-1741444cf80c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:07.078034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-05b0971d-8957-4cd9-b76f-1741444cf80c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:07.086317 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-05b0971d-8957-4cd9-b76f-1741444cf80c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.175246 Jul 25 19:52:07.086906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1468/2774] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:06 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:08.109403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-578eb712-0c7b-40e5-bb99-d21cf476503d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:08.110023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-578eb712-0c7b-40e5-bb99-d21cf476503d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:08.117059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-578eb712-0c7b-40e5-bb99-d21cf476503d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:08.117505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-578eb712-0c7b-40e5-bb99-d21cf476503d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:08.118277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-578eb712-0c7b-40e5-bb99-d21cf476503d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:08.118710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-578eb712-0c7b-40e5-bb99-d21cf476503d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:08.260908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-578eb712-0c7b-40e5-bb99-d21cf476503d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:08.269687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-578eb712-0c7b-40e5-bb99-d21cf476503d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.164860 Jul 25 19:52:08.270285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1307/2775] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:08 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:09.291606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9005d079-7060-4e55-9f22-11d7210f615f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:09.293705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9005d079-7060-4e55-9f22-11d7210f615f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:09.300044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9005d079-7060-4e55-9f22-11d7210f615f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:09.300814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9005d079-7060-4e55-9f22-11d7210f615f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:09.301361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9005d079-7060-4e55-9f22-11d7210f615f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:09.301860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9005d079-7060-4e55-9f22-11d7210f615f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:09.466649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9005d079-7060-4e55-9f22-11d7210f615f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:09.476537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9005d079-7060-4e55-9f22-11d7210f615f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.188937 Jul 25 19:52:09.477584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1469/2776] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:09 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:10.501870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc7f388c-b0e6-4c4a-b4c8-8477cd68bf4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:10.502435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc7f388c-b0e6-4c4a-b4c8-8477cd68bf4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:10.509068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc7f388c-b0e6-4c4a-b4c8-8477cd68bf4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:10.509516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc7f388c-b0e6-4c4a-b4c8-8477cd68bf4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:10.510296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc7f388c-b0e6-4c4a-b4c8-8477cd68bf4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:10.510778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc7f388c-b0e6-4c4a-b4c8-8477cd68bf4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:10.651791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc7f388c-b0e6-4c4a-b4c8-8477cd68bf4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:10.659769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc7f388c-b0e6-4c4a-b4c8-8477cd68bf4a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.161893 Jul 25 19:52:10.660344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1308/2777] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:10 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:11.680982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1ef1bf96-8a42-4208-b04a-e591fcf16b67 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:11.681594 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1ef1bf96-8a42-4208-b04a-e591fcf16b67 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:11.688241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ef1bf96-8a42-4208-b04a-e591fcf16b67 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:11.688694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ef1bf96-8a42-4208-b04a-e591fcf16b67 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:11.689466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ef1bf96-8a42-4208-b04a-e591fcf16b67 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:11.690021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1ef1bf96-8a42-4208-b04a-e591fcf16b67 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:11.841710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1ef1bf96-8a42-4208-b04a-e591fcf16b67 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:11.850367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1ef1bf96-8a42-4208-b04a-e591fcf16b67 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.173115 Jul 25 19:52:11.851021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1470/2778] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:11 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:12.872850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0cf6ae80-6bcc-4bfd-bb3f-9c231ad8d924 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:12.873449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0cf6ae80-6bcc-4bfd-bb3f-9c231ad8d924 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:12.880211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cf6ae80-6bcc-4bfd-bb3f-9c231ad8d924 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:12.880654 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cf6ae80-6bcc-4bfd-bb3f-9c231ad8d924 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:12.881413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cf6ae80-6bcc-4bfd-bb3f-9c231ad8d924 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:12.881844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cf6ae80-6bcc-4bfd-bb3f-9c231ad8d924 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:13.025820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cf6ae80-6bcc-4bfd-bb3f-9c231ad8d924 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:13.035214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0cf6ae80-6bcc-4bfd-bb3f-9c231ad8d924 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.166831 Jul 25 19:52:13.035853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1309/2779] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:12 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:14.057552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6aa354ab-00fc-4adb-a62f-545aad46e96a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:14.058459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6aa354ab-00fc-4adb-a62f-545aad46e96a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:14.065123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6aa354ab-00fc-4adb-a62f-545aad46e96a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:14.065572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6aa354ab-00fc-4adb-a62f-545aad46e96a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:14.066347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6aa354ab-00fc-4adb-a62f-545aad46e96a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:14.066781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6aa354ab-00fc-4adb-a62f-545aad46e96a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:14.216345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6aa354ab-00fc-4adb-a62f-545aad46e96a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:14.225104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6aa354ab-00fc-4adb-a62f-545aad46e96a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.171408 Jul 25 19:52:14.225707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1471/2780] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:14 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:15.255581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-43772cae-fec4-4d7f-8a28-62f14eb61b57 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:15.256185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-43772cae-fec4-4d7f-8a28-62f14eb61b57 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:15.263308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43772cae-fec4-4d7f-8a28-62f14eb61b57 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:15.263929 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43772cae-fec4-4d7f-8a28-62f14eb61b57 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:15.264909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43772cae-fec4-4d7f-8a28-62f14eb61b57 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:15.265270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43772cae-fec4-4d7f-8a28-62f14eb61b57 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:15.268366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:15.409295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-43772cae-fec4-4d7f-8a28-62f14eb61b57 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:15.418414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-43772cae-fec4-4d7f-8a28-62f14eb61b57 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.166458 Jul 25 19:52:15.419001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1310/2781] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:15 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:16.445014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df8f14b2-0ae5-4bad-8299-ab6fa86f2fa9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:16.446131 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df8f14b2-0ae5-4bad-8299-ab6fa86f2fa9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:16.457432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df8f14b2-0ae5-4bad-8299-ab6fa86f2fa9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:16.458233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df8f14b2-0ae5-4bad-8299-ab6fa86f2fa9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:16.459745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df8f14b2-0ae5-4bad-8299-ab6fa86f2fa9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:16.460506 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df8f14b2-0ae5-4bad-8299-ab6fa86f2fa9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:16.636646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df8f14b2-0ae5-4bad-8299-ab6fa86f2fa9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:16.646226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df8f14b2-0ae5-4bad-8299-ab6fa86f2fa9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.208703 Jul 25 19:52:16.646836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1472/2782] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:16 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:17.668733 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb0de94d-6e36-48b3-9d2c-a1110f54d635 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:17.669389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb0de94d-6e36-48b3-9d2c-a1110f54d635 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:17.676317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb0de94d-6e36-48b3-9d2c-a1110f54d635 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:17.676850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb0de94d-6e36-48b3-9d2c-a1110f54d635 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:17.677880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb0de94d-6e36-48b3-9d2c-a1110f54d635 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:17.678550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb0de94d-6e36-48b3-9d2c-a1110f54d635 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:17.837685 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fb0de94d-6e36-48b3-9d2c-a1110f54d635 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:17.847634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb0de94d-6e36-48b3-9d2c-a1110f54d635 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.183164 Jul 25 19:52:17.848236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1311/2783] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:17 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:18.878780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ed895153-3f42-4340-9a1e-f20497d47531 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:18.879386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ed895153-3f42-4340-9a1e-f20497d47531 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:18.881881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=28 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:18.888566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed895153-3f42-4340-9a1e-f20497d47531 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:18.889006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed895153-3f42-4340-9a1e-f20497d47531 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:18.889772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed895153-3f42-4340-9a1e-f20497d47531 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:18.890204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed895153-3f42-4340-9a1e-f20497d47531 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:19.035317 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ed895153-3f42-4340-9a1e-f20497d47531 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:19.044266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ed895153-3f42-4340-9a1e-f20497d47531 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.169255 Jul 25 19:52:19.044848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1473/2784] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:18 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:20.066586 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4868c655-631d-44cb-8026-33d4459b174a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:20.067237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4868c655-631d-44cb-8026-33d4459b174a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:20.069693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:20.079796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4868c655-631d-44cb-8026-33d4459b174a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:20.080261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4868c655-631d-44cb-8026-33d4459b174a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:20.081019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4868c655-631d-44cb-8026-33d4459b174a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:20.081454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4868c655-631d-44cb-8026-33d4459b174a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:20.229203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4868c655-631d-44cb-8026-33d4459b174a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:20.238688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4868c655-631d-44cb-8026-33d4459b174a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.175384 Jul 25 19:52:20.239442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1312/2785] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:20 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:21.261916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2bd4e77d-74ec-4ce6-9d5e-1acae66138ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:21.262822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2bd4e77d-74ec-4ce6-9d5e-1acae66138ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:21.270476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bd4e77d-74ec-4ce6-9d5e-1acae66138ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:21.270917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bd4e77d-74ec-4ce6-9d5e-1acae66138ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:21.271724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bd4e77d-74ec-4ce6-9d5e-1acae66138ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:21.272158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2bd4e77d-74ec-4ce6-9d5e-1acae66138ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:21.422035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2bd4e77d-74ec-4ce6-9d5e-1acae66138ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:21.430433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2bd4e77d-74ec-4ce6-9d5e-1acae66138ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.172445 Jul 25 19:52:21.431003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1474/2786] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:21 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:22.453571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48b494b6-d18e-4589-8ac8-62bb6327ca2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:22.454175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48b494b6-d18e-4589-8ac8-62bb6327ca2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:22.461412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48b494b6-d18e-4589-8ac8-62bb6327ca2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:22.461854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48b494b6-d18e-4589-8ac8-62bb6327ca2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:22.462619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48b494b6-d18e-4589-8ac8-62bb6327ca2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:22.463057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48b494b6-d18e-4589-8ac8-62bb6327ca2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:22.603140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48b494b6-d18e-4589-8ac8-62bb6327ca2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:22.611956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48b494b6-d18e-4589-8ac8-62bb6327ca2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.162247 Jul 25 19:52:22.612538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1313/2787] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:22 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:23.634678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6024b969-802e-473c-bd89-88a60dc06e2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:23.635859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6024b969-802e-473c-bd89-88a60dc06e2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:23.642844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6024b969-802e-473c-bd89-88a60dc06e2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:23.643286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6024b969-802e-473c-bd89-88a60dc06e2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:23.644096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6024b969-802e-473c-bd89-88a60dc06e2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:23.644534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6024b969-802e-473c-bd89-88a60dc06e2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:23.783673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6024b969-802e-473c-bd89-88a60dc06e2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:23.791770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6024b969-802e-473c-bd89-88a60dc06e2d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.160913 Jul 25 19:52:23.792522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1475/2788] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:23 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:24.813235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aad846b3-47cb-41b7-930a-df36f660fd74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:24.813843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aad846b3-47cb-41b7-930a-df36f660fd74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:24.820446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aad846b3-47cb-41b7-930a-df36f660fd74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:24.820894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aad846b3-47cb-41b7-930a-df36f660fd74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:24.821747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aad846b3-47cb-41b7-930a-df36f660fd74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:24.822119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aad846b3-47cb-41b7-930a-df36f660fd74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:24.953253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aad846b3-47cb-41b7-930a-df36f660fd74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:24.961171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aad846b3-47cb-41b7-930a-df36f660fd74 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.151803 Jul 25 19:52:24.961740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1314/2789] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:24 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:25.983035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f92f3642-89b9-46a5-a49e-77f1f8de57d5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:25.983600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f92f3642-89b9-46a5-a49e-77f1f8de57d5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:25.990748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f92f3642-89b9-46a5-a49e-77f1f8de57d5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:25.990986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f92f3642-89b9-46a5-a49e-77f1f8de57d5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:25.991695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f92f3642-89b9-46a5-a49e-77f1f8de57d5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:25.992126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f92f3642-89b9-46a5-a49e-77f1f8de57d5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:26.143678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f92f3642-89b9-46a5-a49e-77f1f8de57d5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:26.152960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f92f3642-89b9-46a5-a49e-77f1f8de57d5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.174329 Jul 25 19:52:26.153567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1476/2790] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:25 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:27.174991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fe328d94-bafe-4b80-bf0b-112b8c1ad284 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:27.175642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fe328d94-bafe-4b80-bf0b-112b8c1ad284 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:27.182416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe328d94-bafe-4b80-bf0b-112b8c1ad284 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:27.182872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe328d94-bafe-4b80-bf0b-112b8c1ad284 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:27.183704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe328d94-bafe-4b80-bf0b-112b8c1ad284 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:27.184147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe328d94-bafe-4b80-bf0b-112b8c1ad284 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:27.331315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe328d94-bafe-4b80-bf0b-112b8c1ad284 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:27.340673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fe328d94-bafe-4b80-bf0b-112b8c1ad284 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.170187 Jul 25 19:52:27.341259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1315/2791] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:27 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:28.362684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-763eeb4c-67e5-423d-b8af-2fb3862ac881 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:28.363697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-763eeb4c-67e5-423d-b8af-2fb3862ac881 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:28.370786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-763eeb4c-67e5-423d-b8af-2fb3862ac881 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:28.371227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-763eeb4c-67e5-423d-b8af-2fb3862ac881 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:28.372027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-763eeb4c-67e5-423d-b8af-2fb3862ac881 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:28.372467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-763eeb4c-67e5-423d-b8af-2fb3862ac881 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:28.534121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-763eeb4c-67e5-423d-b8af-2fb3862ac881 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:28.544466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-763eeb4c-67e5-423d-b8af-2fb3862ac881 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.185758 Jul 25 19:52:28.545097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1477/2792] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:28 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:29.566652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0909731f-79dc-47ab-a3d5-f7368f367bb6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:29.567264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0909731f-79dc-47ab-a3d5-f7368f367bb6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:29.575952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0909731f-79dc-47ab-a3d5-f7368f367bb6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:29.576407 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0909731f-79dc-47ab-a3d5-f7368f367bb6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:29.577188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0909731f-79dc-47ab-a3d5-f7368f367bb6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:29.577630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0909731f-79dc-47ab-a3d5-f7368f367bb6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:29.724861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0909731f-79dc-47ab-a3d5-f7368f367bb6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:29.734451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0909731f-79dc-47ab-a3d5-f7368f367bb6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.171654 Jul 25 19:52:29.735210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1316/2793] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:29 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:30.771071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b7a3cc3b-62fd-441a-af9b-ec33bec5c5c6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:30.771904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b7a3cc3b-62fd-441a-af9b-ec33bec5c5c6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:30.779829 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7a3cc3b-62fd-441a-af9b-ec33bec5c5c6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:30.780300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7a3cc3b-62fd-441a-af9b-ec33bec5c5c6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:30.781089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7a3cc3b-62fd-441a-af9b-ec33bec5c5c6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:30.781524 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7a3cc3b-62fd-441a-af9b-ec33bec5c5c6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:30.931104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b7a3cc3b-62fd-441a-af9b-ec33bec5c5c6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:30.941406 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b7a3cc3b-62fd-441a-af9b-ec33bec5c5c6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.174418 Jul 25 19:52:30.942073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1478/2794] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:30 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:31.964405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f2bd1703-3566-4205-a442-97ebb3067d5c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:31.965716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f2bd1703-3566-4205-a442-97ebb3067d5c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:31.972352 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2bd1703-3566-4205-a442-97ebb3067d5c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:31.972741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2bd1703-3566-4205-a442-97ebb3067d5c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:31.973523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2bd1703-3566-4205-a442-97ebb3067d5c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:31.973939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2bd1703-3566-4205-a442-97ebb3067d5c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:32.121075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2bd1703-3566-4205-a442-97ebb3067d5c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:32.129644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f2bd1703-3566-4205-a442-97ebb3067d5c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.169609 Jul 25 19:52:32.130240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1317/2795] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:31 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:33.151417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7fa425a2-25af-4f39-a910-6e88b8833e68 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:33.152211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7fa425a2-25af-4f39-a910-6e88b8833e68 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:33.158873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fa425a2-25af-4f39-a910-6e88b8833e68 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:33.159448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fa425a2-25af-4f39-a910-6e88b8833e68 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:33.160243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fa425a2-25af-4f39-a910-6e88b8833e68 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:33.160673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fa425a2-25af-4f39-a910-6e88b8833e68 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:33.163419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=78 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:33.331659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7fa425a2-25af-4f39-a910-6e88b8833e68 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:33.340773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7fa425a2-25af-4f39-a910-6e88b8833e68 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.193552 Jul 25 19:52:33.341363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1479/2796] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:33 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:34.361757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1c99b85-c368-4bb1-b507-63d153cf0452 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:34.362374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c1c99b85-c368-4bb1-b507-63d153cf0452 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:34.369113 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1c99b85-c368-4bb1-b507-63d153cf0452 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:34.369583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1c99b85-c368-4bb1-b507-63d153cf0452 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:34.370413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1c99b85-c368-4bb1-b507-63d153cf0452 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:34.370838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1c99b85-c368-4bb1-b507-63d153cf0452 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:34.521057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c1c99b85-c368-4bb1-b507-63d153cf0452 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:34.532332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c1c99b85-c368-4bb1-b507-63d153cf0452 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.173883 Jul 25 19:52:34.533404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1318/2797] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:34 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:35.567700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5f78c106-6ca8-4692-80a6-d26c965c90cd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:35.568476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5f78c106-6ca8-4692-80a6-d26c965c90cd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:35.577309 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f78c106-6ca8-4692-80a6-d26c965c90cd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:35.577757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f78c106-6ca8-4692-80a6-d26c965c90cd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:35.578544 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f78c106-6ca8-4692-80a6-d26c965c90cd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:35.578986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f78c106-6ca8-4692-80a6-d26c965c90cd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:35.737372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5f78c106-6ca8-4692-80a6-d26c965c90cd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:35.747408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5f78c106-6ca8-4692-80a6-d26c965c90cd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.183794 Jul 25 19:52:35.748145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1480/2798] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:35 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:36.769823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2de672a4-f789-402a-b7a6-a47e5cfa90f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:36.770437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2de672a4-f789-402a-b7a6-a47e5cfa90f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:36.777344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2de672a4-f789-402a-b7a6-a47e5cfa90f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:36.777796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2de672a4-f789-402a-b7a6-a47e5cfa90f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:36.778576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2de672a4-f789-402a-b7a6-a47e5cfa90f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:36.779010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2de672a4-f789-402a-b7a6-a47e5cfa90f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:36.943949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2de672a4-f789-402a-b7a6-a47e5cfa90f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:36.954240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2de672a4-f789-402a-b7a6-a47e5cfa90f1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.188202 Jul 25 19:52:36.954841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1319/2799] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:36 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:37.977040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-52bdd2f2-149a-4340-bb04-16685d0a7a9a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:37.977607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-52bdd2f2-149a-4340-bb04-16685d0a7a9a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:37.985778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-52bdd2f2-149a-4340-bb04-16685d0a7a9a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:37.986220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-52bdd2f2-149a-4340-bb04-16685d0a7a9a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:37.986981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-52bdd2f2-149a-4340-bb04-16685d0a7a9a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:37.987408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-52bdd2f2-149a-4340-bb04-16685d0a7a9a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:38.147934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-52bdd2f2-149a-4340-bb04-16685d0a7a9a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:38.162686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-52bdd2f2-149a-4340-bb04-16685d0a7a9a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.189645 Jul 25 19:52:38.163284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1481/2800] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:37 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:39.186735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4d88894-3775-466f-b97b-55451b8b4659 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:39.187462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c4d88894-3775-466f-b97b-55451b8b4659 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:39.194397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4d88894-3775-466f-b97b-55451b8b4659 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:39.194845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4d88894-3775-466f-b97b-55451b8b4659 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:39.195660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4d88894-3775-466f-b97b-55451b8b4659 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:39.196104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4d88894-3775-466f-b97b-55451b8b4659 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:39.340824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c4d88894-3775-466f-b97b-55451b8b4659 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:39.349264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c4d88894-3775-466f-b97b-55451b8b4659 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.166302 Jul 25 19:52:39.349862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1320/2801] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:39 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:40.373565 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-997bf76f-2e0b-407e-ba55-cbe92877e1d4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:40.374183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-997bf76f-2e0b-407e-ba55-cbe92877e1d4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:40.381036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-997bf76f-2e0b-407e-ba55-cbe92877e1d4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:40.381484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-997bf76f-2e0b-407e-ba55-cbe92877e1d4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:40.382265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-997bf76f-2e0b-407e-ba55-cbe92877e1d4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:40.382705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-997bf76f-2e0b-407e-ba55-cbe92877e1d4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:40.550382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-997bf76f-2e0b-407e-ba55-cbe92877e1d4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:40.559206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-997bf76f-2e0b-407e-ba55-cbe92877e1d4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.190448 Jul 25 19:52:40.559885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1482/2802] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:40 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:41.583193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b4fde46-1db7-487d-918d-5748eb1340fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:41.584103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b4fde46-1db7-487d-918d-5748eb1340fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:41.592227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b4fde46-1db7-487d-918d-5748eb1340fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:41.592675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b4fde46-1db7-487d-918d-5748eb1340fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:41.593454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b4fde46-1db7-487d-918d-5748eb1340fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:41.593889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b4fde46-1db7-487d-918d-5748eb1340fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:41.758131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b4fde46-1db7-487d-918d-5748eb1340fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:41.767547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b4fde46-1db7-487d-918d-5748eb1340fa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.189014 Jul 25 19:52:41.768124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1321/2803] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:41 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:42.790993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-055e967d-90f2-4ac1-9cdf-69348b0e3020 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:42.792173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-055e967d-90f2-4ac1-9cdf-69348b0e3020 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:42.799101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-055e967d-90f2-4ac1-9cdf-69348b0e3020 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:42.799610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-055e967d-90f2-4ac1-9cdf-69348b0e3020 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:42.800417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-055e967d-90f2-4ac1-9cdf-69348b0e3020 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:42.800917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-055e967d-90f2-4ac1-9cdf-69348b0e3020 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:42.957474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-055e967d-90f2-4ac1-9cdf-69348b0e3020 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:42.966282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-055e967d-90f2-4ac1-9cdf-69348b0e3020 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.179342 Jul 25 19:52:42.966874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1483/2804] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:42 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:43.992552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f1dbf96-5309-4334-8a5c-42e850925ccb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:43.993682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2f1dbf96-5309-4334-8a5c-42e850925ccb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:44.005839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f1dbf96-5309-4334-8a5c-42e850925ccb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:44.006625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f1dbf96-5309-4334-8a5c-42e850925ccb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:44.008052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f1dbf96-5309-4334-8a5c-42e850925ccb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:44.008804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f1dbf96-5309-4334-8a5c-42e850925ccb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:44.163399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2f1dbf96-5309-4334-8a5c-42e850925ccb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:44.173696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2f1dbf96-5309-4334-8a5c-42e850925ccb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.188910 Jul 25 19:52:44.174288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1322/2805] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:43 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:45.202113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-365a1a7b-6edd-42d5-877b-2801cc8267b0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:45.203323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-365a1a7b-6edd-42d5-877b-2801cc8267b0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:45.213411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-365a1a7b-6edd-42d5-877b-2801cc8267b0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:45.213860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-365a1a7b-6edd-42d5-877b-2801cc8267b0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:45.214671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-365a1a7b-6edd-42d5-877b-2801cc8267b0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:45.215189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-365a1a7b-6edd-42d5-877b-2801cc8267b0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:45.372773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-365a1a7b-6edd-42d5-877b-2801cc8267b0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:45.381437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-365a1a7b-6edd-42d5-877b-2801cc8267b0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.187271 Jul 25 19:52:45.382044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1484/2806] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:45 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:46.405305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c311a2de-bba3-44fd-a84a-71d0057a949a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:46.405982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c311a2de-bba3-44fd-a84a-71d0057a949a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:46.413428 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c311a2de-bba3-44fd-a84a-71d0057a949a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:46.414001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c311a2de-bba3-44fd-a84a-71d0057a949a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:46.414826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c311a2de-bba3-44fd-a84a-71d0057a949a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:46.415298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c311a2de-bba3-44fd-a84a-71d0057a949a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:46.419246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:46.579896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c311a2de-bba3-44fd-a84a-71d0057a949a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:46.590194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c311a2de-bba3-44fd-a84a-71d0057a949a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.189362 Jul 25 19:52:46.590800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1323/2807] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:46 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:47.614613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-72c6c276-5b42-4bc8-ab97-e5b449a09000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:47.615293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-72c6c276-5b42-4bc8-ab97-e5b449a09000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:47.623551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72c6c276-5b42-4bc8-ab97-e5b449a09000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:47.624095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72c6c276-5b42-4bc8-ab97-e5b449a09000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:47.625020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72c6c276-5b42-4bc8-ab97-e5b449a09000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:47.625563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-72c6c276-5b42-4bc8-ab97-e5b449a09000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:47.798440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-72c6c276-5b42-4bc8-ab97-e5b449a09000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:47.808767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-72c6c276-5b42-4bc8-ab97-e5b449a09000 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.199563 Jul 25 19:52:47.809460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1485/2808] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:47 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:48.832232 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc3c5fc8-1223-434c-8947-e1eaf64ec7d9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:48.832818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cc3c5fc8-1223-434c-8947-e1eaf64ec7d9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:48.840024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc3c5fc8-1223-434c-8947-e1eaf64ec7d9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:48.840720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc3c5fc8-1223-434c-8947-e1eaf64ec7d9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:48.841205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc3c5fc8-1223-434c-8947-e1eaf64ec7d9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:48.841642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc3c5fc8-1223-434c-8947-e1eaf64ec7d9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:49.003798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cc3c5fc8-1223-434c-8947-e1eaf64ec7d9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:49.013543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cc3c5fc8-1223-434c-8947-e1eaf64ec7d9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.185093 Jul 25 19:52:49.014136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1324/2809] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:48 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:50.035576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a8fab62a-fc62-4c6c-97ae-440b79363a8d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:50.036212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a8fab62a-fc62-4c6c-97ae-440b79363a8d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:50.038563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=26 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:50.044493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8fab62a-fc62-4c6c-97ae-440b79363a8d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:50.044954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8fab62a-fc62-4c6c-97ae-440b79363a8d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:50.045776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8fab62a-fc62-4c6c-97ae-440b79363a8d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:50.046171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8fab62a-fc62-4c6c-97ae-440b79363a8d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:50.195182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a8fab62a-fc62-4c6c-97ae-440b79363a8d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:50.204332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a8fab62a-fc62-4c6c-97ae-440b79363a8d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.172634 Jul 25 19:52:50.204917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1486/2810] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:50 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:51.226416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-744b39ff-0172-428c-9ca1-5704353a5a21 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:51.227001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-744b39ff-0172-428c-9ca1-5704353a5a21 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:51.230049 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:51.236014 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-744b39ff-0172-428c-9ca1-5704353a5a21 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:51.236433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-744b39ff-0172-428c-9ca1-5704353a5a21 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:51.237195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-744b39ff-0172-428c-9ca1-5704353a5a21 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:51.237625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-744b39ff-0172-428c-9ca1-5704353a5a21 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:51.389234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-744b39ff-0172-428c-9ca1-5704353a5a21 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:51.397482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-744b39ff-0172-428c-9ca1-5704353a5a21 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.175179 Jul 25 19:52:51.398082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1325/2811] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:51 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:52.420836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6031e561-aafa-4a23-a045-8b738f3229b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:52.421430 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6031e561-aafa-4a23-a045-8b738f3229b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:52.427904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6031e561-aafa-4a23-a045-8b738f3229b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:52.428345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6031e561-aafa-4a23-a045-8b738f3229b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:52.429101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6031e561-aafa-4a23-a045-8b738f3229b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:52.429537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6031e561-aafa-4a23-a045-8b738f3229b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:52.571610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6031e561-aafa-4a23-a045-8b738f3229b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:52.582012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6031e561-aafa-4a23-a045-8b738f3229b3 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.166008 Jul 25 19:52:52.582599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1487/2812] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:52 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:53.607095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9d002d5d-2a2e-4592-92c0-a5529999894b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:53.607986 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9d002d5d-2a2e-4592-92c0-a5529999894b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:53.614775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d002d5d-2a2e-4592-92c0-a5529999894b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:53.615222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d002d5d-2a2e-4592-92c0-a5529999894b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:53.616021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d002d5d-2a2e-4592-92c0-a5529999894b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:53.616462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d002d5d-2a2e-4592-92c0-a5529999894b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:53.753891 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9d002d5d-2a2e-4592-92c0-a5529999894b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:53.762779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9d002d5d-2a2e-4592-92c0-a5529999894b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.160001 Jul 25 19:52:53.763369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1326/2813] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:53 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:54.786737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-adf8f09e-9812-43d0-8de3-6d5ce1273307 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:54.787646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-adf8f09e-9812-43d0-8de3-6d5ce1273307 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:54.797354 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adf8f09e-9812-43d0-8de3-6d5ce1273307 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:54.797827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adf8f09e-9812-43d0-8de3-6d5ce1273307 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:54.798725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adf8f09e-9812-43d0-8de3-6d5ce1273307 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:54.799185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-adf8f09e-9812-43d0-8de3-6d5ce1273307 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:54.968930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-adf8f09e-9812-43d0-8de3-6d5ce1273307 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:54.978038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-adf8f09e-9812-43d0-8de3-6d5ce1273307 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.196179 Jul 25 19:52:54.979019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1488/2814] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:54 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:56.000665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b3cf68ee-60ba-477a-89fd-cd73286de440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:56.001273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b3cf68ee-60ba-477a-89fd-cd73286de440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:56.007828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3cf68ee-60ba-477a-89fd-cd73286de440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:56.008285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3cf68ee-60ba-477a-89fd-cd73286de440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:56.009055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3cf68ee-60ba-477a-89fd-cd73286de440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:56.010088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3cf68ee-60ba-477a-89fd-cd73286de440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:56.152873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b3cf68ee-60ba-477a-89fd-cd73286de440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:56.162681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b3cf68ee-60ba-477a-89fd-cd73286de440 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.165898 Jul 25 19:52:56.163296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1327/2815] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:55 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:57.187702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ab1f3fb1-4b61-436b-8f06-640902f37001 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:57.188572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ab1f3fb1-4b61-436b-8f06-640902f37001 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:57.196141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab1f3fb1-4b61-436b-8f06-640902f37001 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:57.196684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab1f3fb1-4b61-436b-8f06-640902f37001 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:57.197669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab1f3fb1-4b61-436b-8f06-640902f37001 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:57.198142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ab1f3fb1-4b61-436b-8f06-640902f37001 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:57.391653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ab1f3fb1-4b61-436b-8f06-640902f37001 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:57.402850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ab1f3fb1-4b61-436b-8f06-640902f37001 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.219673 Jul 25 19:52:57.403500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1489/2816] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:57 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:58.429116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-92ecbe48-aadb-4664-b876-af56898135e0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:58.430162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-92ecbe48-aadb-4664-b876-af56898135e0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:58.441712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ecbe48-aadb-4664-b876-af56898135e0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:58.442449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ecbe48-aadb-4664-b876-af56898135e0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:58.443850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ecbe48-aadb-4664-b876-af56898135e0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:58.444614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ecbe48-aadb-4664-b876-af56898135e0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:58.649603 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-92ecbe48-aadb-4664-b876-af56898135e0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:58.659252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-92ecbe48-aadb-4664-b876-af56898135e0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.237551 Jul 25 19:52:58.659880 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1328/2817] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:58 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:59.684549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-638d8d55-abeb-4544-bf95-4374a2fcfaeb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:59.685468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-638d8d55-abeb-4544-bf95-4374a2fcfaeb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:52:59.695184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-638d8d55-abeb-4544-bf95-4374a2fcfaeb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:59.695880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-638d8d55-abeb-4544-bf95-4374a2fcfaeb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:59.697684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-638d8d55-abeb-4544-bf95-4374a2fcfaeb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:52:59.698163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-638d8d55-abeb-4544-bf95-4374a2fcfaeb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:52:59.909896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-638d8d55-abeb-4544-bf95-4374a2fcfaeb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:52:59.923598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-638d8d55-abeb-4544-bf95-4374a2fcfaeb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.244450 Jul 25 19:52:59.924487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1490/2818] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:52:59 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:00.954622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d18ed0f1-4482-486d-8392-1f3feca69f3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:00.955294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d18ed0f1-4482-486d-8392-1f3feca69f3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:00.963058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d18ed0f1-4482-486d-8392-1f3feca69f3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:00.963641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d18ed0f1-4482-486d-8392-1f3feca69f3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:00.964768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d18ed0f1-4482-486d-8392-1f3feca69f3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:00.965575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d18ed0f1-4482-486d-8392-1f3feca69f3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:01.149583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d18ed0f1-4482-486d-8392-1f3feca69f3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:01.167714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d18ed0f1-4482-486d-8392-1f3feca69f3f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.217352 Jul 25 19:53:01.170384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1329/2819] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:00 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:02.193107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f3c7f92b-789c-4baf-bfeb-630733d275c8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:02.194229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f3c7f92b-789c-4baf-bfeb-630733d275c8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:02.201579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3c7f92b-789c-4baf-bfeb-630733d275c8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:02.202025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3c7f92b-789c-4baf-bfeb-630733d275c8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:02.202794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3c7f92b-789c-4baf-bfeb-630733d275c8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:02.203378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f3c7f92b-789c-4baf-bfeb-630733d275c8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:02.398710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f3c7f92b-789c-4baf-bfeb-630733d275c8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:02.412100 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f3c7f92b-789c-4baf-bfeb-630733d275c8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.223024 Jul 25 19:53:02.413038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1491/2820] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:02 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:03.445147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-02147c3b-bf4a-4f50-9113-b827e2f56015 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:03.446003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-02147c3b-bf4a-4f50-9113-b827e2f56015 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:03.457155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02147c3b-bf4a-4f50-9113-b827e2f56015 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:03.457906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02147c3b-bf4a-4f50-9113-b827e2f56015 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:03.459218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02147c3b-bf4a-4f50-9113-b827e2f56015 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:03.460008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02147c3b-bf4a-4f50-9113-b827e2f56015 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:03.615249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-02147c3b-bf4a-4f50-9113-b827e2f56015 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:03.623951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-02147c3b-bf4a-4f50-9113-b827e2f56015 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.186063 Jul 25 19:53:03.624595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1330/2821] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:03 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:04.656111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4c6fb8f8-e8ef-490f-9da3-61230927e618 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:04.656724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4c6fb8f8-e8ef-490f-9da3-61230927e618 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:04.663618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c6fb8f8-e8ef-490f-9da3-61230927e618 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:04.664065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c6fb8f8-e8ef-490f-9da3-61230927e618 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:04.664918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c6fb8f8-e8ef-490f-9da3-61230927e618 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:04.665351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4c6fb8f8-e8ef-490f-9da3-61230927e618 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:04.668421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=78 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:53:04.806668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4c6fb8f8-e8ef-490f-9da3-61230927e618 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:04.814732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4c6fb8f8-e8ef-490f-9da3-61230927e618 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.162499 Jul 25 19:53:04.815298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1492/2822] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:04 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:05.840283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2577d0d9-8e10-4d78-8230-8286c3c2dc65 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:05.842485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2577d0d9-8e10-4d78-8230-8286c3c2dc65 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:05.849877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2577d0d9-8e10-4d78-8230-8286c3c2dc65 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:05.850454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2577d0d9-8e10-4d78-8230-8286c3c2dc65 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:05.851754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2577d0d9-8e10-4d78-8230-8286c3c2dc65 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:05.852287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2577d0d9-8e10-4d78-8230-8286c3c2dc65 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:06.039031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2577d0d9-8e10-4d78-8230-8286c3c2dc65 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:06.048443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2577d0d9-8e10-4d78-8230-8286c3c2dc65 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.214874 Jul 25 19:53:06.049101 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1331/2823] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:05 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:07.071500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-35eec35f-d93c-478e-afe8-061aae916983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:07.073072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-35eec35f-d93c-478e-afe8-061aae916983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:07.081575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-35eec35f-d93c-478e-afe8-061aae916983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:07.082074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-35eec35f-d93c-478e-afe8-061aae916983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:07.082985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-35eec35f-d93c-478e-afe8-061aae916983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:07.083631 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-35eec35f-d93c-478e-afe8-061aae916983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:07.278069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-35eec35f-d93c-478e-afe8-061aae916983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:07.291936 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-35eec35f-d93c-478e-afe8-061aae916983 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.224623 Jul 25 19:53:07.292847 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1493/2824] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:07 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:53:08.322100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f4f47b7-50e1-4a29-ab47-de1de16181d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:08.322883 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f4f47b7-50e1-4a29-ab47-de1de16181d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:08.330300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f4f47b7-50e1-4a29-ab47-de1de16181d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:08.330749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f4f47b7-50e1-4a29-ab47-de1de16181d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:08.331535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f4f47b7-50e1-4a29-ab47-de1de16181d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:08.331978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f4f47b7-50e1-4a29-ab47-de1de16181d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:08.475286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f4f47b7-50e1-4a29-ab47-de1de16181d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:08.486423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f4f47b7-50e1-4a29-ab47-de1de16181d2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.168142 Jul 25 19:53:08.487161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1332/2825] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:08 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:09.510647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4190ca46-05f0-4f6b-ad17-9ec2ceacf4ee tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:09.511396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4190ca46-05f0-4f6b-ad17-9ec2ceacf4ee tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:09.519833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4190ca46-05f0-4f6b-ad17-9ec2ceacf4ee tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:09.520435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4190ca46-05f0-4f6b-ad17-9ec2ceacf4ee tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:09.521621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4190ca46-05f0-4f6b-ad17-9ec2ceacf4ee tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:09.522063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4190ca46-05f0-4f6b-ad17-9ec2ceacf4ee tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:09.672202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4190ca46-05f0-4f6b-ad17-9ec2ceacf4ee tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:09.680460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4190ca46-05f0-4f6b-ad17-9ec2ceacf4ee tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.174494 Jul 25 19:53:09.682182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1494/2826] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:09 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:53:10.708812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b3834d1-ab38-4ed3-895f-fcf1e38af023 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:10.709949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b3834d1-ab38-4ed3-895f-fcf1e38af023 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:10.718688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b3834d1-ab38-4ed3-895f-fcf1e38af023 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:10.719146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b3834d1-ab38-4ed3-895f-fcf1e38af023 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:10.720081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b3834d1-ab38-4ed3-895f-fcf1e38af023 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:10.720618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b3834d1-ab38-4ed3-895f-fcf1e38af023 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:10.882271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b3834d1-ab38-4ed3-895f-fcf1e38af023 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:10.891985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b3834d1-ab38-4ed3-895f-fcf1e38af023 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.187616 Jul 25 19:53:10.892635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1333/2827] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:10 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:11.916930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3d350cbc-3368-4d32-8921-e1e8f4c9b3a1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:11.917782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3d350cbc-3368-4d32-8921-e1e8f4c9b3a1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:11.924638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d350cbc-3368-4d32-8921-e1e8f4c9b3a1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:11.925107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d350cbc-3368-4d32-8921-e1e8f4c9b3a1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:11.925939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d350cbc-3368-4d32-8921-e1e8f4c9b3a1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:11.926376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d350cbc-3368-4d32-8921-e1e8f4c9b3a1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:12.083791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3d350cbc-3368-4d32-8921-e1e8f4c9b3a1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:12.092728 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3d350cbc-3368-4d32-8921-e1e8f4c9b3a1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.180503 Jul 25 19:53:12.093318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1495/2828] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:11 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:13.114604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-57552b10-42e5-4c8a-bcee-1981baf32447 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:13.115230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-57552b10-42e5-4c8a-bcee-1981baf32447 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:13.122455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57552b10-42e5-4c8a-bcee-1981baf32447 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:13.122905 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57552b10-42e5-4c8a-bcee-1981baf32447 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:13.123742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57552b10-42e5-4c8a-bcee-1981baf32447 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:13.124183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57552b10-42e5-4c8a-bcee-1981baf32447 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:13.278330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-57552b10-42e5-4c8a-bcee-1981baf32447 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:13.288598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-57552b10-42e5-4c8a-bcee-1981baf32447 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.178233 Jul 25 19:53:13.289185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1334/2829] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:13 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:53:14.310509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c37f9032-7cb7-4815-abee-82a868043c70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:14.311207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c37f9032-7cb7-4815-abee-82a868043c70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:14.318409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c37f9032-7cb7-4815-abee-82a868043c70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:14.318851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c37f9032-7cb7-4815-abee-82a868043c70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:14.319661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c37f9032-7cb7-4815-abee-82a868043c70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:14.320097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c37f9032-7cb7-4815-abee-82a868043c70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:14.460881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c37f9032-7cb7-4815-abee-82a868043c70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:14.469692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c37f9032-7cb7-4815-abee-82a868043c70 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.163060 Jul 25 19:53:14.470285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1496/2830] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:14 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:15.491933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0acff3ed-64b0-42e3-90a8-046b74ebe0dc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:15.492526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0acff3ed-64b0-42e3-90a8-046b74ebe0dc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:15.499900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0acff3ed-64b0-42e3-90a8-046b74ebe0dc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:15.500342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0acff3ed-64b0-42e3-90a8-046b74ebe0dc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:15.501095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0acff3ed-64b0-42e3-90a8-046b74ebe0dc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:15.501528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0acff3ed-64b0-42e3-90a8-046b74ebe0dc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:15.647714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0acff3ed-64b0-42e3-90a8-046b74ebe0dc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:15.659850 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0acff3ed-64b0-42e3-90a8-046b74ebe0dc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.171891 Jul 25 19:53:15.660687 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1335/2831] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:15 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:16.683184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3b8ddb76-29cc-4ed8-bbfa-3c6c1a864feb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:16.683836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3b8ddb76-29cc-4ed8-bbfa-3c6c1a864feb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:16.690259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b8ddb76-29cc-4ed8-bbfa-3c6c1a864feb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:16.690709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b8ddb76-29cc-4ed8-bbfa-3c6c1a864feb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:16.691483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b8ddb76-29cc-4ed8-bbfa-3c6c1a864feb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:16.691961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b8ddb76-29cc-4ed8-bbfa-3c6c1a864feb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:16.831090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b8ddb76-29cc-4ed8-bbfa-3c6c1a864feb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:16.839687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3b8ddb76-29cc-4ed8-bbfa-3c6c1a864feb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.161373 Jul 25 19:53:16.840277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1497/2832] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:16 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:17.862285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1a8b1688-3c2d-4c0e-a6f7-de017b81d0ce tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:17.862881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1a8b1688-3c2d-4c0e-a6f7-de017b81d0ce tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:17.870744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a8b1688-3c2d-4c0e-a6f7-de017b81d0ce tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:17.871194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a8b1688-3c2d-4c0e-a6f7-de017b81d0ce tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:17.872001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a8b1688-3c2d-4c0e-a6f7-de017b81d0ce tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:17.872439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a8b1688-3c2d-4c0e-a6f7-de017b81d0ce tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:17.875210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:53:18.425009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1a8b1688-3c2d-4c0e-a6f7-de017b81d0ce tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:18.433265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1a8b1688-3c2d-4c0e-a6f7-de017b81d0ce tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.574828 Jul 25 19:53:18.433836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1336/2833] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:17 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:18.937000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:53:18.937749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:53:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:53:19.455696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1cd30878-e4e2-4a33-a2f5-b04b062509d0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:19.456272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1cd30878-e4e2-4a33-a2f5-b04b062509d0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:19.463271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cd30878-e4e2-4a33-a2f5-b04b062509d0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:19.463743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cd30878-e4e2-4a33-a2f5-b04b062509d0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:19.464516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cd30878-e4e2-4a33-a2f5-b04b062509d0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:19.464958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1cd30878-e4e2-4a33-a2f5-b04b062509d0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:19.598481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1cd30878-e4e2-4a33-a2f5-b04b062509d0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:19.608945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1cd30878-e4e2-4a33-a2f5-b04b062509d0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.157115 Jul 25 19:53:19.609610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1498/2834] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:19 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:20.630517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-792fcbc9-a961-4e88-a795-b4a3c1a9fa6f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:20.631121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-792fcbc9-a961-4e88-a795-b4a3c1a9fa6f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:20.638759 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-792fcbc9-a961-4e88-a795-b4a3c1a9fa6f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:20.640482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-792fcbc9-a961-4e88-a795-b4a3c1a9fa6f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:20.640917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-792fcbc9-a961-4e88-a795-b4a3c1a9fa6f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:20.641361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-792fcbc9-a961-4e88-a795-b4a3c1a9fa6f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:20.793522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-792fcbc9-a961-4e88-a795-b4a3c1a9fa6f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:20.801700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-792fcbc9-a961-4e88-a795-b4a3c1a9fa6f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.174929 Jul 25 19:53:20.802279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1337/2835] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:20 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:21.823239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f17f466c-2800-4aaa-a5ce-44e6a04c0f0f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:21.823879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f17f466c-2800-4aaa-a5ce-44e6a04c0f0f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:21.826371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=26 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:53:21.832250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f17f466c-2800-4aaa-a5ce-44e6a04c0f0f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:21.832700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f17f466c-2800-4aaa-a5ce-44e6a04c0f0f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:21.833474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f17f466c-2800-4aaa-a5ce-44e6a04c0f0f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:21.833910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f17f466c-2800-4aaa-a5ce-44e6a04c0f0f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:21.975729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f17f466c-2800-4aaa-a5ce-44e6a04c0f0f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:21.986553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f17f466c-2800-4aaa-a5ce-44e6a04c0f0f tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.167177 Jul 25 19:53:21.987140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1499/2836] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:21 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:23.010427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c169fdaf-f830-4d7b-a177-c9c95063267a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:23.011247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c169fdaf-f830-4d7b-a177-c9c95063267a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:23.013011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:53:23.018808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c169fdaf-f830-4d7b-a177-c9c95063267a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:23.019250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c169fdaf-f830-4d7b-a177-c9c95063267a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:23.020053 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c169fdaf-f830-4d7b-a177-c9c95063267a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:23.020480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c169fdaf-f830-4d7b-a177-c9c95063267a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:23.167170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c169fdaf-f830-4d7b-a177-c9c95063267a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:23.175807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c169fdaf-f830-4d7b-a177-c9c95063267a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.170788 Jul 25 19:53:23.176383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1338/2837] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:23 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:24.198450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-06f73e99-e140-4729-a087-21884832c304 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:24.199092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-06f73e99-e140-4729-a087-21884832c304 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:24.205973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06f73e99-e140-4729-a087-21884832c304 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:24.206420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06f73e99-e140-4729-a087-21884832c304 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:24.207184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06f73e99-e140-4729-a087-21884832c304 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:24.207642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-06f73e99-e140-4729-a087-21884832c304 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:24.346778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-06f73e99-e140-4729-a087-21884832c304 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:24.356025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-06f73e99-e140-4729-a087-21884832c304 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.162226 Jul 25 19:53:24.356848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1500/2838] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:24 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:25.379024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4274242e-23d8-42d8-ac9c-fc7b25a0d244 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:25.379663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4274242e-23d8-42d8-ac9c-fc7b25a0d244 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:25.386885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4274242e-23d8-42d8-ac9c-fc7b25a0d244 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:25.387380 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4274242e-23d8-42d8-ac9c-fc7b25a0d244 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:25.388553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4274242e-23d8-42d8-ac9c-fc7b25a0d244 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:25.389149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4274242e-23d8-42d8-ac9c-fc7b25a0d244 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:25.531652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4274242e-23d8-42d8-ac9c-fc7b25a0d244 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:25.539788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4274242e-23d8-42d8-ac9c-fc7b25a0d244 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.164610 Jul 25 19:53:25.541048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1339/2839] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:25 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:26.561108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c0665b36-767a-412f-899f-a2248dc19bc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:26.561757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c0665b36-767a-412f-899f-a2248dc19bc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:26.568431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0665b36-767a-412f-899f-a2248dc19bc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:26.568882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0665b36-767a-412f-899f-a2248dc19bc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:26.569653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0665b36-767a-412f-899f-a2248dc19bc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:26.570133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c0665b36-767a-412f-899f-a2248dc19bc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:26.715068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c0665b36-767a-412f-899f-a2248dc19bc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:26.723445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c0665b36-767a-412f-899f-a2248dc19bc8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.166189 Jul 25 19:53:26.724048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1501/2840] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:26 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:27.748179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-196b8009-b616-443a-b740-161a30380580 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:27.748835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-196b8009-b616-443a-b740-161a30380580 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:27.755309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-196b8009-b616-443a-b740-161a30380580 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:27.755788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-196b8009-b616-443a-b740-161a30380580 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:27.756548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-196b8009-b616-443a-b740-161a30380580 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:27.756978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-196b8009-b616-443a-b740-161a30380580 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:27.889054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-196b8009-b616-443a-b740-161a30380580 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:27.896902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-196b8009-b616-443a-b740-161a30380580 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.153065 Jul 25 19:53:27.897460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1340/2841] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:27 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:28.919302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a43fcce0-345e-49d5-ad81-12b29b8ebb82 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:28.919935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a43fcce0-345e-49d5-ad81-12b29b8ebb82 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:28.927378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a43fcce0-345e-49d5-ad81-12b29b8ebb82 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:28.927846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a43fcce0-345e-49d5-ad81-12b29b8ebb82 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:28.928859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a43fcce0-345e-49d5-ad81-12b29b8ebb82 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:28.929315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a43fcce0-345e-49d5-ad81-12b29b8ebb82 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:29.065972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a43fcce0-345e-49d5-ad81-12b29b8ebb82 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:29.074686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a43fcce0-345e-49d5-ad81-12b29b8ebb82 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.160176 Jul 25 19:53:29.075272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1502/2842] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:28 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:30.095976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b49c158-2712-463a-adc9-395dc8c7dcb5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:30.096587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b49c158-2712-463a-adc9-395dc8c7dcb5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:30.103852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b49c158-2712-463a-adc9-395dc8c7dcb5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:30.104301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b49c158-2712-463a-adc9-395dc8c7dcb5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:30.105063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b49c158-2712-463a-adc9-395dc8c7dcb5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:30.105509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b49c158-2712-463a-adc9-395dc8c7dcb5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:30.241055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b49c158-2712-463a-adc9-395dc8c7dcb5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:30.249172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b49c158-2712-463a-adc9-395dc8c7dcb5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.157114 Jul 25 19:53:30.249726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1341/2843] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:30 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:31.270413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1665c61b-eb83-4dce-a219-c2a7f53be8cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:31.271023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1665c61b-eb83-4dce-a219-c2a7f53be8cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:31.278446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1665c61b-eb83-4dce-a219-c2a7f53be8cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:31.278887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1665c61b-eb83-4dce-a219-c2a7f53be8cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:31.279686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1665c61b-eb83-4dce-a219-c2a7f53be8cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:31.280122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1665c61b-eb83-4dce-a219-c2a7f53be8cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:31.417599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1665c61b-eb83-4dce-a219-c2a7f53be8cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:31.425623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1665c61b-eb83-4dce-a219-c2a7f53be8cc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.159085 Jul 25 19:53:31.426121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1503/2844] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:31 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:32.448745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-507caa9e-75c5-485f-82a6-340f794e2fa7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:32.449402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-507caa9e-75c5-485f-82a6-340f794e2fa7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:32.456311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-507caa9e-75c5-485f-82a6-340f794e2fa7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:32.456782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-507caa9e-75c5-485f-82a6-340f794e2fa7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:32.457541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-507caa9e-75c5-485f-82a6-340f794e2fa7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:32.457985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-507caa9e-75c5-485f-82a6-340f794e2fa7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:32.607793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-507caa9e-75c5-485f-82a6-340f794e2fa7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:32.617339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-507caa9e-75c5-485f-82a6-340f794e2fa7 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.173300 Jul 25 19:53:32.618520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1342/2845] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:32 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:33.639475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-79588d57-1bd9-4ae9-a214-a5804526cdb1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:33.640096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-79588d57-1bd9-4ae9-a214-a5804526cdb1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:33.646632 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79588d57-1bd9-4ae9-a214-a5804526cdb1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:33.647071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79588d57-1bd9-4ae9-a214-a5804526cdb1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:33.647862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79588d57-1bd9-4ae9-a214-a5804526cdb1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:33.648291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-79588d57-1bd9-4ae9-a214-a5804526cdb1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:33.809364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-79588d57-1bd9-4ae9-a214-a5804526cdb1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:33.818205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-79588d57-1bd9-4ae9-a214-a5804526cdb1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.182402 Jul 25 19:53:33.818796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1504/2846] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:33 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:53:34.841610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f1caedc5-72b6-4c19-ae9a-d239ade5b5bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:34.842214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f1caedc5-72b6-4c19-ae9a-d239ade5b5bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:34.848228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1caedc5-72b6-4c19-ae9a-d239ade5b5bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:34.848665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1caedc5-72b6-4c19-ae9a-d239ade5b5bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:34.849414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1caedc5-72b6-4c19-ae9a-d239ade5b5bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:34.849845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1caedc5-72b6-4c19-ae9a-d239ade5b5bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:34.994836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f1caedc5-72b6-4c19-ae9a-d239ade5b5bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:35.004731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f1caedc5-72b6-4c19-ae9a-d239ade5b5bd tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.167056 Jul 25 19:53:35.005312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1343/2847] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:34 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:36.028069 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f1338987-5ed2-4f51-a01d-7d172e48b07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:36.028843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f1338987-5ed2-4f51-a01d-7d172e48b07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:36.035916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1338987-5ed2-4f51-a01d-7d172e48b07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:36.036366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1338987-5ed2-4f51-a01d-7d172e48b07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:36.037200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1338987-5ed2-4f51-a01d-7d172e48b07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:36.037639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f1338987-5ed2-4f51-a01d-7d172e48b07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:36.041212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=78 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:53:36.193555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f1338987-5ed2-4f51-a01d-7d172e48b07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:36.202335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f1338987-5ed2-4f51-a01d-7d172e48b07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.179353 Jul 25 19:53:36.202923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1505/2848] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:36 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:37.225485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-886e42d9-2282-4f5e-a803-17ed23c1c784 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:37.226309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-886e42d9-2282-4f5e-a803-17ed23c1c784 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:37.233666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-886e42d9-2282-4f5e-a803-17ed23c1c784 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:37.234086 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-886e42d9-2282-4f5e-a803-17ed23c1c784 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:37.234854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-886e42d9-2282-4f5e-a803-17ed23c1c784 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:37.235473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-886e42d9-2282-4f5e-a803-17ed23c1c784 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:37.459037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-886e42d9-2282-4f5e-a803-17ed23c1c784 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:37.468424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-886e42d9-2282-4f5e-a803-17ed23c1c784 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.246960 Jul 25 19:53:37.469007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1344/2849] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:37 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:38.491931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5b2dc0fd-f557-46a0-9832-2747d7c177c1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:38.493284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5b2dc0fd-f557-46a0-9832-2747d7c177c1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:38.500527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b2dc0fd-f557-46a0-9832-2747d7c177c1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:38.500972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b2dc0fd-f557-46a0-9832-2747d7c177c1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:38.501740 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b2dc0fd-f557-46a0-9832-2747d7c177c1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:38.502177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5b2dc0fd-f557-46a0-9832-2747d7c177c1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:38.665900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5b2dc0fd-f557-46a0-9832-2747d7c177c1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:38.674300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5b2dc0fd-f557-46a0-9832-2747d7c177c1 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.186453 Jul 25 19:53:38.674885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1506/2850] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:38 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:39.031007 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:53:39.031272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:53:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:53:39.697961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-903092a4-fa43-4208-a3d8-f555d2810a32 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:39.698568 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-903092a4-fa43-4208-a3d8-f555d2810a32 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:39.705037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-903092a4-fa43-4208-a3d8-f555d2810a32 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:39.705476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-903092a4-fa43-4208-a3d8-f555d2810a32 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:39.706223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-903092a4-fa43-4208-a3d8-f555d2810a32 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:39.706651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-903092a4-fa43-4208-a3d8-f555d2810a32 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:39.848410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-903092a4-fa43-4208-a3d8-f555d2810a32 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:39.858070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-903092a4-fa43-4208-a3d8-f555d2810a32 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.164599 Jul 25 19:53:39.858670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1345/2851] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:39 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:40.881899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-85545447-5601-4ff6-abdb-195087cca178 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:40.882513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-85545447-5601-4ff6-abdb-195087cca178 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:40.890307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-85545447-5601-4ff6-abdb-195087cca178 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:40.890753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-85545447-5601-4ff6-abdb-195087cca178 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:40.891548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-85545447-5601-4ff6-abdb-195087cca178 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:40.891979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-85545447-5601-4ff6-abdb-195087cca178 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:41.032101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-85545447-5601-4ff6-abdb-195087cca178 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:41.041333 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-85545447-5601-4ff6-abdb-195087cca178 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.163327 Jul 25 19:53:41.041919 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1507/2852] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:40 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:42.063351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-036fee1d-5387-4df8-a787-6ae353b39e77 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:42.063992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-036fee1d-5387-4df8-a787-6ae353b39e77 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:42.070506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-036fee1d-5387-4df8-a787-6ae353b39e77 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:42.071818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-036fee1d-5387-4df8-a787-6ae353b39e77 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:42.072601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-036fee1d-5387-4df8-a787-6ae353b39e77 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:42.073034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-036fee1d-5387-4df8-a787-6ae353b39e77 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:42.219370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-036fee1d-5387-4df8-a787-6ae353b39e77 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:42.228624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-036fee1d-5387-4df8-a787-6ae353b39e77 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.169060 Jul 25 19:53:42.229220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1346/2853] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:42 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:43.252874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-176b7bb5-2432-4440-8d94-75e0b6c93fe0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:43.253700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-176b7bb5-2432-4440-8d94-75e0b6c93fe0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:43.261342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-176b7bb5-2432-4440-8d94-75e0b6c93fe0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:43.262242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-176b7bb5-2432-4440-8d94-75e0b6c93fe0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:43.262997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-176b7bb5-2432-4440-8d94-75e0b6c93fe0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:43.264351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-176b7bb5-2432-4440-8d94-75e0b6c93fe0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:43.431154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-176b7bb5-2432-4440-8d94-75e0b6c93fe0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:43.443597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-176b7bb5-2432-4440-8d94-75e0b6c93fe0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.195669 Jul 25 19:53:43.444196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1508/2854] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:43 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:44.465873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-06a49bff-b943-4ef7-8f0d-1c5081daa600 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:44.466477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-06a49bff-b943-4ef7-8f0d-1c5081daa600 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:44.473651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06a49bff-b943-4ef7-8f0d-1c5081daa600 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:44.474096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06a49bff-b943-4ef7-8f0d-1c5081daa600 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:44.474867 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06a49bff-b943-4ef7-8f0d-1c5081daa600 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:44.475302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06a49bff-b943-4ef7-8f0d-1c5081daa600 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:44.622856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-06a49bff-b943-4ef7-8f0d-1c5081daa600 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:44.631051 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-06a49bff-b943-4ef7-8f0d-1c5081daa600 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.170014 Jul 25 19:53:44.631673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1347/2855] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:44 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:45.654216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1f5769c3-9f71-4e08-b7ac-84f2712b732d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:45.654912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1f5769c3-9f71-4e08-b7ac-84f2712b732d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:45.660928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1f5769c3-9f71-4e08-b7ac-84f2712b732d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:45.661372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1f5769c3-9f71-4e08-b7ac-84f2712b732d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:45.662128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1f5769c3-9f71-4e08-b7ac-84f2712b732d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:45.662556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1f5769c3-9f71-4e08-b7ac-84f2712b732d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:45.805528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1f5769c3-9f71-4e08-b7ac-84f2712b732d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:45.814538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1f5769c3-9f71-4e08-b7ac-84f2712b732d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.164505 Jul 25 19:53:45.815150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1509/2856] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:45 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:46.838680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9285730e-1c19-42ae-9822-74f79ddd8c3e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:46.839326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9285730e-1c19-42ae-9822-74f79ddd8c3e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:46.846543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9285730e-1c19-42ae-9822-74f79ddd8c3e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:46.846988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9285730e-1c19-42ae-9822-74f79ddd8c3e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:46.847792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9285730e-1c19-42ae-9822-74f79ddd8c3e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:46.848226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9285730e-1c19-42ae-9822-74f79ddd8c3e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:47.010253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9285730e-1c19-42ae-9822-74f79ddd8c3e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:47.019269 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9285730e-1c19-42ae-9822-74f79ddd8c3e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.185281 Jul 25 19:53:47.019898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1348/2857] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:46 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:48.042067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dc554d5a-a2cb-4901-a51d-c749927fbe6d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:48.042680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dc554d5a-a2cb-4901-a51d-c749927fbe6d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:48.049388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc554d5a-a2cb-4901-a51d-c749927fbe6d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:48.049821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc554d5a-a2cb-4901-a51d-c749927fbe6d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:48.050579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc554d5a-a2cb-4901-a51d-c749927fbe6d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:48.051013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc554d5a-a2cb-4901-a51d-c749927fbe6d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:48.204540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-dc554d5a-a2cb-4901-a51d-c749927fbe6d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:48.212958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dc554d5a-a2cb-4901-a51d-c749927fbe6d tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.174706 Jul 25 19:53:48.213543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1510/2858] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:48 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:53:49.237945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-19cd9703-8246-4cfb-add7-211cf8f22be2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:49.238962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-19cd9703-8246-4cfb-add7-211cf8f22be2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:49.246896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19cd9703-8246-4cfb-add7-211cf8f22be2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:49.247558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19cd9703-8246-4cfb-add7-211cf8f22be2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:49.248707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19cd9703-8246-4cfb-add7-211cf8f22be2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:49.249277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19cd9703-8246-4cfb-add7-211cf8f22be2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:49.252986 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:53:49.415686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-19cd9703-8246-4cfb-add7-211cf8f22be2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:49.424359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-19cd9703-8246-4cfb-add7-211cf8f22be2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.192550 Jul 25 19:53:49.424837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1349/2859] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:49 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:53:50.448741 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-aaad18d9-608c-43a7-a46e-b2cc16a0b975 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:50.449322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-aaad18d9-608c-43a7-a46e-b2cc16a0b975 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:50.457966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aaad18d9-608c-43a7-a46e-b2cc16a0b975 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:50.458411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aaad18d9-608c-43a7-a46e-b2cc16a0b975 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:50.459201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aaad18d9-608c-43a7-a46e-b2cc16a0b975 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:50.459967 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-aaad18d9-608c-43a7-a46e-b2cc16a0b975 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:50.616079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-aaad18d9-608c-43a7-a46e-b2cc16a0b975 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:50.624507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-aaad18d9-608c-43a7-a46e-b2cc16a0b975 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.182038 Jul 25 19:53:50.625105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1511/2860] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:50 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:51.646302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d9264791-cba9-4133-8a08-b0c132fd73c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:51.647041 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d9264791-cba9-4133-8a08-b0c132fd73c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:51.654610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9264791-cba9-4133-8a08-b0c132fd73c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:51.655194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9264791-cba9-4133-8a08-b0c132fd73c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:51.655845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9264791-cba9-4133-8a08-b0c132fd73c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:51.656272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9264791-cba9-4133-8a08-b0c132fd73c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:51.809221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d9264791-cba9-4133-8a08-b0c132fd73c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:51.817957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d9264791-cba9-4133-8a08-b0c132fd73c5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.175455 Jul 25 19:53:51.818681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1350/2861] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:51 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:52.843302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7755759e-fff2-435e-b73e-d59ccc2552ec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:52.843941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7755759e-fff2-435e-b73e-d59ccc2552ec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:52.846286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=26 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:53:52.851921 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7755759e-fff2-435e-b73e-d59ccc2552ec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:52.852473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7755759e-fff2-435e-b73e-d59ccc2552ec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:52.853246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7755759e-fff2-435e-b73e-d59ccc2552ec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:52.853686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7755759e-fff2-435e-b73e-d59ccc2552ec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:53.005795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7755759e-fff2-435e-b73e-d59ccc2552ec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:53.015815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7755759e-fff2-435e-b73e-d59ccc2552ec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.176264 Jul 25 19:53:53.016455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1512/2862] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:52 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:53:54.043019 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb9e9c0f-ad15-4dcc-9461-edbc72e58c64 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:54.046528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb9e9c0f-ad15-4dcc-9461-edbc72e58c64 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:54.049785 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:53:54.056316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb9e9c0f-ad15-4dcc-9461-edbc72e58c64 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:54.056734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb9e9c0f-ad15-4dcc-9461-edbc72e58c64 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:54.057681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb9e9c0f-ad15-4dcc-9461-edbc72e58c64 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:54.059157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb9e9c0f-ad15-4dcc-9461-edbc72e58c64 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:54.212072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb9e9c0f-ad15-4dcc-9461-edbc72e58c64 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:54.220615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb9e9c0f-ad15-4dcc-9461-edbc72e58c64 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.185667 Jul 25 19:53:54.221185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1351/2863] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:54 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:54.596869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:53:54.597192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:53:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:53:55.244342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5fd02ac9-790b-4d7c-90d6-c209fce783c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:55.244976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5fd02ac9-790b-4d7c-90d6-c209fce783c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:55.251983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5fd02ac9-790b-4d7c-90d6-c209fce783c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:55.252605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5fd02ac9-790b-4d7c-90d6-c209fce783c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:55.253344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5fd02ac9-790b-4d7c-90d6-c209fce783c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:55.253861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5fd02ac9-790b-4d7c-90d6-c209fce783c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:55.416327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5fd02ac9-790b-4d7c-90d6-c209fce783c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:55.424522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5fd02ac9-790b-4d7c-90d6-c209fce783c4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.184072 Jul 25 19:53:55.424984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1513/2864] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:55 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:56.447163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb5eee6f-e6ad-4aa9-9d8b-02b06d3e1abb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:56.447784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb5eee6f-e6ad-4aa9-9d8b-02b06d3e1abb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:56.454443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb5eee6f-e6ad-4aa9-9d8b-02b06d3e1abb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:56.454895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb5eee6f-e6ad-4aa9-9d8b-02b06d3e1abb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:56.455713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb5eee6f-e6ad-4aa9-9d8b-02b06d3e1abb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:56.456159 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb5eee6f-e6ad-4aa9-9d8b-02b06d3e1abb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:56.612667 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb5eee6f-e6ad-4aa9-9d8b-02b06d3e1abb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:56.624069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb5eee6f-e6ad-4aa9-9d8b-02b06d3e1abb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.181077 Jul 25 19:53:56.624658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1352/2865] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:56 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:57.646756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-96fbf55a-47bd-4b7f-aad7-04b9b74347ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:57.647356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-96fbf55a-47bd-4b7f-aad7-04b9b74347ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:57.654196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96fbf55a-47bd-4b7f-aad7-04b9b74347ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:57.654630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96fbf55a-47bd-4b7f-aad7-04b9b74347ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:57.655407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96fbf55a-47bd-4b7f-aad7-04b9b74347ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:57.655859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-96fbf55a-47bd-4b7f-aad7-04b9b74347ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:57.792501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-96fbf55a-47bd-4b7f-aad7-04b9b74347ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:57.800750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-96fbf55a-47bd-4b7f-aad7-04b9b74347ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.157745 Jul 25 19:53:57.801334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1514/2866] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:57 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:53:58.823475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-73a97115-ad82-4310-a02f-2c3eea9dbd07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:58.824156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-73a97115-ad82-4310-a02f-2c3eea9dbd07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:53:58.831233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73a97115-ad82-4310-a02f-2c3eea9dbd07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:58.831739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73a97115-ad82-4310-a02f-2c3eea9dbd07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:58.832548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73a97115-ad82-4310-a02f-2c3eea9dbd07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:53:58.832988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73a97115-ad82-4310-a02f-2c3eea9dbd07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:53:58.982643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-73a97115-ad82-4310-a02f-2c3eea9dbd07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:53:58.990960 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-73a97115-ad82-4310-a02f-2c3eea9dbd07 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.171854 Jul 25 19:53:58.991540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1353/2867] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:53:58 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:00.016045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-99e73105-cec4-43b2-a85a-63b8203abaec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:00.017092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-99e73105-cec4-43b2-a85a-63b8203abaec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:00.026755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99e73105-cec4-43b2-a85a-63b8203abaec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:00.027205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99e73105-cec4-43b2-a85a-63b8203abaec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:00.028024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99e73105-cec4-43b2-a85a-63b8203abaec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:00.028465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99e73105-cec4-43b2-a85a-63b8203abaec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:00.176866 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-99e73105-cec4-43b2-a85a-63b8203abaec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:00.185935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-99e73105-cec4-43b2-a85a-63b8203abaec tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.176186 Jul 25 19:54:00.186527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1515/2868] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:00 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:54:01.207093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f5d81e33-0be7-4cfd-b027-82f9496263ac tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:01.207753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f5d81e33-0be7-4cfd-b027-82f9496263ac tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:01.214852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5d81e33-0be7-4cfd-b027-82f9496263ac tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:01.215312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5d81e33-0be7-4cfd-b027-82f9496263ac tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:01.216125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5d81e33-0be7-4cfd-b027-82f9496263ac tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:01.216566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5d81e33-0be7-4cfd-b027-82f9496263ac tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:01.353871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f5d81e33-0be7-4cfd-b027-82f9496263ac tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:01.362549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f5d81e33-0be7-4cfd-b027-82f9496263ac tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.159271 Jul 25 19:54:01.363124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1354/2869] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:01 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:02.385615 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-763c7304-9526-49f4-af0e-625d0b475103 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:02.386249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-763c7304-9526-49f4-af0e-625d0b475103 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:02.393025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-763c7304-9526-49f4-af0e-625d0b475103 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:02.393467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-763c7304-9526-49f4-af0e-625d0b475103 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:02.394237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-763c7304-9526-49f4-af0e-625d0b475103 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:02.394671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-763c7304-9526-49f4-af0e-625d0b475103 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:02.543274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-763c7304-9526-49f4-af0e-625d0b475103 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:02.551635 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-763c7304-9526-49f4-af0e-625d0b475103 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.170901 Jul 25 19:54:02.552221 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1516/2870] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:02 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:03.576809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ae9ef1c-abf6-4617-9875-238fc3ba6ba9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:03.577831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ae9ef1c-abf6-4617-9875-238fc3ba6ba9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:03.589027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ae9ef1c-abf6-4617-9875-238fc3ba6ba9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:03.589727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ae9ef1c-abf6-4617-9875-238fc3ba6ba9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:03.590968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ae9ef1c-abf6-4617-9875-238fc3ba6ba9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:03.591715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ae9ef1c-abf6-4617-9875-238fc3ba6ba9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:03.735347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ae9ef1c-abf6-4617-9875-238fc3ba6ba9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:03.744298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ae9ef1c-abf6-4617-9875-238fc3ba6ba9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.174604 Jul 25 19:54:03.744885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1355/2871] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:03 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:04.766992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e942ea14-3ccb-487c-82bd-83df2a3417eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:04.767666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e942ea14-3ccb-487c-82bd-83df2a3417eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:04.776284 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e942ea14-3ccb-487c-82bd-83df2a3417eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:04.776869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e942ea14-3ccb-487c-82bd-83df2a3417eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:04.777878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e942ea14-3ccb-487c-82bd-83df2a3417eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:04.778400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e942ea14-3ccb-487c-82bd-83df2a3417eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:04.962527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e942ea14-3ccb-487c-82bd-83df2a3417eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:04.971710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e942ea14-3ccb-487c-82bd-83df2a3417eb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.208456 Jul 25 19:54:04.972299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1517/2872] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:04 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:05.994378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-be0442c5-087c-4e03-957b-f5f99f039ed4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:05.995063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-be0442c5-087c-4e03-957b-f5f99f039ed4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:06.008566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be0442c5-087c-4e03-957b-f5f99f039ed4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:06.009310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be0442c5-087c-4e03-957b-f5f99f039ed4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:06.011214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be0442c5-087c-4e03-957b-f5f99f039ed4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:06.012221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be0442c5-087c-4e03-957b-f5f99f039ed4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:06.159885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-be0442c5-087c-4e03-957b-f5f99f039ed4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:06.168022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-be0442c5-087c-4e03-957b-f5f99f039ed4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.178081 Jul 25 19:54:06.168597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1356/2873] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:05 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:07.192161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7fa61679-7005-4ccc-9834-42e927de33ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:07.192840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7fa61679-7005-4ccc-9834-42e927de33ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:07.200394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fa61679-7005-4ccc-9834-42e927de33ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:07.200968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fa61679-7005-4ccc-9834-42e927de33ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:07.201820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fa61679-7005-4ccc-9834-42e927de33ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:07.202314 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fa61679-7005-4ccc-9834-42e927de33ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:07.205436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=78 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:54:07.387441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7fa61679-7005-4ccc-9834-42e927de33ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:07.395916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7fa61679-7005-4ccc-9834-42e927de33ea tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.209375 Jul 25 19:54:07.396508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1518/2874] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:07 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:08.419119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a5038679-f17d-4c5b-9ee8-8115db89e32e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:08.419821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a5038679-f17d-4c5b-9ee8-8115db89e32e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:08.426704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5038679-f17d-4c5b-9ee8-8115db89e32e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:08.427064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5038679-f17d-4c5b-9ee8-8115db89e32e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:08.427897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5038679-f17d-4c5b-9ee8-8115db89e32e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:08.428329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5038679-f17d-4c5b-9ee8-8115db89e32e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:08.573337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a5038679-f17d-4c5b-9ee8-8115db89e32e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:08.581675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a5038679-f17d-4c5b-9ee8-8115db89e32e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.166361 Jul 25 19:54:08.582250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1357/2875] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:08 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:09.606044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-117076c4-1a8e-422d-a338-5809ed139869 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:09.607005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-117076c4-1a8e-422d-a338-5809ed139869 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:09.614673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-117076c4-1a8e-422d-a338-5809ed139869 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:09.615173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-117076c4-1a8e-422d-a338-5809ed139869 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:09.616073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-117076c4-1a8e-422d-a338-5809ed139869 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:09.616552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-117076c4-1a8e-422d-a338-5809ed139869 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:09.779748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-117076c4-1a8e-422d-a338-5809ed139869 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:09.790471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-117076c4-1a8e-422d-a338-5809ed139869 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.188992 Jul 25 19:54:09.791258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1519/2876] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:09 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:10.912745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-25fc7de0-e451-4ed2-b8ce-b7301101c2e5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:10.914271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-25fc7de0-e451-4ed2-b8ce-b7301101c2e5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:10.924953 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25fc7de0-e451-4ed2-b8ce-b7301101c2e5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:10.925748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25fc7de0-e451-4ed2-b8ce-b7301101c2e5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:10.927130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25fc7de0-e451-4ed2-b8ce-b7301101c2e5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:10.927916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25fc7de0-e451-4ed2-b8ce-b7301101c2e5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:11.113158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-25fc7de0-e451-4ed2-b8ce-b7301101c2e5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:11.123412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-25fc7de0-e451-4ed2-b8ce-b7301101c2e5 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.311558 Jul 25 19:54:11.124033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1358/2877] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:10 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:12.146415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3c9ef13f-1270-427c-a693-a796c3d39daa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:12.147043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3c9ef13f-1270-427c-a693-a796c3d39daa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:12.156767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c9ef13f-1270-427c-a693-a796c3d39daa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:12.157556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c9ef13f-1270-427c-a693-a796c3d39daa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:12.158949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c9ef13f-1270-427c-a693-a796c3d39daa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:12.159780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c9ef13f-1270-427c-a693-a796c3d39daa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:12.328727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3c9ef13f-1270-427c-a693-a796c3d39daa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:12.341002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3c9ef13f-1270-427c-a693-a796c3d39daa tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.198299 Jul 25 19:54:12.341002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1520/2878] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:12 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:13.371368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74c830c6-96b8-4e81-aa7d-1b95cf3ca7bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:13.372097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-74c830c6-96b8-4e81-aa7d-1b95cf3ca7bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:13.380851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74c830c6-96b8-4e81-aa7d-1b95cf3ca7bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:13.381308 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74c830c6-96b8-4e81-aa7d-1b95cf3ca7bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:13.382213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74c830c6-96b8-4e81-aa7d-1b95cf3ca7bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:13.383943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74c830c6-96b8-4e81-aa7d-1b95cf3ca7bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:13.530662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-74c830c6-96b8-4e81-aa7d-1b95cf3ca7bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:13.539560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74c830c6-96b8-4e81-aa7d-1b95cf3ca7bb tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.171951 Jul 25 19:54:13.540322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1359/2879] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:13 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:14.569089 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5d92f4e2-6612-47c8-8be7-527b11ffbc80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:14.570253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5d92f4e2-6612-47c8-8be7-527b11ffbc80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:14.583792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d92f4e2-6612-47c8-8be7-527b11ffbc80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:14.583976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d92f4e2-6612-47c8-8be7-527b11ffbc80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:14.585347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d92f4e2-6612-47c8-8be7-527b11ffbc80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:14.587126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d92f4e2-6612-47c8-8be7-527b11ffbc80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:14.589732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-093dc676-5f5d-4855-b73a-5cd2e84a9a87 req-faca42ef-4807-4f41-ba8e-0f6b8f0df959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1007369a-dd3c-4837-95f4-e8326d600031", "name": "network-vif-deleted", "tag": "33faefb9-12a5-4e86-b189-357d316c5553"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:54:14.599834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-093dc676-5f5d-4855-b73a-5cd2e84a9a87 req-faca42ef-4807-4f41-ba8e-0f6b8f0df959 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:14.600279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-093dc676-5f5d-4855-b73a-5cd2e84a9a87 req-faca42ef-4807-4f41-ba8e-0f6b8f0df959 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:14.614201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-093dc676-5f5d-4855-b73a-5cd2e84a9a87 req-faca42ef-4807-4f41-ba8e-0f6b8f0df959 service nova] Creating event network-vif-deleted:33faefb9-12a5-4e86-b189-357d316c5553 for instance 1007369a-dd3c-4837-95f4-e8326d600031 on hv-cinder-85093 Jul 25 19:54:14.620266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-093dc676-5f5d-4855-b73a-5cd2e84a9a87 req-faca42ef-4807-4f41-ba8e-0f6b8f0df959 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106952 Jul 25 19:54:14.621477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1521/2880] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:54:14.759487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5d92f4e2-6612-47c8-8be7-527b11ffbc80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:14.772530 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5d92f4e2-6612-47c8-8be7-527b11ffbc80 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.212499 Jul 25 19:54:14.773853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1360/2881] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:14 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:15.794742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3e67a509-eb8d-467a-bc7e-e00d4b4b7849 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:15.795434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3e67a509-eb8d-467a-bc7e-e00d4b4b7849 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:15.802184 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3e67a509-eb8d-467a-bc7e-e00d4b4b7849 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:15.802625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3e67a509-eb8d-467a-bc7e-e00d4b4b7849 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:15.803381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3e67a509-eb8d-467a-bc7e-e00d4b4b7849 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:15.803833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3e67a509-eb8d-467a-bc7e-e00d4b4b7849 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:15.936453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3e67a509-eb8d-467a-bc7e-e00d4b4b7849 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:15.944531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3e67a509-eb8d-467a-bc7e-e00d4b4b7849 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.153822 Jul 25 19:54:15.945805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1522/2882] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:15 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:16.966947 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c455905c-fa77-4fef-9c05-0544280c51a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:16.967655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c455905c-fa77-4fef-9c05-0544280c51a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:16.974964 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c455905c-fa77-4fef-9c05-0544280c51a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:16.975412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c455905c-fa77-4fef-9c05-0544280c51a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:16.976702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c455905c-fa77-4fef-9c05-0544280c51a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:16.977233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c455905c-fa77-4fef-9c05-0544280c51a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:17.149868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c455905c-fa77-4fef-9c05-0544280c51a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:17.158166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c455905c-fa77-4fef-9c05-0544280c51a9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.194916 Jul 25 19:54:17.158671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1361/2883] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:16 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:18.180723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2e77ce60-c528-4edc-a66d-af4aea8b2651 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:18.181323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2e77ce60-c528-4edc-a66d-af4aea8b2651 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:18.187915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e77ce60-c528-4edc-a66d-af4aea8b2651 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:18.188299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e77ce60-c528-4edc-a66d-af4aea8b2651 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:18.189050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e77ce60-c528-4edc-a66d-af4aea8b2651 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:18.189482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e77ce60-c528-4edc-a66d-af4aea8b2651 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:18.323025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2e77ce60-c528-4edc-a66d-af4aea8b2651 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:18.333177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2e77ce60-c528-4edc-a66d-af4aea8b2651 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.156416 Jul 25 19:54:18.333775 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1523/2884] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:18 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:19.358488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-11593612-b66c-4ec2-8ef4-a01c5b4f0062 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:19.359102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-11593612-b66c-4ec2-8ef4-a01c5b4f0062 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:19.365979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11593612-b66c-4ec2-8ef4-a01c5b4f0062 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:19.366429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11593612-b66c-4ec2-8ef4-a01c5b4f0062 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:19.367343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11593612-b66c-4ec2-8ef4-a01c5b4f0062 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:19.367814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11593612-b66c-4ec2-8ef4-a01c5b4f0062 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:19.370615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:54:19.506068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-11593612-b66c-4ec2-8ef4-a01c5b4f0062 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:19.515552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-11593612-b66c-4ec2-8ef4-a01c5b4f0062 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.160916 Jul 25 19:54:19.516119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1362/2885] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:19 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:20.538463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f2cb8928-5ee6-42d1-9349-26701cc8ebdf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:20.539230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f2cb8928-5ee6-42d1-9349-26701cc8ebdf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:20.546106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2cb8928-5ee6-42d1-9349-26701cc8ebdf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:20.546563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2cb8928-5ee6-42d1-9349-26701cc8ebdf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:20.547346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2cb8928-5ee6-42d1-9349-26701cc8ebdf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:20.547819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f2cb8928-5ee6-42d1-9349-26701cc8ebdf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:20.706472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f2cb8928-5ee6-42d1-9349-26701cc8ebdf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:20.715785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f2cb8928-5ee6-42d1-9349-26701cc8ebdf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.181197 Jul 25 19:54:20.716385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1524/2886] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:20 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:21.739467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a61ce55b-4875-4a15-af7c-3b6c8381f07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:21.740404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a61ce55b-4875-4a15-af7c-3b6c8381f07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:21.748605 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a61ce55b-4875-4a15-af7c-3b6c8381f07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:21.749060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a61ce55b-4875-4a15-af7c-3b6c8381f07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:21.749861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a61ce55b-4875-4a15-af7c-3b6c8381f07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:21.750306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a61ce55b-4875-4a15-af7c-3b6c8381f07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:21.900642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a61ce55b-4875-4a15-af7c-3b6c8381f07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:21.909413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a61ce55b-4875-4a15-af7c-3b6c8381f07b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.174089 Jul 25 19:54:21.909992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1363/2887] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:21 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:54:22.946218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e1535552-f36b-482e-a975-734addc17a95 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:22.947792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e1535552-f36b-482e-a975-734addc17a95 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:22.950781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=26 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:54:22.961840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1535552-f36b-482e-a975-734addc17a95 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:22.962581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1535552-f36b-482e-a975-734addc17a95 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:22.963927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1535552-f36b-482e-a975-734addc17a95 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:22.964631 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1535552-f36b-482e-a975-734addc17a95 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:23.117375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e1535552-f36b-482e-a975-734addc17a95 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:23.126295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e1535552-f36b-482e-a975-734addc17a95 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.185192 Jul 25 19:54:23.126914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1525/2888] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:22 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:24.151703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e989d4d-e9c8-4a4d-8677-f9b39a99ad25 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:24.153475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6e989d4d-e9c8-4a4d-8677-f9b39a99ad25 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:24.156763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:54:24.165195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e989d4d-e9c8-4a4d-8677-f9b39a99ad25 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:24.165662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e989d4d-e9c8-4a4d-8677-f9b39a99ad25 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:24.166843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e989d4d-e9c8-4a4d-8677-f9b39a99ad25 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:24.167708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e989d4d-e9c8-4a4d-8677-f9b39a99ad25 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:24.332207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6e989d4d-e9c8-4a4d-8677-f9b39a99ad25 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:24.341068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6e989d4d-e9c8-4a4d-8677-f9b39a99ad25 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.196164 Jul 25 19:54:24.341660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1364/2889] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:24 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:25.362681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bfb5a54e-abdb-4da2-ab1e-c0f5441603b2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:25.363561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bfb5a54e-abdb-4da2-ab1e-c0f5441603b2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:25.371226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bfb5a54e-abdb-4da2-ab1e-c0f5441603b2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:25.371712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bfb5a54e-abdb-4da2-ab1e-c0f5441603b2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:25.372484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bfb5a54e-abdb-4da2-ab1e-c0f5441603b2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:25.372915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bfb5a54e-abdb-4da2-ab1e-c0f5441603b2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:25.543769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bfb5a54e-abdb-4da2-ab1e-c0f5441603b2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:25.552649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bfb5a54e-abdb-4da2-ab1e-c0f5441603b2 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.193876 Jul 25 19:54:25.553253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1526/2890] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:25 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:26.575919 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6fad7c98-8120-4ee7-ad24-5e8a698b3d5e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:26.576722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6fad7c98-8120-4ee7-ad24-5e8a698b3d5e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:26.586399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6fad7c98-8120-4ee7-ad24-5e8a698b3d5e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:26.587265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6fad7c98-8120-4ee7-ad24-5e8a698b3d5e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:26.588947 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6fad7c98-8120-4ee7-ad24-5e8a698b3d5e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:26.589280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6fad7c98-8120-4ee7-ad24-5e8a698b3d5e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:26.777550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6fad7c98-8120-4ee7-ad24-5e8a698b3d5e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:26.786192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6fad7c98-8120-4ee7-ad24-5e8a698b3d5e tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.214671 Jul 25 19:54:26.786791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1365/2891] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:26 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:54:27.808242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3f33f605-1638-43d5-9f4a-48ea3680a0a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:27.808902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3f33f605-1638-43d5-9f4a-48ea3680a0a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:27.816203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f33f605-1638-43d5-9f4a-48ea3680a0a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:27.816655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f33f605-1638-43d5-9f4a-48ea3680a0a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:27.817512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f33f605-1638-43d5-9f4a-48ea3680a0a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:27.817954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f33f605-1638-43d5-9f4a-48ea3680a0a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:28.008927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3f33f605-1638-43d5-9f4a-48ea3680a0a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:28.017656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3f33f605-1638-43d5-9f4a-48ea3680a0a8 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.213375 Jul 25 19:54:28.018256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1527/2892] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:27 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:29.041816 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-679fd02b-aceb-44de-a929-6a82d4cb11f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:29.042679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-679fd02b-aceb-44de-a929-6a82d4cb11f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:29.052069 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-679fd02b-aceb-44de-a929-6a82d4cb11f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:29.052670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-679fd02b-aceb-44de-a929-6a82d4cb11f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:29.053750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-679fd02b-aceb-44de-a929-6a82d4cb11f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:29.054398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-679fd02b-aceb-44de-a929-6a82d4cb11f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:29.205976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-679fd02b-aceb-44de-a929-6a82d4cb11f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:29.216486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-679fd02b-aceb-44de-a929-6a82d4cb11f0 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.181061 Jul 25 19:54:29.217164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1366/2893] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:29 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:30.238470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e864cb24-7674-4a41-84fd-773bbb63920c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:30.239876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e864cb24-7674-4a41-84fd-773bbb63920c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:30.247023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e864cb24-7674-4a41-84fd-773bbb63920c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:30.247468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e864cb24-7674-4a41-84fd-773bbb63920c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:30.248275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e864cb24-7674-4a41-84fd-773bbb63920c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:30.248703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e864cb24-7674-4a41-84fd-773bbb63920c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:30.413000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e864cb24-7674-4a41-84fd-773bbb63920c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:30.422040 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e864cb24-7674-4a41-84fd-773bbb63920c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.187336 Jul 25 19:54:30.422539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1528/2894] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:30 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:31.443136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05a32aef-7845-40b6-aab8-8cb4ec9cf25b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:31.443749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05a32aef-7845-40b6-aab8-8cb4ec9cf25b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:31.451503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05a32aef-7845-40b6-aab8-8cb4ec9cf25b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:31.451974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05a32aef-7845-40b6-aab8-8cb4ec9cf25b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:31.452742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05a32aef-7845-40b6-aab8-8cb4ec9cf25b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:31.453185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05a32aef-7845-40b6-aab8-8cb4ec9cf25b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:31.593708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05a32aef-7845-40b6-aab8-8cb4ec9cf25b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:31.603406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05a32aef-7845-40b6-aab8-8cb4ec9cf25b tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.164223 Jul 25 19:54:31.604031 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1367/2895] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:31 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:32.626663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2e51966e-2185-46f2-b988-45f1fb614811 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:32.627593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2e51966e-2185-46f2-b988-45f1fb614811 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:32.634802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e51966e-2185-46f2-b988-45f1fb614811 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:32.635247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e51966e-2185-46f2-b988-45f1fb614811 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:32.636067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e51966e-2185-46f2-b988-45f1fb614811 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:32.636501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2e51966e-2185-46f2-b988-45f1fb614811 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:32.793217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-2e51966e-2185-46f2-b988-45f1fb614811 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:32.801470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2e51966e-2185-46f2-b988-45f1fb614811 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.178727 Jul 25 19:54:32.802036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1529/2896] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:32 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:33.824533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9422c1c0-5a48-4e08-b27b-5a3ab3eaf114 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:33.825200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9422c1c0-5a48-4e08-b27b-5a3ab3eaf114 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:33.831769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9422c1c0-5a48-4e08-b27b-5a3ab3eaf114 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:33.832221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9422c1c0-5a48-4e08-b27b-5a3ab3eaf114 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:33.833028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9422c1c0-5a48-4e08-b27b-5a3ab3eaf114 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:33.833468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9422c1c0-5a48-4e08-b27b-5a3ab3eaf114 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:33.973672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9422c1c0-5a48-4e08-b27b-5a3ab3eaf114 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:33.982920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9422c1c0-5a48-4e08-b27b-5a3ab3eaf114 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.163168 Jul 25 19:54:33.983503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1368/2897] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:33 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:35.006341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-38428da9-26cf-42f6-a13a-bdf64bb0d262 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:35.007039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-38428da9-26cf-42f6-a13a-bdf64bb0d262 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:35.016953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38428da9-26cf-42f6-a13a-bdf64bb0d262 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:35.017649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38428da9-26cf-42f6-a13a-bdf64bb0d262 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:35.018786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38428da9-26cf-42f6-a13a-bdf64bb0d262 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:35.019278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-38428da9-26cf-42f6-a13a-bdf64bb0d262 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:35.251414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-38428da9-26cf-42f6-a13a-bdf64bb0d262 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:35.262011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-38428da9-26cf-42f6-a13a-bdf64bb0d262 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.259963 Jul 25 19:54:35.262821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1530/2898] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:35 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:36.290522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4fcfcdd5-5368-42c3-8c71-43f965c0477a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:36.291309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4fcfcdd5-5368-42c3-8c71-43f965c0477a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:36.302334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4fcfcdd5-5368-42c3-8c71-43f965c0477a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:36.303165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4fcfcdd5-5368-42c3-8c71-43f965c0477a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:36.308799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4fcfcdd5-5368-42c3-8c71-43f965c0477a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:36.308799 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4fcfcdd5-5368-42c3-8c71-43f965c0477a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:36.532720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4fcfcdd5-5368-42c3-8c71-43f965c0477a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:36.544241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4fcfcdd5-5368-42c3-8c71-43f965c0477a tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.260427 Jul 25 19:54:36.544973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1369/2899] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:36 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:37.574667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-86c4f3c3-fa74-4f64-a445-8b2dc6219a12 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:37.575579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-86c4f3c3-fa74-4f64-a445-8b2dc6219a12 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:37.582937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86c4f3c3-fa74-4f64-a445-8b2dc6219a12 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:37.583475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86c4f3c3-fa74-4f64-a445-8b2dc6219a12 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:37.584478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86c4f3c3-fa74-4f64-a445-8b2dc6219a12 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:37.585693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-86c4f3c3-fa74-4f64-a445-8b2dc6219a12 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:37.589322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=74 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:54:37.876391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-86c4f3c3-fa74-4f64-a445-8b2dc6219a12 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:37.892607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-86c4f3c3-fa74-4f64-a445-8b2dc6219a12 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.322433 Jul 25 19:54:37.893579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1531/2900] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:37 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:38.927526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-37fdd3cf-06ea-4ca6-bb7c-d699a6b66b01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:38.928228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-37fdd3cf-06ea-4ca6-bb7c-d699a6b66b01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:38.937433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37fdd3cf-06ea-4ca6-bb7c-d699a6b66b01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:38.938065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37fdd3cf-06ea-4ca6-bb7c-d699a6b66b01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:38.938982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37fdd3cf-06ea-4ca6-bb7c-d699a6b66b01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:38.939468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37fdd3cf-06ea-4ca6-bb7c-d699a6b66b01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:39.126451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37fdd3cf-06ea-4ca6-bb7c-d699a6b66b01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:39.136750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-37fdd3cf-06ea-4ca6-bb7c-d699a6b66b01 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.213037 Jul 25 19:54:39.137435 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1370/2901] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:38 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:40.159073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0e220bb1-c630-4f17-9ef2-d04395d1c87c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:40.159743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0e220bb1-c630-4f17-9ef2-d04395d1c87c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:40.169120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e220bb1-c630-4f17-9ef2-d04395d1c87c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:40.169646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e220bb1-c630-4f17-9ef2-d04395d1c87c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:40.170576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e220bb1-c630-4f17-9ef2-d04395d1c87c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:40.171163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e220bb1-c630-4f17-9ef2-d04395d1c87c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:40.354865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0e220bb1-c630-4f17-9ef2-d04395d1c87c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:40.364178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0e220bb1-c630-4f17-9ef2-d04395d1c87c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.208647 Jul 25 19:54:40.364811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1532/2902] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:40 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:41.393581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dbd570c6-bcac-41e5-a3ae-ebb1b274eca4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:41.394224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dbd570c6-bcac-41e5-a3ae-ebb1b274eca4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:41.403825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbd570c6-bcac-41e5-a3ae-ebb1b274eca4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:41.404565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbd570c6-bcac-41e5-a3ae-ebb1b274eca4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:41.406008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbd570c6-bcac-41e5-a3ae-ebb1b274eca4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:41.406774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbd570c6-bcac-41e5-a3ae-ebb1b274eca4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:41.633889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dbd570c6-bcac-41e5-a3ae-ebb1b274eca4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:41.642739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dbd570c6-bcac-41e5-a3ae-ebb1b274eca4 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.254881 Jul 25 19:54:41.643336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1371/2903] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:41 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:42.672977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-05634894-7362-4e79-aaad-99833fbf0ebf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:42.673791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-05634894-7362-4e79-aaad-99833fbf0ebf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:42.681704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05634894-7362-4e79-aaad-99833fbf0ebf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:42.682157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05634894-7362-4e79-aaad-99833fbf0ebf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:42.682987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05634894-7362-4e79-aaad-99833fbf0ebf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:42.683422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05634894-7362-4e79-aaad-99833fbf0ebf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:42.830652 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-05634894-7362-4e79-aaad-99833fbf0ebf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:42.839441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-05634894-7362-4e79-aaad-99833fbf0ebf tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.170352 Jul 25 19:54:42.840052 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1533/2904] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:42 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:43.861862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e2e2127-2cb4-4b73-ac14-9d193911647c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:43.862502 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e2e2127-2cb4-4b73-ac14-9d193911647c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:43.871342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2e2127-2cb4-4b73-ac14-9d193911647c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:43.871979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2e2127-2cb4-4b73-ac14-9d193911647c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:43.872892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2e2127-2cb4-4b73-ac14-9d193911647c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:43.873432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2e2127-2cb4-4b73-ac14-9d193911647c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:44.027943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7e2e2127-2cb4-4b73-ac14-9d193911647c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:44.043229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e2e2127-2cb4-4b73-ac14-9d193911647c tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.184922 Jul 25 19:54:44.044334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1372/2905] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:43 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:45.067968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5a0eb843-e77a-461a-afe7-2270487f82f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:45.068581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5a0eb843-e77a-461a-afe7-2270487f82f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:45.076611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a0eb843-e77a-461a-afe7-2270487f82f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:45.076963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a0eb843-e77a-461a-afe7-2270487f82f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:45.077754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a0eb843-e77a-461a-afe7-2270487f82f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:45.078197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a0eb843-e77a-461a-afe7-2270487f82f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:45.262517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5a0eb843-e77a-461a-afe7-2270487f82f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:45.271341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5a0eb843-e77a-461a-afe7-2270487f82f9 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.207315 Jul 25 19:54:45.271994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1534/2906] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:45 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:54:45.653158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:54:45.653455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:54:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:54:46.294630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a176466b-e12a-4bcc-907d-f925ba0eebcc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:46.295277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a176466b-e12a-4bcc-907d-f925ba0eebcc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:46.302710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a176466b-e12a-4bcc-907d-f925ba0eebcc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:46.303156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a176466b-e12a-4bcc-907d-f925ba0eebcc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:46.304418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a176466b-e12a-4bcc-907d-f925ba0eebcc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:46.304974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a176466b-e12a-4bcc-907d-f925ba0eebcc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:46.549286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a176466b-e12a-4bcc-907d-f925ba0eebcc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:46.565164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a176466b-e12a-4bcc-907d-f925ba0eebcc tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.273981 Jul 25 19:54:46.566269 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1373/2907] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:46 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:54:47.601447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-203bd609-dfa5-4a58-80fc-a92718b2e384 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:47.602417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-203bd609-dfa5-4a58-80fc-a92718b2e384 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:47.609306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-203bd609-dfa5-4a58-80fc-a92718b2e384 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:47.609745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-203bd609-dfa5-4a58-80fc-a92718b2e384 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:47.610519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-203bd609-dfa5-4a58-80fc-a92718b2e384 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:47.610979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-203bd609-dfa5-4a58-80fc-a92718b2e384 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:47.793538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-203bd609-dfa5-4a58-80fc-a92718b2e384 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:47.808487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-203bd609-dfa5-4a58-80fc-a92718b2e384 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.211592 Jul 25 19:54:47.809522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1535/2908] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:47 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:48.846099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb15cc5f-d97f-4655-a23b-a7c6bfcdaf22 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:48.847192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb15cc5f-d97f-4655-a23b-a7c6bfcdaf22 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:48.858984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb15cc5f-d97f-4655-a23b-a7c6bfcdaf22 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:48.859813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb15cc5f-d97f-4655-a23b-a7c6bfcdaf22 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:48.861183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb15cc5f-d97f-4655-a23b-a7c6bfcdaf22 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:48.861946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb15cc5f-d97f-4655-a23b-a7c6bfcdaf22 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:49.062604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb15cc5f-d97f-4655-a23b-a7c6bfcdaf22 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:49.071157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb15cc5f-d97f-4655-a23b-a7c6bfcdaf22 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.232193 Jul 25 19:54:49.071782 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1374/2909] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:48 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:50.096695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a814d048-0c29-4642-9648-0a49584fca86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:50.097872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a814d048-0c29-4642-9648-0a49584fca86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:50.107271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a814d048-0c29-4642-9648-0a49584fca86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:50.107898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a814d048-0c29-4642-9648-0a49584fca86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:50.108920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a814d048-0c29-4642-9648-0a49584fca86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:50.109458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a814d048-0c29-4642-9648-0a49584fca86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:50.342070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a814d048-0c29-4642-9648-0a49584fca86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:50.352617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a814d048-0c29-4642-9648-0a49584fca86 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.262023 Jul 25 19:54:50.353123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1536/2910] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:50 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:51.378003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2389047f-b14f-4277-9efa-e3adb6dc15f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:51.378932 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2389047f-b14f-4277-9efa-e3adb6dc15f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:51.390678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2389047f-b14f-4277-9efa-e3adb6dc15f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:51.391344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2389047f-b14f-4277-9efa-e3adb6dc15f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:51.392579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2389047f-b14f-4277-9efa-e3adb6dc15f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:51.393221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2389047f-b14f-4277-9efa-e3adb6dc15f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:51.398591 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:54:51.622686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2389047f-b14f-4277-9efa-e3adb6dc15f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:51.638185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2389047f-b14f-4277-9efa-e3adb6dc15f6 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.266032 Jul 25 19:54:51.639202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1375/2911] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:51 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:52.679068 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0a0095e2-3ce7-4c2e-a25d-8bab2ab1ab13 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:52.680137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0a0095e2-3ce7-4c2e-a25d-8bab2ab1ab13 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] [instance: d238c56a-d3fb-4eaa-abb6-4f9155523e90] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:54:52.692959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a0095e2-3ce7-4c2e-a25d-8bab2ab1ab13 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:52.693560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a0095e2-3ce7-4c2e-a25d-8bab2ab1ab13 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:52.694597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a0095e2-3ce7-4c2e-a25d-8bab2ab1ab13 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:54:52.695151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a0095e2-3ce7-4c2e-a25d-8bab2ab1ab13 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:54:52.929297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0a0095e2-3ce7-4c2e-a25d-8bab2ab1ab13 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324738dd872e445ba845a101f45fa595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cfdd0ba7de4e46a17d4c0d698159cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:54:52.942396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0a0095e2-3ce7-4c2e-a25d-8bab2ab1ab13 tempest-VolumesSnapshotTestJSON-1012759034 tempest-VolumesSnapshotTestJSON-1012759034-project] 10.222.0.18 "GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90" status: 200 len: 1556 microversion: 2.1 time: 0.273481 Jul 25 19:54:52.943438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1537/2912] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:54:52 2022] GET /compute/v2.1/servers/d238c56a-d3fb-4eaa-abb6-4f9155523e90 => generated 1556 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:02.941202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:56:02.942065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:56:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:56:14.738695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-89a3533e-5e44-43f1-bf64-ea1b94aff9d3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:14.739872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-89a3533e-5e44-43f1-bf64-ea1b94aff9d3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:14.741954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=23 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:56:14.742614 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=5 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:56:14.749018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89a3533e-5e44-43f1-bf64-ea1b94aff9d3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:14.750001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89a3533e-5e44-43f1-bf64-ea1b94aff9d3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:14.750918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89a3533e-5e44-43f1-bf64-ea1b94aff9d3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:14.751370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89a3533e-5e44-43f1-bf64-ea1b94aff9d3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:14.786090 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-89a3533e-5e44-43f1-bf64-ea1b94aff9d3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:56:14.874343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-89a3533e-5e44-43f1-bf64-ea1b94aff9d3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 204 len: 0 microversion: 2.1 time: 0.141189 Jul 25 19:56:14.874930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1376/2913] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:56:14 2022] DELETE /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:56:14.882283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=25 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:56:14.883047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=41 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:56:14.886962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a1216ba3-5c98-4187-9ccc-8360597843f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:14.887626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a1216ba3-5c98-4187-9ccc-8360597843f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:14.894514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1216ba3-5c98-4187-9ccc-8360597843f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:14.895759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1216ba3-5c98-4187-9ccc-8360597843f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:14.896853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1216ba3-5c98-4187-9ccc-8360597843f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:14.897295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a1216ba3-5c98-4187-9ccc-8360597843f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:15.259258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a1216ba3-5c98-4187-9ccc-8360597843f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:15.268671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a1216ba3-5c98-4187-9ccc-8360597843f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.387425 Jul 25 19:56:15.268671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1538/2914] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:14 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:16.289421 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c0a79102-d388-4559-bdf6-29df4db94450 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:16.290157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c0a79102-d388-4559-bdf6-29df4db94450 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:16.297127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0a79102-d388-4559-bdf6-29df4db94450 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:16.297583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0a79102-d388-4559-bdf6-29df4db94450 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:16.298378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0a79102-d388-4559-bdf6-29df4db94450 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:16.298821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0a79102-d388-4559-bdf6-29df4db94450 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:16.503198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c0a79102-d388-4559-bdf6-29df4db94450 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:16.512196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c0a79102-d388-4559-bdf6-29df4db94450 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.226941 Jul 25 19:56:16.512774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1377/2915] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:16 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:17.531817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9ce3868-c733-42b7-81b3-e48191fea9eb] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 19:56:17.535311 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b9e7142e-7dc5-4886-b1df-d5766c262817 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:17.536482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b9e7142e-7dc5-4886-b1df-d5766c262817 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:17.542720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9e7142e-7dc5-4886-b1df-d5766c262817 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:17.543160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9e7142e-7dc5-4886-b1df-d5766c262817 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:17.543950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9e7142e-7dc5-4886-b1df-d5766c262817 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:17.544380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9e7142e-7dc5-4886-b1df-d5766c262817 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:17.690089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b9e7142e-7dc5-4886-b1df-d5766c262817 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:17.699136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b9e7142e-7dc5-4886-b1df-d5766c262817 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.168672 Jul 25 19:56:17.699763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1539/2916] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:17 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:18.721930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-addcad83-30ea-419f-993c-261bb3fca290 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:18.722536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-addcad83-30ea-419f-993c-261bb3fca290 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:18.730406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-addcad83-30ea-419f-993c-261bb3fca290 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:18.730852 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-addcad83-30ea-419f-993c-261bb3fca290 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:18.731655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-addcad83-30ea-419f-993c-261bb3fca290 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:18.732103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-addcad83-30ea-419f-993c-261bb3fca290 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:18.873992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-addcad83-30ea-419f-993c-261bb3fca290 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:18.883300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-addcad83-30ea-419f-993c-261bb3fca290 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.165248 Jul 25 19:56:18.883917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1378/2917] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:18 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:19.905972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e493bfd3-6d91-431d-935e-c874a7123a4c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:19.906743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e493bfd3-6d91-431d-935e-c874a7123a4c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:19.914917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e493bfd3-6d91-431d-935e-c874a7123a4c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:19.915364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e493bfd3-6d91-431d-935e-c874a7123a4c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:19.916146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e493bfd3-6d91-431d-935e-c874a7123a4c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:19.916784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e493bfd3-6d91-431d-935e-c874a7123a4c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:19.922420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9ce3868-c733-42b7-81b3-e48191fea9eb] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41564. Jul 25 19:56:20.053810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e493bfd3-6d91-431d-935e-c874a7123a4c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:20.061879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e493bfd3-6d91-431d-935e-c874a7123a4c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.159785 Jul 25 19:56:20.062452 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1540/2918] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:19 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:21.084158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7f5cbaad-4b40-4462-b02a-e7b0252e4521 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:21.084791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7f5cbaad-4b40-4462-b02a-e7b0252e4521 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:21.091240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f5cbaad-4b40-4462-b02a-e7b0252e4521 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:21.091729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f5cbaad-4b40-4462-b02a-e7b0252e4521 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:21.092529 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f5cbaad-4b40-4462-b02a-e7b0252e4521 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:21.092976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f5cbaad-4b40-4462-b02a-e7b0252e4521 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:21.241833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f5cbaad-4b40-4462-b02a-e7b0252e4521 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:21.250280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7f5cbaad-4b40-4462-b02a-e7b0252e4521 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.170537 Jul 25 19:56:21.250846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1379/2919] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:21 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:22.273414 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a6978a94-d567-4d1b-a8ff-5662ec5ccbe1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:22.274026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a6978a94-d567-4d1b-a8ff-5662ec5ccbe1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:22.280691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a6978a94-d567-4d1b-a8ff-5662ec5ccbe1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:22.281143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a6978a94-d567-4d1b-a8ff-5662ec5ccbe1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:22.281920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a6978a94-d567-4d1b-a8ff-5662ec5ccbe1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:22.282360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a6978a94-d567-4d1b-a8ff-5662ec5ccbe1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:22.416693 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a6978a94-d567-4d1b-a8ff-5662ec5ccbe1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:22.425814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a6978a94-d567-4d1b-a8ff-5662ec5ccbe1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.156948 Jul 25 19:56:22.426400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1541/2920] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:22 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:23.448836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df398295-758d-47ba-ba62-6969355c7412 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:23.449634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-df398295-758d-47ba-ba62-6969355c7412 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:23.456656 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df398295-758d-47ba-ba62-6969355c7412 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:23.457145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df398295-758d-47ba-ba62-6969355c7412 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:23.457952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df398295-758d-47ba-ba62-6969355c7412 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:23.458423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df398295-758d-47ba-ba62-6969355c7412 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:23.613916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df398295-758d-47ba-ba62-6969355c7412 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:23.625205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df398295-758d-47ba-ba62-6969355c7412 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.181143 Jul 25 19:56:23.625962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1380/2921] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:23 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:24.648918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9e82d03c-a2e4-4a4d-9234-6f10a209bf06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:24.649656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9e82d03c-a2e4-4a4d-9234-6f10a209bf06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:24.656214 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e82d03c-a2e4-4a4d-9234-6f10a209bf06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:24.656648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e82d03c-a2e4-4a4d-9234-6f10a209bf06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:24.657415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e82d03c-a2e4-4a4d-9234-6f10a209bf06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:24.657846 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e82d03c-a2e4-4a4d-9234-6f10a209bf06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:24.815376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9e82d03c-a2e4-4a4d-9234-6f10a209bf06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:24.827458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9e82d03c-a2e4-4a4d-9234-6f10a209bf06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.182364 Jul 25 19:56:24.828146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1542/2922] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:24 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:25.851056 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0e7e63b1-eb8e-4f8b-a1e0-47ce266110a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:25.851882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0e7e63b1-eb8e-4f8b-a1e0-47ce266110a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:25.860389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e7e63b1-eb8e-4f8b-a1e0-47ce266110a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:25.860842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e7e63b1-eb8e-4f8b-a1e0-47ce266110a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:25.861619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e7e63b1-eb8e-4f8b-a1e0-47ce266110a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:25.862064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e7e63b1-eb8e-4f8b-a1e0-47ce266110a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:26.015616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0e7e63b1-eb8e-4f8b-a1e0-47ce266110a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:26.024368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0e7e63b1-eb8e-4f8b-a1e0-47ce266110a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.177875 Jul 25 19:56:26.024952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1381/2923] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:25 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:56:27.048691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f168fb15-b281-44fe-a49a-ce6abe3e0407 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:27.049641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f168fb15-b281-44fe-a49a-ce6abe3e0407 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:27.058228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f168fb15-b281-44fe-a49a-ce6abe3e0407 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:27.058681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f168fb15-b281-44fe-a49a-ce6abe3e0407 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:27.059471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f168fb15-b281-44fe-a49a-ce6abe3e0407 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:27.059949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f168fb15-b281-44fe-a49a-ce6abe3e0407 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:27.240446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f168fb15-b281-44fe-a49a-ce6abe3e0407 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:27.250598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f168fb15-b281-44fe-a49a-ce6abe3e0407 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.206836 Jul 25 19:56:27.251081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1543/2924] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:27 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:28.277070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-574f979f-5a99-4d40-a628-e368e4859f67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:28.277683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-574f979f-5a99-4d40-a628-e368e4859f67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:28.284493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-574f979f-5a99-4d40-a628-e368e4859f67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:28.284958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-574f979f-5a99-4d40-a628-e368e4859f67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:28.285725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-574f979f-5a99-4d40-a628-e368e4859f67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:28.286162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-574f979f-5a99-4d40-a628-e368e4859f67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:28.421576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-574f979f-5a99-4d40-a628-e368e4859f67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:28.430526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-574f979f-5a99-4d40-a628-e368e4859f67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.157235 Jul 25 19:56:28.431107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1382/2925] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:28 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:56:29.454097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-84e858ea-6c15-455c-8dd5-39370dea3e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:29.455017 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-84e858ea-6c15-455c-8dd5-39370dea3e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:29.465530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84e858ea-6c15-455c-8dd5-39370dea3e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:29.466251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84e858ea-6c15-455c-8dd5-39370dea3e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:29.467575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84e858ea-6c15-455c-8dd5-39370dea3e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:29.468294 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84e858ea-6c15-455c-8dd5-39370dea3e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:29.641683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-84e858ea-6c15-455c-8dd5-39370dea3e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:29.650819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-84e858ea-6c15-455c-8dd5-39370dea3e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.200589 Jul 25 19:56:29.651399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1544/2926] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:29 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:30.674600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-876ced80-bec7-4ca7-89ad-a52c65aabdff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:30.675686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-876ced80-bec7-4ca7-89ad-a52c65aabdff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:30.684441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-876ced80-bec7-4ca7-89ad-a52c65aabdff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:30.684882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-876ced80-bec7-4ca7-89ad-a52c65aabdff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:30.686040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-876ced80-bec7-4ca7-89ad-a52c65aabdff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:30.686527 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-876ced80-bec7-4ca7-89ad-a52c65aabdff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:30.864292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-876ced80-bec7-4ca7-89ad-a52c65aabdff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:30.875059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-876ced80-bec7-4ca7-89ad-a52c65aabdff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.204188 Jul 25 19:56:30.875817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1383/2927] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:30 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:31.900249 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-721da5af-5e6e-4112-9c8c-4ea840589ec2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:31.901201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-721da5af-5e6e-4112-9c8c-4ea840589ec2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:31.913372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-721da5af-5e6e-4112-9c8c-4ea840589ec2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:31.913825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-721da5af-5e6e-4112-9c8c-4ea840589ec2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:31.914639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-721da5af-5e6e-4112-9c8c-4ea840589ec2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:31.915067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-721da5af-5e6e-4112-9c8c-4ea840589ec2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:32.087137 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-721da5af-5e6e-4112-9c8c-4ea840589ec2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:32.095834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-721da5af-5e6e-4112-9c8c-4ea840589ec2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.201084 Jul 25 19:56:32.096427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1545/2928] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:31 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:33.128612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-166c8148-a509-4856-972d-71d86ac9f212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:33.129385 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-166c8148-a509-4856-972d-71d86ac9f212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:33.136858 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-166c8148-a509-4856-972d-71d86ac9f212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:33.137345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-166c8148-a509-4856-972d-71d86ac9f212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:33.138131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-166c8148-a509-4856-972d-71d86ac9f212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:33.138573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-166c8148-a509-4856-972d-71d86ac9f212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:33.302212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-166c8148-a509-4856-972d-71d86ac9f212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:33.313647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-166c8148-a509-4856-972d-71d86ac9f212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.188530 Jul 25 19:56:33.314644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1384/2929] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:33 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:34.338475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0590c543-ab54-424e-833b-065ee15aaf38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:34.339381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0590c543-ab54-424e-833b-065ee15aaf38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:34.347488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0590c543-ab54-424e-833b-065ee15aaf38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:34.348110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0590c543-ab54-424e-833b-065ee15aaf38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:34.348940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0590c543-ab54-424e-833b-065ee15aaf38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:34.349417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0590c543-ab54-424e-833b-065ee15aaf38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:34.512590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0590c543-ab54-424e-833b-065ee15aaf38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:34.522606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0590c543-ab54-424e-833b-065ee15aaf38 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.189235 Jul 25 19:56:34.523193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1546/2930] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:34 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:35.547065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-39f913e4-0729-42f6-af6c-2811cd48b384 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:35.547873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-39f913e4-0729-42f6-af6c-2811cd48b384 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:35.557111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39f913e4-0729-42f6-af6c-2811cd48b384 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:35.557560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39f913e4-0729-42f6-af6c-2811cd48b384 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:35.558346 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39f913e4-0729-42f6-af6c-2811cd48b384 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:35.558777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39f913e4-0729-42f6-af6c-2811cd48b384 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:35.737553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-39f913e4-0729-42f6-af6c-2811cd48b384 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:35.755558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-39f913e4-0729-42f6-af6c-2811cd48b384 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.213724 Jul 25 19:56:35.760080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1385/2931] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:35 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:56:36.793320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-37c7504e-3823-4246-af32-9df2522bd35a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:36.794335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-37c7504e-3823-4246-af32-9df2522bd35a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:36.801520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37c7504e-3823-4246-af32-9df2522bd35a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:36.801962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37c7504e-3823-4246-af32-9df2522bd35a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:36.803432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37c7504e-3823-4246-af32-9df2522bd35a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:36.803801 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-37c7504e-3823-4246-af32-9df2522bd35a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:36.963968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-37c7504e-3823-4246-af32-9df2522bd35a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:36.976035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-37c7504e-3823-4246-af32-9df2522bd35a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.186661 Jul 25 19:56:36.976812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1547/2932] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:36 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:38.002990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b4d79c49-babe-4cfd-b07e-7819a43a21ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:38.004202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b4d79c49-babe-4cfd-b07e-7819a43a21ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:38.016815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4d79c49-babe-4cfd-b07e-7819a43a21ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:38.017651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4d79c49-babe-4cfd-b07e-7819a43a21ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:38.019076 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4d79c49-babe-4cfd-b07e-7819a43a21ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:38.019937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4d79c49-babe-4cfd-b07e-7819a43a21ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:38.265304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b4d79c49-babe-4cfd-b07e-7819a43a21ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:38.283071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b4d79c49-babe-4cfd-b07e-7819a43a21ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.287031 Jul 25 19:56:38.284537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1386/2933] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:37 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:38.945895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:56:38.946149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:56:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:56:39.323737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf75c5d7-e739-4f28-8a88-dad4a817c31b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:39.325094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cf75c5d7-e739-4f28-8a88-dad4a817c31b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:39.337713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf75c5d7-e739-4f28-8a88-dad4a817c31b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:39.338674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf75c5d7-e739-4f28-8a88-dad4a817c31b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:39.340348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf75c5d7-e739-4f28-8a88-dad4a817c31b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:39.341320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf75c5d7-e739-4f28-8a88-dad4a817c31b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:39.576741 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf75c5d7-e739-4f28-8a88-dad4a817c31b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:39.586955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cf75c5d7-e739-4f28-8a88-dad4a817c31b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.271926 Jul 25 19:56:39.587700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1548/2934] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:39 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:40.614007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-716ec2aa-99e3-4bc3-bec2-d9afbf6dc12d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:40.615769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-716ec2aa-99e3-4bc3-bec2-d9afbf6dc12d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:40.624186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-716ec2aa-99e3-4bc3-bec2-d9afbf6dc12d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:40.624793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-716ec2aa-99e3-4bc3-bec2-d9afbf6dc12d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:40.626170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-716ec2aa-99e3-4bc3-bec2-d9afbf6dc12d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:40.626934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-716ec2aa-99e3-4bc3-bec2-d9afbf6dc12d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:40.836160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-716ec2aa-99e3-4bc3-bec2-d9afbf6dc12d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:40.857999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-716ec2aa-99e3-4bc3-bec2-d9afbf6dc12d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.250444 Jul 25 19:56:40.858966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1387/2935] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:40 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:41.895794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b5575c7d-34b0-4d6b-8c52-9ea3bf19c6fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:41.896906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b5575c7d-34b0-4d6b-8c52-9ea3bf19c6fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:41.908347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b5575c7d-34b0-4d6b-8c52-9ea3bf19c6fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:41.909398 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b5575c7d-34b0-4d6b-8c52-9ea3bf19c6fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:41.910604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b5575c7d-34b0-4d6b-8c52-9ea3bf19c6fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:41.911015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b5575c7d-34b0-4d6b-8c52-9ea3bf19c6fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:42.146878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b5575c7d-34b0-4d6b-8c52-9ea3bf19c6fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:42.158326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b5575c7d-34b0-4d6b-8c52-9ea3bf19c6fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.268620 Jul 25 19:56:42.159472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1549/2936] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:41 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:43.195053 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0ade8e1-fe47-4128-b6ab-617e9bfa2599 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:43.195949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0ade8e1-fe47-4128-b6ab-617e9bfa2599 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:43.202992 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0ade8e1-fe47-4128-b6ab-617e9bfa2599 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:43.203443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0ade8e1-fe47-4128-b6ab-617e9bfa2599 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:43.204262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0ade8e1-fe47-4128-b6ab-617e9bfa2599 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:43.204705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0ade8e1-fe47-4128-b6ab-617e9bfa2599 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:43.403490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0ade8e1-fe47-4128-b6ab-617e9bfa2599 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:43.419443 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0ade8e1-fe47-4128-b6ab-617e9bfa2599 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.228990 Jul 25 19:56:43.420386 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1388/2937] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:43 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:56:44.453763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-23f3c9bd-a5de-4d47-b91e-a2dc91e6e370 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:44.454665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-23f3c9bd-a5de-4d47-b91e-a2dc91e6e370 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:44.462721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23f3c9bd-a5de-4d47-b91e-a2dc91e6e370 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:44.463178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23f3c9bd-a5de-4d47-b91e-a2dc91e6e370 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:44.464022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23f3c9bd-a5de-4d47-b91e-a2dc91e6e370 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:44.464475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-23f3c9bd-a5de-4d47-b91e-a2dc91e6e370 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:44.651256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-23f3c9bd-a5de-4d47-b91e-a2dc91e6e370 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:44.660023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-23f3c9bd-a5de-4d47-b91e-a2dc91e6e370 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.210515 Jul 25 19:56:44.660600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1550/2938] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:44 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:45.687334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-368ed2bb-075a-43d1-b367-48c5f5ce8f14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:45.688246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-368ed2bb-075a-43d1-b367-48c5f5ce8f14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:45.691628 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:56:45.700190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-368ed2bb-075a-43d1-b367-48c5f5ce8f14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:45.701021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-368ed2bb-075a-43d1-b367-48c5f5ce8f14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:45.702100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-368ed2bb-075a-43d1-b367-48c5f5ce8f14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:45.702635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-368ed2bb-075a-43d1-b367-48c5f5ce8f14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:45.706703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:56:45.893575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-368ed2bb-075a-43d1-b367-48c5f5ce8f14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:45.903405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-368ed2bb-075a-43d1-b367-48c5f5ce8f14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.222968 Jul 25 19:56:45.904044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1389/2939] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:45 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:46.944000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ad7d111d-7c1c-4d42-8dee-4a96e253096d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:46.945091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ad7d111d-7c1c-4d42-8dee-4a96e253096d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:46.949094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=27 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:56:46.958317 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7d111d-7c1c-4d42-8dee-4a96e253096d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:46.959096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7d111d-7c1c-4d42-8dee-4a96e253096d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:46.960503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7d111d-7c1c-4d42-8dee-4a96e253096d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:46.961270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad7d111d-7c1c-4d42-8dee-4a96e253096d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:46.969263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=79 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:56:47.165937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ad7d111d-7c1c-4d42-8dee-4a96e253096d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:47.181441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ad7d111d-7c1c-4d42-8dee-4a96e253096d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.244922 Jul 25 19:56:47.182509 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1551/2940] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:46 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:48.222505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cf341706-ca99-498a-90a5-a7220a708d31 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:48.223720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cf341706-ca99-498a-90a5-a7220a708d31 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:48.234773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf341706-ca99-498a-90a5-a7220a708d31 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:48.235277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf341706-ca99-498a-90a5-a7220a708d31 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:48.236101 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf341706-ca99-498a-90a5-a7220a708d31 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:48.236550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf341706-ca99-498a-90a5-a7220a708d31 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:48.383052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cf341706-ca99-498a-90a5-a7220a708d31 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:48.392083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cf341706-ca99-498a-90a5-a7220a708d31 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.176980 Jul 25 19:56:48.392754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1390/2941] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:48 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:49.415796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-16f6d0f0-e8dc-4e7b-84f3-7e7c5f1ce4fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:49.416865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-16f6d0f0-e8dc-4e7b-84f3-7e7c5f1ce4fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:49.424889 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16f6d0f0-e8dc-4e7b-84f3-7e7c5f1ce4fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:49.425339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16f6d0f0-e8dc-4e7b-84f3-7e7c5f1ce4fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:49.426121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16f6d0f0-e8dc-4e7b-84f3-7e7c5f1ce4fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:49.426564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-16f6d0f0-e8dc-4e7b-84f3-7e7c5f1ce4fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:49.587626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-16f6d0f0-e8dc-4e7b-84f3-7e7c5f1ce4fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:49.601639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-16f6d0f0-e8dc-4e7b-84f3-7e7c5f1ce4fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.190158 Jul 25 19:56:49.602247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1552/2942] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:49 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:50.635909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b4f84fba-174f-4331-b813-6e9b122c56c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:50.636726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b4f84fba-174f-4331-b813-6e9b122c56c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:50.643488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4f84fba-174f-4331-b813-6e9b122c56c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:50.644046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4f84fba-174f-4331-b813-6e9b122c56c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:50.644838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4f84fba-174f-4331-b813-6e9b122c56c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:50.645280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4f84fba-174f-4331-b813-6e9b122c56c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:50.787910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b4f84fba-174f-4331-b813-6e9b122c56c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:50.796434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b4f84fba-174f-4331-b813-6e9b122c56c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.164772 Jul 25 19:56:50.797211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1391/2943] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:50 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:51.818802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8df2419c-21c2-4b21-b1a1-ee965b34290b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:51.819575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8df2419c-21c2-4b21-b1a1-ee965b34290b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:51.827107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8df2419c-21c2-4b21-b1a1-ee965b34290b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:51.827752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8df2419c-21c2-4b21-b1a1-ee965b34290b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:51.828621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8df2419c-21c2-4b21-b1a1-ee965b34290b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:51.829130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8df2419c-21c2-4b21-b1a1-ee965b34290b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:51.991215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8df2419c-21c2-4b21-b1a1-ee965b34290b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:52.001687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8df2419c-21c2-4b21-b1a1-ee965b34290b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.186374 Jul 25 19:56:52.002295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1553/2944] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:51 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:52.744233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8697286d-509e-47df-8d48-32ad38366abc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:52.745140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8697286d-509e-47df-8d48-32ad38366abc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:52.753700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8697286d-509e-47df-8d48-32ad38366abc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:52.754156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8697286d-509e-47df-8d48-32ad38366abc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:52.755230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8697286d-509e-47df-8d48-32ad38366abc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:52.755730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8697286d-509e-47df-8d48-32ad38366abc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:52.785328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8697286d-509e-47df-8d48-32ad38366abc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:56:52.872459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8697286d-509e-47df-8d48-32ad38366abc tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 204 len: 0 microversion: 2.1 time: 0.133510 Jul 25 19:56:52.873059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1392/2945] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:56:52 2022] DELETE /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:56:52.883905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6c067a43-1743-4689-9944-bc041e985b46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:52.884650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6c067a43-1743-4689-9944-bc041e985b46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:52.891247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c067a43-1743-4689-9944-bc041e985b46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:52.891725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c067a43-1743-4689-9944-bc041e985b46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:52.892493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c067a43-1743-4689-9944-bc041e985b46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:52.892922 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c067a43-1743-4689-9944-bc041e985b46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:53.037481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c47249b5-e32e-4f43-a3f5-80bdccb890b6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:53.038024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c47249b5-e32e-4f43-a3f5-80bdccb890b6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:53.040264 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6c067a43-1743-4689-9944-bc041e985b46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:53.045322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c47249b5-e32e-4f43-a3f5-80bdccb890b6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:53.045765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c47249b5-e32e-4f43-a3f5-80bdccb890b6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:53.046539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c47249b5-e32e-4f43-a3f5-80bdccb890b6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:53.046982 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c47249b5-e32e-4f43-a3f5-80bdccb890b6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:53.048336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6c067a43-1743-4689-9944-bc041e985b46 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1680 microversion: 2.1 time: 0.168890 Jul 25 19:56:53.048927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1554/2946] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:52 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:53.201361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c47249b5-e32e-4f43-a3f5-80bdccb890b6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:53.210677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c47249b5-e32e-4f43-a3f5-80bdccb890b6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.180493 Jul 25 19:56:53.211262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1393/2947] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:53 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:56:54.071031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df76fb19-f209-4438-a04f-30e9c8589aa2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:54.071891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df76fb19-f209-4438-a04f-30e9c8589aa2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:54.078918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df76fb19-f209-4438-a04f-30e9c8589aa2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:54.079369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df76fb19-f209-4438-a04f-30e9c8589aa2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:54.080188 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df76fb19-f209-4438-a04f-30e9c8589aa2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:54.080629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df76fb19-f209-4438-a04f-30e9c8589aa2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:54.234543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ac827771-c520-4e83-ba34-b91ebdf7c3a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:54.235347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ac827771-c520-4e83-ba34-b91ebdf7c3a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:54.244699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac827771-c520-4e83-ba34-b91ebdf7c3a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:54.245150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac827771-c520-4e83-ba34-b91ebdf7c3a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:54.245926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac827771-c520-4e83-ba34-b91ebdf7c3a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:54.246365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac827771-c520-4e83-ba34-b91ebdf7c3a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:54.294986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df76fb19-f209-4438-a04f-30e9c8589aa2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:54.304383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df76fb19-f209-4438-a04f-30e9c8589aa2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1680 microversion: 2.1 time: 0.238170 Jul 25 19:56:54.304980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1555/2948] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:54 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1680 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:54.582296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ac827771-c520-4e83-ba34-b91ebdf7c3a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:54.591702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ac827771-c520-4e83-ba34-b91ebdf7c3a2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.361080 Jul 25 19:56:54.592753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1394/2949] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:54 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:56:54.791880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-a6acbe04-d023-4588-98ea-cbabe9a03b4b req-72c5ae0c-2371-43e2-8eee-4853fabeaa6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f473a58-cf08-414e-8307-99283263dd30", "name": "network-vif-deleted", "tag": "082c8b7f-e878-4256-9011-4d70d8adbf74"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:56:54.816189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-a6acbe04-d023-4588-98ea-cbabe9a03b4b req-72c5ae0c-2371-43e2-8eee-4853fabeaa6d service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:54.817239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-a6acbe04-d023-4588-98ea-cbabe9a03b4b req-72c5ae0c-2371-43e2-8eee-4853fabeaa6d service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:54.843095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-a6acbe04-d023-4588-98ea-cbabe9a03b4b req-72c5ae0c-2371-43e2-8eee-4853fabeaa6d service nova] Creating event network-vif-deleted:082c8b7f-e878-4256-9011-4d70d8adbf74 for instance 2f473a58-cf08-414e-8307-99283263dd30 on hv-cinder-85093 Jul 25 19:56:54.853715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-a6acbe04-d023-4588-98ea-cbabe9a03b4b req-72c5ae0c-2371-43e2-8eee-4853fabeaa6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068765 Jul 25 19:56:54.854780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1556/2950] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:56:55.326571 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:55.327287 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:55.335843 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:55.336296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:55.337083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:55.337519 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:55.372584 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:55.373030 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:55.373495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lazy-loading 'fault' on Instance uuid 2f473a58-cf08-414e-8307-99283263dd30 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:56:55.422966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:55.432526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0056892e-6221-47a1-bfdf-deadc1f24f0a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 200 len: 1330 microversion: 2.1 time: 0.109857 Jul 25 19:56:55.433004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1395/2951] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:55 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:55.626085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-44857bf1-1d87-432f-80b0-34fcf93fe182 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:55.626603 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-44857bf1-1d87-432f-80b0-34fcf93fe182 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:55.634206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44857bf1-1d87-432f-80b0-34fcf93fe182 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:55.634648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44857bf1-1d87-432f-80b0-34fcf93fe182 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:55.635718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44857bf1-1d87-432f-80b0-34fcf93fe182 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:55.636174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44857bf1-1d87-432f-80b0-34fcf93fe182 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:55.795482 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-44857bf1-1d87-432f-80b0-34fcf93fe182 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:55.807880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-44857bf1-1d87-432f-80b0-34fcf93fe182 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.185925 Jul 25 19:56:55.808749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1557/2952] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:55 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:56.463426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77ac0555-a21d-4537-9d44-396fcd22b60f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:56.464402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-77ac0555-a21d-4537-9d44-396fcd22b60f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:56.470716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ac0555-a21d-4537-9d44-396fcd22b60f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:56.471158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ac0555-a21d-4537-9d44-396fcd22b60f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:56.471961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ac0555-a21d-4537-9d44-396fcd22b60f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:56.472400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ac0555-a21d-4537-9d44-396fcd22b60f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:56.487637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-77ac0555-a21d-4537-9d44-396fcd22b60f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77ac0555-a21d-4537-9d44-396fcd22b60f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 HTTP/1.1 Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:56:56.489324 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 19:56:56.492114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '2f473a58-cf08-414e-8307-99283263dd30'} Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:56:56.493369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 19:56:56.496075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:56:56.498873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77ac0555-a21d-4537-9d44-396fcd22b60f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:56:56.498873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-77ac0555-a21d-4537-9d44-396fcd22b60f tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 404 len: 111 microversion: 2.1 time: 0.032774 Jul 25 19:56:56.498873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1396/2953] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:56 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:56:56.501469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2010a65c-ef91-46b0-aa69-46106f6aa27a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '.version_select at 0x7feafb352a60>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:56.531764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2010a65c-ef91-46b0-aa69-46106f6aa27a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-97164375" status: 202 len: 0 microversion: 2.1 time: 0.034895 Jul 25 19:56:56.532352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1558/2954] 10.222.0.18 () {58 vars in 1215 bytes} [Mon Jul 25 19:56:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-97164375 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 19:56:56.832702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a47919f4-5423-412c-9bd9-092c3bf7f573 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:56.834382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a47919f4-5423-412c-9bd9-092c3bf7f573 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:56.842790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a47919f4-5423-412c-9bd9-092c3bf7f573 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:56.843238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a47919f4-5423-412c-9bd9-092c3bf7f573 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:56.844063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a47919f4-5423-412c-9bd9-092c3bf7f573 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:56.844496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a47919f4-5423-412c-9bd9-092c3bf7f573 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:57.303957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a47919f4-5423-412c-9bd9-092c3bf7f573 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:57.312181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a47919f4-5423-412c-9bd9-092c3bf7f573 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.486514 Jul 25 19:56:57.313020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1397/2955] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:56 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:57.548435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7751caa5-8bb5-4d02-bffb-7c85705a3d41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: .version_select at 0x7feb0c46a550>, body: {"keypair": {"name": "tempest-keypair-1188869481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD009Fgu/rmPbrB6D2jD1PeVj6DuxmJYU72HA7BIw4axPTMTyfXRj1UGsrcZjK0MdA98HLgk+5GuWOP4n3N16jRORSo4Xk5+uYIGwE1cODJZy0Y/VtfJnloOSfDS3wzW9A=="}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:56:57.567806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-7751caa5-8bb5-4d02-bffb-7c85705a3d41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:56:57.571963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-7751caa5-8bb5-4d02-bffb-7c85705a3d41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for user 6ecf34ceee294b53b5be7c1723b42950 and project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:56:57.602360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7751caa5-8bb5-4d02-bffb-7c85705a3d41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061165 Jul 25 19:56:57.603458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1559/2956] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Jul 25 19:56:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:56:58.340153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ec565a9d-1a30-4fba-8057-d77502e7adf1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:58.340837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ec565a9d-1a30-4fba-8057-d77502e7adf1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:58.348546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec565a9d-1a30-4fba-8057-d77502e7adf1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:58.349808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec565a9d-1a30-4fba-8057-d77502e7adf1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:58.351163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec565a9d-1a30-4fba-8057-d77502e7adf1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:58.351943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec565a9d-1a30-4fba-8057-d77502e7adf1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:58.545979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ec565a9d-1a30-4fba-8057-d77502e7adf1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:58.559775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ec565a9d-1a30-4fba-8057-d77502e7adf1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.226647 Jul 25 19:56:58.560836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1398/2957] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:58 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:56:59.041467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:56:59.042181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 19:56:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:56:59.325909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1417466402", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b6d8d22-cbba-4be4-870a-41dcb5ed33ac"}], "security_groups": [{"name": "tempest-securitygroup--222704486"}], "key_name": "tempest-keypair-1188869481", "user_data": "}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:56:59.450128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] validate_networks() for [('5b6d8d22-cbba-4be4-870a-41dcb5ed33ac', None, None, None, None, None)] {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:56:59.595094 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-75b98d91-8cea-4fbc-8ea5-ac3e833b5e17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:56:59.595757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-75b98d91-8cea-4fbc-8ea5-ac3e833b5e17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:56:59.603744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75b98d91-8cea-4fbc-8ea5-ac3e833b5e17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:59.604208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75b98d91-8cea-4fbc-8ea5-ac3e833b5e17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:59.604998 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75b98d91-8cea-4fbc-8ea5-ac3e833b5e17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:59.605436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75b98d91-8cea-4fbc-8ea5-ac3e833b5e17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:59.816751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-75b98d91-8cea-4fbc-8ea5-ac3e833b5e17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:56:59.827540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-75b98d91-8cea-4fbc-8ea5-ac3e833b5e17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.236265 Jul 25 19:56:59.828309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1399/2958] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:56:59 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:56:59.984019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:56:59.984441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:56:59.984920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:56:59.985331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:56:59.985743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:56:59.996227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:59.996696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:56:59.997484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:56:59.997912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:00.016641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:57:00.021448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Getting quotas for user 6ecf34ceee294b53b5be7c1723b42950 and project 8185baa0f3e3465f813c0e2dc29ad847. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:57:00.035207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:57:00.038085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:57:00.093721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a562edf4-8a31-4790-ac51-fa741b7eff41 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.773649 Jul 25 19:57:00.094670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1560/2959] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 19:56:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:57:00.105674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1ccf0381-3185-4253-a278-f9ddedb805c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:00.106284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1ccf0381-3185-4253-a278-f9ddedb805c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:00.182913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1ccf0381-3185-4253-a278-f9ddedb805c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:00.190234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1ccf0381-3185-4253-a278-f9ddedb805c2 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1242 microversion: 2.1 time: 0.088312 Jul 25 19:57:00.190839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1400/2960] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:00 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:00.858758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-969b5f58-a0cc-4b33-97ac-3bb1a59734ff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:00.859621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-969b5f58-a0cc-4b33-97ac-3bb1a59734ff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:00.868060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-969b5f58-a0cc-4b33-97ac-3bb1a59734ff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:00.868636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-969b5f58-a0cc-4b33-97ac-3bb1a59734ff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:00.869532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-969b5f58-a0cc-4b33-97ac-3bb1a59734ff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:00.870102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-969b5f58-a0cc-4b33-97ac-3bb1a59734ff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:01.044882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-969b5f58-a0cc-4b33-97ac-3bb1a59734ff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:01.053593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-969b5f58-a0cc-4b33-97ac-3bb1a59734ff tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.202198 Jul 25 19:57:01.054211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1561/2961] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:00 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:01.213805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-afc00058-4524-4f62-a56b-da68725bd660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:01.214434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-afc00058-4524-4f62-a56b-da68725bd660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:01.222376 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afc00058-4524-4f62-a56b-da68725bd660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:01.222830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afc00058-4524-4f62-a56b-da68725bd660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:01.223652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afc00058-4524-4f62-a56b-da68725bd660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:01.224340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afc00058-4524-4f62-a56b-da68725bd660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:01.290641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-afc00058-4524-4f62-a56b-da68725bd660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:01.298482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-afc00058-4524-4f62-a56b-da68725bd660 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1294 microversion: 2.1 time: 0.089183 Jul 25 19:57:01.299060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1401/2962] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:01 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:02.076599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6336098b-c40a-4fc9-a853-7851517bff91 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:02.077328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6336098b-c40a-4fc9-a853-7851517bff91 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:02.085814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6336098b-c40a-4fc9-a853-7851517bff91 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:02.086410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6336098b-c40a-4fc9-a853-7851517bff91 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:02.087281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6336098b-c40a-4fc9-a853-7851517bff91 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:02.087860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6336098b-c40a-4fc9-a853-7851517bff91 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:02.321351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3223ee49-ca5f-4506-8a90-0ae25329c0d8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:02.322483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3223ee49-ca5f-4506-8a90-0ae25329c0d8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:02.333923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3223ee49-ca5f-4506-8a90-0ae25329c0d8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:02.334373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3223ee49-ca5f-4506-8a90-0ae25329c0d8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:02.335764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3223ee49-ca5f-4506-8a90-0ae25329c0d8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:02.336456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3223ee49-ca5f-4506-8a90-0ae25329c0d8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:02.397581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6336098b-c40a-4fc9-a853-7851517bff91 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:02.407604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6336098b-c40a-4fc9-a853-7851517bff91 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.335639 Jul 25 19:57:02.423750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1562/2963] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:02 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:02.428422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3223ee49-ca5f-4506-8a90-0ae25329c0d8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:02.437797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3223ee49-ca5f-4506-8a90-0ae25329c0d8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1300 microversion: 2.1 time: 0.121415 Jul 25 19:57:02.438050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1402/2964] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:02 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:03.446720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9955d09b-9ef1-40b6-bd94-791102a34f1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:03.448702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9955d09b-9ef1-40b6-bd94-791102a34f1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:03.462262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9955d09b-9ef1-40b6-bd94-791102a34f1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:03.463332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ab3a92a-5024-41ff-afe0-2e6365495d63 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:03.463869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9955d09b-9ef1-40b6-bd94-791102a34f1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:03.464763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9955d09b-9ef1-40b6-bd94-791102a34f1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:03.465079 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ab3a92a-5024-41ff-afe0-2e6365495d63 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:03.465479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9955d09b-9ef1-40b6-bd94-791102a34f1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:03.472812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ab3a92a-5024-41ff-afe0-2e6365495d63 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:03.474363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ab3a92a-5024-41ff-afe0-2e6365495d63 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:03.475663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ab3a92a-5024-41ff-afe0-2e6365495d63 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:03.476359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ab3a92a-5024-41ff-afe0-2e6365495d63 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:03.931691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ab3a92a-5024-41ff-afe0-2e6365495d63 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:03.947842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ab3a92a-5024-41ff-afe0-2e6365495d63 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1367 microversion: 2.1 time: 0.488587 Jul 25 19:57:03.949503 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1403/2965] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:03 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1367 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:03.967880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9955d09b-9ef1-40b6-bd94-791102a34f1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:03.978720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9955d09b-9ef1-40b6-bd94-791102a34f1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.542434 Jul 25 19:57:03.980084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1563/2966] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:03 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:04.040158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-848e9cfc-711a-40c3-96f0-84c6c2d65ed5 req-0b94715e-ef87-4d97-8bb6-d8cd9ff7a807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31db936e-3df3-4d8b-82f6-2022cfcc5227", "tag": "ae264aa0-c829-48d9-9c93-f11be9a04f72"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:57:04.072645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-848e9cfc-711a-40c3-96f0-84c6c2d65ed5 req-0b94715e-ef87-4d97-8bb6-d8cd9ff7a807 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:04.073860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-848e9cfc-711a-40c3-96f0-84c6c2d65ed5 req-0b94715e-ef87-4d97-8bb6-d8cd9ff7a807 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:04.089873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-848e9cfc-711a-40c3-96f0-84c6c2d65ed5 req-0b94715e-ef87-4d97-8bb6-d8cd9ff7a807 service nova] Creating event network-changed:ae264aa0-c829-48d9-9c93-f11be9a04f72 for instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 on hv-cinder-85093 Jul 25 19:57:04.097872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-848e9cfc-711a-40c3-96f0-84c6c2d65ed5 req-0b94715e-ef87-4d97-8bb6-d8cd9ff7a807 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062752 Jul 25 19:57:04.099418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1404/2967] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:57:04.980058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-481ff8f6-9e48-4361-a4ac-6079c5157df7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:04.980927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-481ff8f6-9e48-4361-a4ac-6079c5157df7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:04.988376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-481ff8f6-9e48-4361-a4ac-6079c5157df7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:04.988910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-481ff8f6-9e48-4361-a4ac-6079c5157df7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:04.990353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-481ff8f6-9e48-4361-a4ac-6079c5157df7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:04.990800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-481ff8f6-9e48-4361-a4ac-6079c5157df7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:05.006373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0a1739dc-33b3-479a-8adc-f4ac86d60b69 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:05.007260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0a1739dc-33b3-479a-8adc-f4ac86d60b69 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:05.015359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a1739dc-33b3-479a-8adc-f4ac86d60b69 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:05.015980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a1739dc-33b3-479a-8adc-f4ac86d60b69 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:05.017228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a1739dc-33b3-479a-8adc-f4ac86d60b69 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:05.018027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a1739dc-33b3-479a-8adc-f4ac86d60b69 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:05.240692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-481ff8f6-9e48-4361-a4ac-6079c5157df7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:05.252156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0a1739dc-33b3-479a-8adc-f4ac86d60b69 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:05.254764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-481ff8f6-9e48-4361-a4ac-6079c5157df7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1367 microversion: 2.1 time: 0.281091 Jul 25 19:57:05.256091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1564/2968] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:04 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:05.261309 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0a1739dc-33b3-479a-8adc-f4ac86d60b69 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.260588 Jul 25 19:57:05.262125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1405/2969] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:04 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:06.285658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0a3266dd-8963-4fa9-9e66-7dd4a6ca24a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:06.286324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0a3266dd-8963-4fa9-9e66-7dd4a6ca24a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:06.287200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-982a98b0-2013-44bf-8285-83fb14427495 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:06.288047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-982a98b0-2013-44bf-8285-83fb14427495 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:06.293332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a3266dd-8963-4fa9-9e66-7dd4a6ca24a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:06.293777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a3266dd-8963-4fa9-9e66-7dd4a6ca24a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:06.294556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a3266dd-8963-4fa9-9e66-7dd4a6ca24a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:06.294999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a3266dd-8963-4fa9-9e66-7dd4a6ca24a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:06.295179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-982a98b0-2013-44bf-8285-83fb14427495 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:06.295709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-982a98b0-2013-44bf-8285-83fb14427495 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:06.296490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-982a98b0-2013-44bf-8285-83fb14427495 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:06.297003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-982a98b0-2013-44bf-8285-83fb14427495 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:06.300074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:06.641082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-982a98b0-2013-44bf-8285-83fb14427495 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:06.645331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0a3266dd-8963-4fa9-9e66-7dd4a6ca24a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:06.650754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-982a98b0-2013-44bf-8285-83fb14427495 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.367370 Jul 25 19:57:06.651335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1406/2970] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:06 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:06.654642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0a3266dd-8963-4fa9-9e66-7dd4a6ca24a6 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1367 microversion: 2.1 time: 0.373623 Jul 25 19:57:06.655194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1565/2971] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:06 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:07.673461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-176e9eae-c75e-4bd2-92fa-023843979ea5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:07.674100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-176e9eae-c75e-4bd2-92fa-023843979ea5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:07.678147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e06e228d-d317-45d3-8d1a-755b69e568f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:07.679035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e06e228d-d317-45d3-8d1a-755b69e568f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:07.681956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-176e9eae-c75e-4bd2-92fa-023843979ea5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:07.682410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-176e9eae-c75e-4bd2-92fa-023843979ea5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:07.683190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-176e9eae-c75e-4bd2-92fa-023843979ea5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:07.683660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-176e9eae-c75e-4bd2-92fa-023843979ea5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:07.685928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e06e228d-d317-45d3-8d1a-755b69e568f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:07.686382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e06e228d-d317-45d3-8d1a-755b69e568f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:07.687157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e06e228d-d317-45d3-8d1a-755b69e568f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:07.689797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e06e228d-d317-45d3-8d1a-755b69e568f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:07.894226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-176e9eae-c75e-4bd2-92fa-023843979ea5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:07.903618 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-176e9eae-c75e-4bd2-92fa-023843979ea5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.234059 Jul 25 19:57:07.904209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1407/2972] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:07 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:07.922268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e06e228d-d317-45d3-8d1a-755b69e568f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:07.932175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e06e228d-d317-45d3-8d1a-755b69e568f4 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1367 microversion: 2.1 time: 0.259854 Jul 25 19:57:07.932886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1566/2973] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:07 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:08.928414 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5b06309e-e44e-4b63-ab73-b5a20a4293a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:08.929136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5b06309e-e44e-4b63-ab73-b5a20a4293a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:08.936087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b06309e-e44e-4b63-ab73-b5a20a4293a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:08.936625 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b06309e-e44e-4b63-ab73-b5a20a4293a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:08.937482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b06309e-e44e-4b63-ab73-b5a20a4293a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:08.937997 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b06309e-e44e-4b63-ab73-b5a20a4293a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:08.959426 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f8136508-1c85-43ac-b554-8d18782b4341 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:08.960496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f8136508-1c85-43ac-b554-8d18782b4341 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:08.967870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8136508-1c85-43ac-b554-8d18782b4341 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:08.968417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8136508-1c85-43ac-b554-8d18782b4341 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:08.969569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8136508-1c85-43ac-b554-8d18782b4341 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:08.970475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8136508-1c85-43ac-b554-8d18782b4341 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:09.137180 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5b06309e-e44e-4b63-ab73-b5a20a4293a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:09.145358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5b06309e-e44e-4b63-ab73-b5a20a4293a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.221899 Jul 25 19:57:09.147093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1408/2974] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:08 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:09.159966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f8136508-1c85-43ac-b554-8d18782b4341 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:09.168641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f8136508-1c85-43ac-b554-8d18782b4341 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1367 microversion: 2.1 time: 0.213579 Jul 25 19:57:09.169231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1567/2975] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:08 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:10.168146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9da6ae2a-6b05-4c8c-8159-aa2a6b5ac084 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:10.168769 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9da6ae2a-6b05-4c8c-8159-aa2a6b5ac084 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:10.175805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9da6ae2a-6b05-4c8c-8159-aa2a6b5ac084 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:10.176253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9da6ae2a-6b05-4c8c-8159-aa2a6b5ac084 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:10.177638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9da6ae2a-6b05-4c8c-8159-aa2a6b5ac084 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:10.178404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9da6ae2a-6b05-4c8c-8159-aa2a6b5ac084 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:10.188713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ad787d4a-fe4c-4626-88eb-b3944935cc1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:10.189488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ad787d4a-fe4c-4626-88eb-b3944935cc1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:10.191884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:10.193425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=10 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:10.198705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:10.199816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad787d4a-fe4c-4626-88eb-b3944935cc1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:10.200270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad787d4a-fe4c-4626-88eb-b3944935cc1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:10.201064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad787d4a-fe4c-4626-88eb-b3944935cc1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:10.201504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ad787d4a-fe4c-4626-88eb-b3944935cc1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:10.401344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9da6ae2a-6b05-4c8c-8159-aa2a6b5ac084 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:10.405589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ad787d4a-fe4c-4626-88eb-b3944935cc1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:10.409768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9da6ae2a-6b05-4c8c-8159-aa2a6b5ac084 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.245463 Jul 25 19:57:10.410273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1409/2976] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:10 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:10.413413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ad787d4a-fe4c-4626-88eb-b3944935cc1d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1367 microversion: 2.1 time: 0.228610 Jul 25 19:57:10.413985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1568/2977] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:10 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:11.014115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-9732bec2-6be1-4b68-b196-c56008228ad2 req-816c05b3-6ae3-474f-89c6-55c0750c93bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31db936e-3df3-4d8b-82f6-2022cfcc5227", "name": "network-vif-plugged", "status": "completed", "tag": "ae264aa0-c829-48d9-9c93-f11be9a04f72"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:57:11.025680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-9732bec2-6be1-4b68-b196-c56008228ad2 req-816c05b3-6ae3-474f-89c6-55c0750c93bc service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:11.026164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-9732bec2-6be1-4b68-b196-c56008228ad2 req-816c05b3-6ae3-474f-89c6-55c0750c93bc service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:11.039116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-9732bec2-6be1-4b68-b196-c56008228ad2 req-816c05b3-6ae3-474f-89c6-55c0750c93bc service nova] Creating event network-vif-plugged:ae264aa0-c829-48d9-9c93-f11be9a04f72 for instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 on hv-cinder-85093 Jul 25 19:57:11.044691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-9732bec2-6be1-4b68-b196-c56008228ad2 req-816c05b3-6ae3-474f-89c6-55c0750c93bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091047 Jul 25 19:57:11.045319 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1410/2978] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:57:11.433021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d37a8e43-4898-4896-a8c8-2024ff421e14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:11.433853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d37a8e43-4898-4896-a8c8-2024ff421e14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:11.435812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0bdf9040-0fb2-4aec-8190-7532d1be34b7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:11.436513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0bdf9040-0fb2-4aec-8190-7532d1be34b7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:11.440662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d37a8e43-4898-4896-a8c8-2024ff421e14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:11.441116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d37a8e43-4898-4896-a8c8-2024ff421e14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:11.441884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d37a8e43-4898-4896-a8c8-2024ff421e14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:11.442361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d37a8e43-4898-4896-a8c8-2024ff421e14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:11.443767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bdf9040-0fb2-4aec-8190-7532d1be34b7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:11.444314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bdf9040-0fb2-4aec-8190-7532d1be34b7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:11.445175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bdf9040-0fb2-4aec-8190-7532d1be34b7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:11.445616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bdf9040-0fb2-4aec-8190-7532d1be34b7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:11.651795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d37a8e43-4898-4896-a8c8-2024ff421e14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:11.656100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0bdf9040-0fb2-4aec-8190-7532d1be34b7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:11.660211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d37a8e43-4898-4896-a8c8-2024ff421e14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.231706 Jul 25 19:57:11.660796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1569/2979] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:11 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:11.664162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0bdf9040-0fb2-4aec-8190-7532d1be34b7 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1367 microversion: 2.1 time: 0.232969 Jul 25 19:57:11.664746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1411/2980] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:11 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:12.683557 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-eb312fe1-4f9a-4f0a-b3b8-6c7b1b185209 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:12.684595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-eb312fe1-4f9a-4f0a-b3b8-6c7b1b185209 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:12.685642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3e74b6e7-446d-4bb8-8974-9725108a04ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:12.686340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3e74b6e7-446d-4bb8-8974-9725108a04ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:12.692110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb312fe1-4f9a-4f0a-b3b8-6c7b1b185209 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:12.692560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb312fe1-4f9a-4f0a-b3b8-6c7b1b185209 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:12.693341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb312fe1-4f9a-4f0a-b3b8-6c7b1b185209 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:12.693520 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e74b6e7-446d-4bb8-8974-9725108a04ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:12.693773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-eb312fe1-4f9a-4f0a-b3b8-6c7b1b185209 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:12.694128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e74b6e7-446d-4bb8-8974-9725108a04ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:12.694954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e74b6e7-446d-4bb8-8974-9725108a04ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:12.695393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e74b6e7-446d-4bb8-8974-9725108a04ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:12.912193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-eb312fe1-4f9a-4f0a-b3b8-6c7b1b185209 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:12.916255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3e74b6e7-446d-4bb8-8974-9725108a04ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:12.921268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-eb312fe1-4f9a-4f0a-b3b8-6c7b1b185209 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.242399 Jul 25 19:57:12.921880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1570/2981] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:12 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:12.925936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3e74b6e7-446d-4bb8-8974-9725108a04ed tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1367 microversion: 2.1 time: 0.243786 Jul 25 19:57:12.926468 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1412/2982] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:12 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:13.946399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5aa5b608-0a40-4bac-ba4d-9942bdc557ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:13.947074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e9aeba4e-2af1-45e1-8a3e-02ce085dc712 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:13.947450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5aa5b608-0a40-4bac-ba4d-9942bdc557ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:13.948063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e9aeba4e-2af1-45e1-8a3e-02ce085dc712 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:13.954693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9aeba4e-2af1-45e1-8a3e-02ce085dc712 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:13.955157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9aeba4e-2af1-45e1-8a3e-02ce085dc712 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:13.955999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9aeba4e-2af1-45e1-8a3e-02ce085dc712 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:13.956440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9aeba4e-2af1-45e1-8a3e-02ce085dc712 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:13.956746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5aa5b608-0a40-4bac-ba4d-9942bdc557ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:13.957641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5aa5b608-0a40-4bac-ba4d-9942bdc557ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:13.959899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5aa5b608-0a40-4bac-ba4d-9942bdc557ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:13.960700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5aa5b608-0a40-4bac-ba4d-9942bdc557ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:13.967397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=100 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:14.188284 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e9aeba4e-2af1-45e1-8a3e-02ce085dc712 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:14.194770 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5aa5b608-0a40-4bac-ba4d-9942bdc557ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:14.196457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e9aeba4e-2af1-45e1-8a3e-02ce085dc712 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1556 microversion: 2.1 time: 0.253969 Jul 25 19:57:14.197148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1413/2983] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:13 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:14.205072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5aa5b608-0a40-4bac-ba4d-9942bdc557ab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.263558 Jul 25 19:57:14.205649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1571/2984] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:13 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:14.218270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f7545738-44da-46e1-946a-699dc7c7dd6a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:14.218678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f7545738-44da-46e1-946a-699dc7c7dd6a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:14.226424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7545738-44da-46e1-946a-699dc7c7dd6a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:14.226870 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7545738-44da-46e1-946a-699dc7c7dd6a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:14.227709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7545738-44da-46e1-946a-699dc7c7dd6a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:14.228140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7545738-44da-46e1-946a-699dc7c7dd6a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:14.339582 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f7545738-44da-46e1-946a-699dc7c7dd6a tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125464 Jul 25 19:57:14.340176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1414/2985] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Jul 25 19:57:14 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:57:15.227650 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1e25807d-1120-4629-9f52-d42dfd58079b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:15.228296 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1e25807d-1120-4629-9f52-d42dfd58079b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:15.235586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e25807d-1120-4629-9f52-d42dfd58079b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:15.236042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e25807d-1120-4629-9f52-d42dfd58079b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:15.236830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e25807d-1120-4629-9f52-d42dfd58079b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:15.237298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1e25807d-1120-4629-9f52-d42dfd58079b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:15.374512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1e25807d-1120-4629-9f52-d42dfd58079b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:15.383419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1e25807d-1120-4629-9f52-d42dfd58079b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.159704 Jul 25 19:57:15.384326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1572/2986] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:15 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:15.603990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-0c983902-4ce2-4f4e-9307-b34997171117 req-b98b807f-7f26-4ee4-a485-5062317e4d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31db936e-3df3-4d8b-82f6-2022cfcc5227", "tag": "ae264aa0-c829-48d9-9c93-f11be9a04f72"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:57:15.613845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0c983902-4ce2-4f4e-9307-b34997171117 req-b98b807f-7f26-4ee4-a485-5062317e4d87 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:15.615239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0c983902-4ce2-4f4e-9307-b34997171117 req-b98b807f-7f26-4ee4-a485-5062317e4d87 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:15.627534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-0c983902-4ce2-4f4e-9307-b34997171117 req-b98b807f-7f26-4ee4-a485-5062317e4d87 service nova] Creating event network-changed:ae264aa0-c829-48d9-9c93-f11be9a04f72 for instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 on hv-cinder-85093 Jul 25 19:57:15.633818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-0c983902-4ce2-4f4e-9307-b34997171117 req-b98b807f-7f26-4ee4-a485-5062317e4d87 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095820 Jul 25 19:57:15.634427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1415/2987] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:57:16.404696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-99435d0a-e803-4504-bdd2-b3ef0798f6da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:16.405323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-99435d0a-e803-4504-bdd2-b3ef0798f6da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:16.413413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99435d0a-e803-4504-bdd2-b3ef0798f6da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:16.413869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99435d0a-e803-4504-bdd2-b3ef0798f6da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:16.414641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99435d0a-e803-4504-bdd2-b3ef0798f6da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:16.415075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-99435d0a-e803-4504-bdd2-b3ef0798f6da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:16.573372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-99435d0a-e803-4504-bdd2-b3ef0798f6da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:16.581399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-99435d0a-e803-4504-bdd2-b3ef0798f6da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.180521 Jul 25 19:57:16.582212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1573/2988] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:16 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:17.604009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-272114b9-2a2a-4f04-b36c-f24c3fb4821e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:17.604784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-272114b9-2a2a-4f04-b36c-f24c3fb4821e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:17.606717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:17.612160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-272114b9-2a2a-4f04-b36c-f24c3fb4821e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:17.612604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-272114b9-2a2a-4f04-b36c-f24c3fb4821e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:17.613369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-272114b9-2a2a-4f04-b36c-f24c3fb4821e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:17.613800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-272114b9-2a2a-4f04-b36c-f24c3fb4821e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:17.754304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-272114b9-2a2a-4f04-b36c-f24c3fb4821e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:17.762732 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-272114b9-2a2a-4f04-b36c-f24c3fb4821e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.163457 Jul 25 19:57:17.763297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1416/2989] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:17 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:18.784674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b2fdb7df-a726-435a-84ea-996ce4813816 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:18.785427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b2fdb7df-a726-435a-84ea-996ce4813816 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:18.788453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:18.793925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b2fdb7df-a726-435a-84ea-996ce4813816 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:18.794366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b2fdb7df-a726-435a-84ea-996ce4813816 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:18.795127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b2fdb7df-a726-435a-84ea-996ce4813816 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:18.795586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b2fdb7df-a726-435a-84ea-996ce4813816 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:18.928798 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b2fdb7df-a726-435a-84ea-996ce4813816 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:18.936851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b2fdb7df-a726-435a-84ea-996ce4813816 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.156026 Jul 25 19:57:18.937688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1574/2990] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:18 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:19.959286 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-444eb133-680f-45b6-a972-987adc8f2fa5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:19.959909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-444eb133-680f-45b6-a972-987adc8f2fa5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:19.966832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-444eb133-680f-45b6-a972-987adc8f2fa5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:19.967274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-444eb133-680f-45b6-a972-987adc8f2fa5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:19.968060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-444eb133-680f-45b6-a972-987adc8f2fa5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:19.968492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-444eb133-680f-45b6-a972-987adc8f2fa5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:20.106658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-444eb133-680f-45b6-a972-987adc8f2fa5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:20.115926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-444eb133-680f-45b6-a972-987adc8f2fa5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.160558 Jul 25 19:57:20.116509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1417/2991] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:19 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:21.137916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5caf6dc7-f64f-4143-b5b3-8843febbf229 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:21.138569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5caf6dc7-f64f-4143-b5b3-8843febbf229 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:21.144746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5caf6dc7-f64f-4143-b5b3-8843febbf229 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:21.145194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5caf6dc7-f64f-4143-b5b3-8843febbf229 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:21.145951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5caf6dc7-f64f-4143-b5b3-8843febbf229 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:21.146389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5caf6dc7-f64f-4143-b5b3-8843febbf229 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:21.298143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5caf6dc7-f64f-4143-b5b3-8843febbf229 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:21.306534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5caf6dc7-f64f-4143-b5b3-8843febbf229 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.172621 Jul 25 19:57:21.307139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1575/2992] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:21 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:22.329093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ab7408a7-2b3a-4186-b663-ed78f889dd1e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:22.329761 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ab7408a7-2b3a-4186-b663-ed78f889dd1e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:22.337171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab7408a7-2b3a-4186-b663-ed78f889dd1e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:22.337616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab7408a7-2b3a-4186-b663-ed78f889dd1e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:22.338389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab7408a7-2b3a-4186-b663-ed78f889dd1e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:22.338825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab7408a7-2b3a-4186-b663-ed78f889dd1e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:22.483290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ab7408a7-2b3a-4186-b663-ed78f889dd1e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:22.492215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ab7408a7-2b3a-4186-b663-ed78f889dd1e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.167223 Jul 25 19:57:22.492778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1418/2993] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:22 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:23.515206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4504a696-1e44-450d-84a3-baf9d9984ba2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:23.515835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4504a696-1e44-450d-84a3-baf9d9984ba2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:23.523051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4504a696-1e44-450d-84a3-baf9d9984ba2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:23.523613 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4504a696-1e44-450d-84a3-baf9d9984ba2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:23.524374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4504a696-1e44-450d-84a3-baf9d9984ba2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:23.524807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4504a696-1e44-450d-84a3-baf9d9984ba2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:23.656619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4504a696-1e44-450d-84a3-baf9d9984ba2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:23.665760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4504a696-1e44-450d-84a3-baf9d9984ba2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.154261 Jul 25 19:57:23.666346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1576/2994] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:23 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:24.688924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aefbc146-9efe-482b-8fa2-fb9bdb7d5ae6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:24.689515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aefbc146-9efe-482b-8fa2-fb9bdb7d5ae6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:24.696570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aefbc146-9efe-482b-8fa2-fb9bdb7d5ae6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:24.697012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aefbc146-9efe-482b-8fa2-fb9bdb7d5ae6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:24.697763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aefbc146-9efe-482b-8fa2-fb9bdb7d5ae6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:24.698194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aefbc146-9efe-482b-8fa2-fb9bdb7d5ae6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:24.831402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aefbc146-9efe-482b-8fa2-fb9bdb7d5ae6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:24.839979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aefbc146-9efe-482b-8fa2-fb9bdb7d5ae6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.154898 Jul 25 19:57:24.840550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1419/2995] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:24 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:25.861619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d35b23bc-96be-44f9-a451-8414a0ab9057 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:25.862289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d35b23bc-96be-44f9-a451-8414a0ab9057 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:25.869218 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d35b23bc-96be-44f9-a451-8414a0ab9057 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:25.869663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d35b23bc-96be-44f9-a451-8414a0ab9057 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:25.870420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d35b23bc-96be-44f9-a451-8414a0ab9057 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:25.870851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d35b23bc-96be-44f9-a451-8414a0ab9057 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:26.005050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d35b23bc-96be-44f9-a451-8414a0ab9057 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:26.014026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d35b23bc-96be-44f9-a451-8414a0ab9057 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.156224 Jul 25 19:57:26.014683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1577/2996] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:25 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:27.036874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bcaec79e-1289-41e7-b3bb-47a3f7d65afc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:27.038153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bcaec79e-1289-41e7-b3bb-47a3f7d65afc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:27.044849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcaec79e-1289-41e7-b3bb-47a3f7d65afc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:27.045295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcaec79e-1289-41e7-b3bb-47a3f7d65afc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:27.046053 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcaec79e-1289-41e7-b3bb-47a3f7d65afc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:27.046487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcaec79e-1289-41e7-b3bb-47a3f7d65afc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:27.180691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bcaec79e-1289-41e7-b3bb-47a3f7d65afc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:27.188570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bcaec79e-1289-41e7-b3bb-47a3f7d65afc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.155532 Jul 25 19:57:27.189136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1420/2997] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:27 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:28.211092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-079ae3f9-dc2f-4e82-807c-428598740927 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:28.211721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-079ae3f9-dc2f-4e82-807c-428598740927 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:28.218348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-079ae3f9-dc2f-4e82-807c-428598740927 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:28.218832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-079ae3f9-dc2f-4e82-807c-428598740927 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:28.219618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-079ae3f9-dc2f-4e82-807c-428598740927 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:28.220059 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-079ae3f9-dc2f-4e82-807c-428598740927 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:28.356592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-079ae3f9-dc2f-4e82-807c-428598740927 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:28.364569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-079ae3f9-dc2f-4e82-807c-428598740927 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.158009 Jul 25 19:57:28.365408 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1578/2998] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:28 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:29.386748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e1a94fd-d3bc-41c0-af12-2de54024ef42 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:29.387350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e1a94fd-d3bc-41c0-af12-2de54024ef42 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:29.393860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e1a94fd-d3bc-41c0-af12-2de54024ef42 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:29.394307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e1a94fd-d3bc-41c0-af12-2de54024ef42 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:29.395078 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e1a94fd-d3bc-41c0-af12-2de54024ef42 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:29.395537 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e1a94fd-d3bc-41c0-af12-2de54024ef42 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:29.530974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1e1a94fd-d3bc-41c0-af12-2de54024ef42 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:29.540247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e1a94fd-d3bc-41c0-af12-2de54024ef42 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.157437 Jul 25 19:57:29.540834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1421/2999] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:29 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:30.563090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f41e3b08-adc4-4da4-97d9-1846b5feefc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:30.563789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f41e3b08-adc4-4da4-97d9-1846b5feefc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:30.571099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f41e3b08-adc4-4da4-97d9-1846b5feefc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:30.571575 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f41e3b08-adc4-4da4-97d9-1846b5feefc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:30.572361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f41e3b08-adc4-4da4-97d9-1846b5feefc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:30.572794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f41e3b08-adc4-4da4-97d9-1846b5feefc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:30.739481 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f41e3b08-adc4-4da4-97d9-1846b5feefc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:30.749597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f41e3b08-adc4-4da4-97d9-1846b5feefc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.190204 Jul 25 19:57:30.750183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1579/3000] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:30 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:31.773247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d872e71-5c96-4535-88c2-53276c5f5aab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:31.773899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d872e71-5c96-4535-88c2-53276c5f5aab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:31.780737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d872e71-5c96-4535-88c2-53276c5f5aab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:31.781184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d872e71-5c96-4535-88c2-53276c5f5aab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:31.781959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d872e71-5c96-4535-88c2-53276c5f5aab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:31.782395 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d872e71-5c96-4535-88c2-53276c5f5aab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:32.205449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d872e71-5c96-4535-88c2-53276c5f5aab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:32.214592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d872e71-5c96-4535-88c2-53276c5f5aab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.445632 Jul 25 19:57:32.215194 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1422/3001] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:31 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:33.236876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a57ca476-1278-4f0f-967a-f8ce5d0232f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:33.237513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a57ca476-1278-4f0f-967a-f8ce5d0232f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:33.245543 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a57ca476-1278-4f0f-967a-f8ce5d0232f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:33.246065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a57ca476-1278-4f0f-967a-f8ce5d0232f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:33.246827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a57ca476-1278-4f0f-967a-f8ce5d0232f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:33.247266 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a57ca476-1278-4f0f-967a-f8ce5d0232f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:33.411051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a57ca476-1278-4f0f-967a-f8ce5d0232f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:33.426865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a57ca476-1278-4f0f-967a-f8ce5d0232f6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.193450 Jul 25 19:57:33.427998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1580/3002] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:33 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:34.465670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48c8ae26-b779-4f80-98e1-4d4bf5185c05 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:34.466245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48c8ae26-b779-4f80-98e1-4d4bf5185c05 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:34.472729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48c8ae26-b779-4f80-98e1-4d4bf5185c05 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:34.473172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48c8ae26-b779-4f80-98e1-4d4bf5185c05 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:34.473936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48c8ae26-b779-4f80-98e1-4d4bf5185c05 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:34.474429 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48c8ae26-b779-4f80-98e1-4d4bf5185c05 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:34.622576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48c8ae26-b779-4f80-98e1-4d4bf5185c05 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:34.631873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48c8ae26-b779-4f80-98e1-4d4bf5185c05 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.170387 Jul 25 19:57:34.632465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1423/3003] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:34 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:35.657036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bb0750e0-4e25-4709-86af-20a15f400484 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:35.657646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bb0750e0-4e25-4709-86af-20a15f400484 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:35.666132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb0750e0-4e25-4709-86af-20a15f400484 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:35.666581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb0750e0-4e25-4709-86af-20a15f400484 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:35.667369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb0750e0-4e25-4709-86af-20a15f400484 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:35.667839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb0750e0-4e25-4709-86af-20a15f400484 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:35.817773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-bb0750e0-4e25-4709-86af-20a15f400484 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:35.827778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bb0750e0-4e25-4709-86af-20a15f400484 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.174624 Jul 25 19:57:35.828595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1581/3004] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:35 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:36.851305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-daefbe99-fc3b-400e-9d28-3718f9a12dfe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:36.851962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-daefbe99-fc3b-400e-9d28-3718f9a12dfe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:36.858892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-daefbe99-fc3b-400e-9d28-3718f9a12dfe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:36.859332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-daefbe99-fc3b-400e-9d28-3718f9a12dfe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:36.860149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-daefbe99-fc3b-400e-9d28-3718f9a12dfe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:36.860600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-daefbe99-fc3b-400e-9d28-3718f9a12dfe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:36.863469 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:37.007413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-daefbe99-fc3b-400e-9d28-3718f9a12dfe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:37.017573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-daefbe99-fc3b-400e-9d28-3718f9a12dfe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.170209 Jul 25 19:57:37.018155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1424/3005] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:36 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:38.040032 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-314463b6-b123-44d8-a268-8ff9e7d1464a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:38.040659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-314463b6-b123-44d8-a268-8ff9e7d1464a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:38.047856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-314463b6-b123-44d8-a268-8ff9e7d1464a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:38.048303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-314463b6-b123-44d8-a268-8ff9e7d1464a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:38.049074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-314463b6-b123-44d8-a268-8ff9e7d1464a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:38.049508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-314463b6-b123-44d8-a268-8ff9e7d1464a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:38.202963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-314463b6-b123-44d8-a268-8ff9e7d1464a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:38.213736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-314463b6-b123-44d8-a268-8ff9e7d1464a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.177842 Jul 25 19:57:38.214707 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1582/3006] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:38 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:39.240127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dd461083-368d-4037-90ec-e3fc2c5f0b6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:39.241108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dd461083-368d-4037-90ec-e3fc2c5f0b6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:39.251491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd461083-368d-4037-90ec-e3fc2c5f0b6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:39.252307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd461083-368d-4037-90ec-e3fc2c5f0b6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:39.253612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd461083-368d-4037-90ec-e3fc2c5f0b6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:39.254296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd461083-368d-4037-90ec-e3fc2c5f0b6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:39.462113 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd461083-368d-4037-90ec-e3fc2c5f0b6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:39.471259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dd461083-368d-4037-90ec-e3fc2c5f0b6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.235238 Jul 25 19:57:39.471901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1425/3007] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:39 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:40.498020 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5e14ef4c-38dd-4f5e-98fe-501563e39daa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:40.498828 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5e14ef4c-38dd-4f5e-98fe-501563e39daa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:40.507005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e14ef4c-38dd-4f5e-98fe-501563e39daa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:40.507661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e14ef4c-38dd-4f5e-98fe-501563e39daa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:40.509065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e14ef4c-38dd-4f5e-98fe-501563e39daa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:40.509833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5e14ef4c-38dd-4f5e-98fe-501563e39daa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:40.765760 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5e14ef4c-38dd-4f5e-98fe-501563e39daa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:40.774537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5e14ef4c-38dd-4f5e-98fe-501563e39daa tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.283271 Jul 25 19:57:40.775140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1583/3008] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:40 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:41.798326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a159aea3-eda3-4116-8938-db498276ea43 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:41.799225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a159aea3-eda3-4116-8938-db498276ea43 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:41.807564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a159aea3-eda3-4116-8938-db498276ea43 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:41.808187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a159aea3-eda3-4116-8938-db498276ea43 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:41.809021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a159aea3-eda3-4116-8938-db498276ea43 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:41.809499 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a159aea3-eda3-4116-8938-db498276ea43 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:42.023425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a159aea3-eda3-4116-8938-db498276ea43 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:42.033599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a159aea3-eda3-4116-8938-db498276ea43 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.239679 Jul 25 19:57:42.034564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1426/3009] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:41 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:43.068277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4dfb968d-e235-42d4-830b-75a1577bea59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:43.069138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4dfb968d-e235-42d4-830b-75a1577bea59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:43.076596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4dfb968d-e235-42d4-830b-75a1577bea59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:43.077046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4dfb968d-e235-42d4-830b-75a1577bea59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:43.077839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4dfb968d-e235-42d4-830b-75a1577bea59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:43.078280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4dfb968d-e235-42d4-830b-75a1577bea59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:43.265402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4dfb968d-e235-42d4-830b-75a1577bea59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:43.276229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4dfb968d-e235-42d4-830b-75a1577bea59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.211927 Jul 25 19:57:43.276832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1584/3010] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:43 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:44.307100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05ed9f08-138b-4684-b240-04838d17f893 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:44.307918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05ed9f08-138b-4684-b240-04838d17f893 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:44.316528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05ed9f08-138b-4684-b240-04838d17f893 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:44.317278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05ed9f08-138b-4684-b240-04838d17f893 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:44.318325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05ed9f08-138b-4684-b240-04838d17f893 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:44.318844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05ed9f08-138b-4684-b240-04838d17f893 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:44.473557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05ed9f08-138b-4684-b240-04838d17f893 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:44.482277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05ed9f08-138b-4684-b240-04838d17f893 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.181059 Jul 25 19:57:44.482874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1427/3011] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:44 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:57:45.506676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7f1ed513-bb13-4021-b933-92c434fa8046 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:45.507774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7f1ed513-bb13-4021-b933-92c434fa8046 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:45.514205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f1ed513-bb13-4021-b933-92c434fa8046 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:45.514655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f1ed513-bb13-4021-b933-92c434fa8046 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:45.515437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f1ed513-bb13-4021-b933-92c434fa8046 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:45.515908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7f1ed513-bb13-4021-b933-92c434fa8046 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:45.518835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=84 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:45.751741 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7f1ed513-bb13-4021-b933-92c434fa8046 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:45.763006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7f1ed513-bb13-4021-b933-92c434fa8046 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.260917 Jul 25 19:57:45.764056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1585/3012] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:45 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:46.794856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ca30976-3a85-4e9f-bd4d-1499d536d63c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:46.795598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ca30976-3a85-4e9f-bd4d-1499d536d63c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:46.803548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ca30976-3a85-4e9f-bd4d-1499d536d63c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:46.804029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ca30976-3a85-4e9f-bd4d-1499d536d63c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:46.804826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ca30976-3a85-4e9f-bd4d-1499d536d63c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:46.805266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ca30976-3a85-4e9f-bd4d-1499d536d63c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:46.981532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0ca30976-3a85-4e9f-bd4d-1499d536d63c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:46.990812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ca30976-3a85-4e9f-bd4d-1499d536d63c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.199771 Jul 25 19:57:46.991422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1428/3013] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:46 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:48.019268 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cd09ff3b-50aa-4c07-ad27-37b276c04d9c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:48.019924 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cd09ff3b-50aa-4c07-ad27-37b276c04d9c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:48.027307 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd09ff3b-50aa-4c07-ad27-37b276c04d9c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:48.027795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd09ff3b-50aa-4c07-ad27-37b276c04d9c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:48.028579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd09ff3b-50aa-4c07-ad27-37b276c04d9c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:48.029018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cd09ff3b-50aa-4c07-ad27-37b276c04d9c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:48.188444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cd09ff3b-50aa-4c07-ad27-37b276c04d9c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:48.199436 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cd09ff3b-50aa-4c07-ad27-37b276c04d9c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.183949 Jul 25 19:57:48.200419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1586/3014] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:48 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:49.230573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9b13031a-d8f8-4fe9-a2fa-18a917c69e74 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:49.231364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9b13031a-d8f8-4fe9-a2fa-18a917c69e74 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:49.235112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:49.244600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b13031a-d8f8-4fe9-a2fa-18a917c69e74 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:49.245299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b13031a-d8f8-4fe9-a2fa-18a917c69e74 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:49.246561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b13031a-d8f8-4fe9-a2fa-18a917c69e74 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:49.247214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b13031a-d8f8-4fe9-a2fa-18a917c69e74 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:49.398608 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9b13031a-d8f8-4fe9-a2fa-18a917c69e74 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:49.408684 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9b13031a-d8f8-4fe9-a2fa-18a917c69e74 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.182255 Jul 25 19:57:49.409465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1429/3015] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:49 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:50.438095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5d31e0d4-6db2-4fcf-992a-83923a36f9f5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:50.439158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5d31e0d4-6db2-4fcf-992a-83923a36f9f5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:50.443345 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=26 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:57:50.454073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d31e0d4-6db2-4fcf-992a-83923a36f9f5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:50.454978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d31e0d4-6db2-4fcf-992a-83923a36f9f5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:50.456558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d31e0d4-6db2-4fcf-992a-83923a36f9f5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:50.457440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d31e0d4-6db2-4fcf-992a-83923a36f9f5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:50.671584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5d31e0d4-6db2-4fcf-992a-83923a36f9f5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:50.681381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5d31e0d4-6db2-4fcf-992a-83923a36f9f5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.250517 Jul 25 19:57:50.681980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1587/3016] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:50 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:51.710351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-116eba67-53f1-4d08-a84e-fb603e3ffc19 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:51.711476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-116eba67-53f1-4d08-a84e-fb603e3ffc19 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:51.723544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-116eba67-53f1-4d08-a84e-fb603e3ffc19 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:51.724859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-116eba67-53f1-4d08-a84e-fb603e3ffc19 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:51.726256 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-116eba67-53f1-4d08-a84e-fb603e3ffc19 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:51.727084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-116eba67-53f1-4d08-a84e-fb603e3ffc19 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:51.912615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-116eba67-53f1-4d08-a84e-fb603e3ffc19 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:51.923562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-116eba67-53f1-4d08-a84e-fb603e3ffc19 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.220245 Jul 25 19:57:51.924405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1430/3017] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:51 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:52.952533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1db4e781-844d-42f8-ab51-b7886883eaa6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:52.953518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1db4e781-844d-42f8-ab51-b7886883eaa6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:52.961411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1db4e781-844d-42f8-ab51-b7886883eaa6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:52.962003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1db4e781-844d-42f8-ab51-b7886883eaa6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:52.962890 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1db4e781-844d-42f8-ab51-b7886883eaa6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:52.963415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1db4e781-844d-42f8-ab51-b7886883eaa6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:53.186179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1db4e781-844d-42f8-ab51-b7886883eaa6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:53.197338 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1db4e781-844d-42f8-ab51-b7886883eaa6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.252318 Jul 25 19:57:53.198083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1588/3018] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:54.225664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-216458b2-ed46-41eb-886a-d4102754fd3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:54.226667 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-216458b2-ed46-41eb-886a-d4102754fd3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:54.237961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-216458b2-ed46-41eb-886a-d4102754fd3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:54.238749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-216458b2-ed46-41eb-886a-d4102754fd3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:54.241345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-216458b2-ed46-41eb-886a-d4102754fd3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:54.242129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-216458b2-ed46-41eb-886a-d4102754fd3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:54.437696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-216458b2-ed46-41eb-886a-d4102754fd3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:54.448863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-216458b2-ed46-41eb-886a-d4102754fd3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.230125 Jul 25 19:57:54.449781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1431/3019] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:54 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:55.474934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c457a39e-5517-485f-9113-24e374dca98f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:55.475860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c457a39e-5517-485f-9113-24e374dca98f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:55.485094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c457a39e-5517-485f-9113-24e374dca98f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:55.485540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c457a39e-5517-485f-9113-24e374dca98f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:55.486326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c457a39e-5517-485f-9113-24e374dca98f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:55.486758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c457a39e-5517-485f-9113-24e374dca98f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:55.645576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c457a39e-5517-485f-9113-24e374dca98f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:55.654521 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c457a39e-5517-485f-9113-24e374dca98f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.186344 Jul 25 19:57:55.655121 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1589/3020] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:55 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:56.680370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b4c1c1a0-2e73-46ab-bde3-3aa126b23298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:56.681001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b4c1c1a0-2e73-46ab-bde3-3aa126b23298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:56.690475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4c1c1a0-2e73-46ab-bde3-3aa126b23298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:56.691580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4c1c1a0-2e73-46ab-bde3-3aa126b23298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:56.693119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4c1c1a0-2e73-46ab-bde3-3aa126b23298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:56.694846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4c1c1a0-2e73-46ab-bde3-3aa126b23298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:56.875008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b4c1c1a0-2e73-46ab-bde3-3aa126b23298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:56.885057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b4c1c1a0-2e73-46ab-bde3-3aa126b23298 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.209364 Jul 25 19:57:56.885683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1432/3021] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:56 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:57.913119 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-40cb0f13-2096-4e11-8a9b-3f421214087f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:57.914305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-40cb0f13-2096-4e11-8a9b-3f421214087f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:57.924826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40cb0f13-2096-4e11-8a9b-3f421214087f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:57.925598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40cb0f13-2096-4e11-8a9b-3f421214087f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:57.927690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40cb0f13-2096-4e11-8a9b-3f421214087f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:57.928548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40cb0f13-2096-4e11-8a9b-3f421214087f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:58.134532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-40cb0f13-2096-4e11-8a9b-3f421214087f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:58.150578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-40cb0f13-2096-4e11-8a9b-3f421214087f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.244711 Jul 25 19:57:58.151691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1590/3022] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:57 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:57:59.170517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48fa0cff-7360-41ef-adfd-6130b74cf19d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:59.171405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48fa0cff-7360-41ef-adfd-6130b74cf19d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:59.182178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48fa0cff-7360-41ef-adfd-6130b74cf19d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:59.182969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48fa0cff-7360-41ef-adfd-6130b74cf19d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:59.184494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48fa0cff-7360-41ef-adfd-6130b74cf19d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:59.185233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48fa0cff-7360-41ef-adfd-6130b74cf19d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:59.189576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-909e5800-b15d-467a-b201-316d24bd495b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:57:59.190417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-909e5800-b15d-467a-b201-316d24bd495b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:57:59.199120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-909e5800-b15d-467a-b201-316d24bd495b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:59.199724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-909e5800-b15d-467a-b201-316d24bd495b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:59.200655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-909e5800-b15d-467a-b201-316d24bd495b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:57:59.201278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-909e5800-b15d-467a-b201-316d24bd495b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:57:59.243925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48fa0cff-7360-41ef-adfd-6130b74cf19d tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/ips" status: 200 len: 148 microversion: 2.1 time: 0.077739 Jul 25 19:57:59.245149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1433/3023] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Jul 25 19:57:59 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/ips => generated 148 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:57:59.386464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-909e5800-b15d-467a-b201-316d24bd495b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:57:59.401517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-909e5800-b15d-467a-b201-316d24bd495b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.216406 Jul 25 19:57:59.402513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1591/3024] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:57:59 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:58:00.437144 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-70ce5704-af18-4c7f-b470-fa31a7bcfb4f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:00.437937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-70ce5704-af18-4c7f-b470-fa31a7bcfb4f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:00.446389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70ce5704-af18-4c7f-b470-fa31a7bcfb4f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:00.446841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70ce5704-af18-4c7f-b470-fa31a7bcfb4f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:00.447681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70ce5704-af18-4c7f-b470-fa31a7bcfb4f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:00.448122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70ce5704-af18-4c7f-b470-fa31a7bcfb4f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:00.637365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-70ce5704-af18-4c7f-b470-fa31a7bcfb4f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:00.647054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-70ce5704-af18-4c7f-b470-fa31a7bcfb4f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.215049 Jul 25 19:58:00.648154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1434/3025] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:00 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:01.685665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e97146c9-9cd2-4ef8-ab31-f7fa4c104237 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:01.686661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e97146c9-9cd2-4ef8-ab31-f7fa4c104237 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:01.693952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e97146c9-9cd2-4ef8-ab31-f7fa4c104237 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:01.694394 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e97146c9-9cd2-4ef8-ab31-f7fa4c104237 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:01.695186 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e97146c9-9cd2-4ef8-ab31-f7fa4c104237 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:01.695663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e97146c9-9cd2-4ef8-ab31-f7fa4c104237 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:02.033459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e97146c9-9cd2-4ef8-ab31-f7fa4c104237 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:02.052327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e97146c9-9cd2-4ef8-ab31-f7fa4c104237 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.371397 Jul 25 19:58:02.053315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1592/3026] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:01 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:03.082189 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e58cc6e-8b50-4ee4-9570-1e6f3e308784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:03.084390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e58cc6e-8b50-4ee4-9570-1e6f3e308784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:03.095186 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e58cc6e-8b50-4ee4-9570-1e6f3e308784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:03.095925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e58cc6e-8b50-4ee4-9570-1e6f3e308784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:03.097182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e58cc6e-8b50-4ee4-9570-1e6f3e308784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:03.097884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e58cc6e-8b50-4ee4-9570-1e6f3e308784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:03.264720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1e58cc6e-8b50-4ee4-9570-1e6f3e308784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:03.276360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e58cc6e-8b50-4ee4-9570-1e6f3e308784 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.201442 Jul 25 19:58:03.277304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1435/3027] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:03 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:04.300993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0cfd82e6-0f3b-43b0-8acf-c683ce08c810 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:04.302229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0cfd82e6-0f3b-43b0-8acf-c683ce08c810 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:04.312800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cfd82e6-0f3b-43b0-8acf-c683ce08c810 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:04.313319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cfd82e6-0f3b-43b0-8acf-c683ce08c810 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:04.314109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cfd82e6-0f3b-43b0-8acf-c683ce08c810 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:04.314538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0cfd82e6-0f3b-43b0-8acf-c683ce08c810 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:04.459879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0cfd82e6-0f3b-43b0-8acf-c683ce08c810 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:04.468289 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0cfd82e6-0f3b-43b0-8acf-c683ce08c810 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.173272 Jul 25 19:58:04.468856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1593/3028] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:04 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:05.494162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8446031e-0f0f-4284-a3c0-4cc04babc92a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:05.494749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8446031e-0f0f-4284-a3c0-4cc04babc92a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:05.502440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8446031e-0f0f-4284-a3c0-4cc04babc92a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:05.502973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8446031e-0f0f-4284-a3c0-4cc04babc92a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:05.503906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8446031e-0f0f-4284-a3c0-4cc04babc92a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:05.504387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8446031e-0f0f-4284-a3c0-4cc04babc92a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:05.658433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8446031e-0f0f-4284-a3c0-4cc04babc92a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:05.667629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8446031e-0f0f-4284-a3c0-4cc04babc92a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.179125 Jul 25 19:58:05.668289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1436/3029] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:05 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:06.692045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fa16ea4b-da7f-40b7-b987-0c87165d1a06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:06.693263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fa16ea4b-da7f-40b7-b987-0c87165d1a06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:06.703735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa16ea4b-da7f-40b7-b987-0c87165d1a06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:06.704207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa16ea4b-da7f-40b7-b987-0c87165d1a06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:06.705072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa16ea4b-da7f-40b7-b987-0c87165d1a06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:06.705582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fa16ea4b-da7f-40b7-b987-0c87165d1a06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:06.879226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fa16ea4b-da7f-40b7-b987-0c87165d1a06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:06.889397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fa16ea4b-da7f-40b7-b987-0c87165d1a06 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.201164 Jul 25 19:58:06.889993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1594/3030] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:06 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:07.914018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-187f4679-fb17-4cc6-9cc3-85161bb2babe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:07.914847 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-187f4679-fb17-4cc6-9cc3-85161bb2babe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:07.923216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-187f4679-fb17-4cc6-9cc3-85161bb2babe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:07.923774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-187f4679-fb17-4cc6-9cc3-85161bb2babe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:07.924657 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-187f4679-fb17-4cc6-9cc3-85161bb2babe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:07.925238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-187f4679-fb17-4cc6-9cc3-85161bb2babe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:07.929556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=76 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:58:08.105166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-187f4679-fb17-4cc6-9cc3-85161bb2babe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:08.120270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-187f4679-fb17-4cc6-9cc3-85161bb2babe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.210712 Jul 25 19:58:08.121295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1437/3031] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:07 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:09.156549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-59adb440-b117-4450-9368-6206ac6193ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:09.157267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-59adb440-b117-4450-9368-6206ac6193ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:09.165855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59adb440-b117-4450-9368-6206ac6193ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:09.166391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59adb440-b117-4450-9368-6206ac6193ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:09.167258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59adb440-b117-4450-9368-6206ac6193ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:09.167994 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-59adb440-b117-4450-9368-6206ac6193ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:09.363139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-59adb440-b117-4450-9368-6206ac6193ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:09.375071 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-59adb440-b117-4450-9368-6206ac6193ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.222113 Jul 25 19:58:09.376213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1595/3032] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:09 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:10.412734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-83904908-cb2a-47e1-abbe-45d0cd32702f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:10.413681 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-83904908-cb2a-47e1-abbe-45d0cd32702f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:10.420675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83904908-cb2a-47e1-abbe-45d0cd32702f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:10.421017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83904908-cb2a-47e1-abbe-45d0cd32702f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:10.421805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83904908-cb2a-47e1-abbe-45d0cd32702f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:10.422255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83904908-cb2a-47e1-abbe-45d0cd32702f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:10.591831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-83904908-cb2a-47e1-abbe-45d0cd32702f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:10.601480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-83904908-cb2a-47e1-abbe-45d0cd32702f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.193705 Jul 25 19:58:10.602080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1438/3033] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:10 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:11.625841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1c352ed6-11a7-4125-9216-5f6b5aeef615 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:11.626449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1c352ed6-11a7-4125-9216-5f6b5aeef615 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:11.633985 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c352ed6-11a7-4125-9216-5f6b5aeef615 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:11.634437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c352ed6-11a7-4125-9216-5f6b5aeef615 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:11.635228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c352ed6-11a7-4125-9216-5f6b5aeef615 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:11.635704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1c352ed6-11a7-4125-9216-5f6b5aeef615 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:11.794233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1c352ed6-11a7-4125-9216-5f6b5aeef615 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:11.806619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1c352ed6-11a7-4125-9216-5f6b5aeef615 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.182107 Jul 25 19:58:11.806619 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1596/3034] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:11 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:58:12.831959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-157935ce-5a8f-4664-b22b-20ea2f5d8a84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:12.833238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-157935ce-5a8f-4664-b22b-20ea2f5d8a84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:12.839731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-157935ce-5a8f-4664-b22b-20ea2f5d8a84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:12.840193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-157935ce-5a8f-4664-b22b-20ea2f5d8a84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:12.841083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-157935ce-5a8f-4664-b22b-20ea2f5d8a84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:12.841541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-157935ce-5a8f-4664-b22b-20ea2f5d8a84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:13.001957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-157935ce-5a8f-4664-b22b-20ea2f5d8a84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:13.011042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-157935ce-5a8f-4664-b22b-20ea2f5d8a84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.185840 Jul 25 19:58:13.011662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1439/3035] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:12 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:14.034141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-126d6c2e-3a4d-4e89-9d55-becfdede2790 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:14.034991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-126d6c2e-3a4d-4e89-9d55-becfdede2790 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:14.042063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-126d6c2e-3a4d-4e89-9d55-becfdede2790 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:14.042843 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-126d6c2e-3a4d-4e89-9d55-becfdede2790 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:14.043672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-126d6c2e-3a4d-4e89-9d55-becfdede2790 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:14.044120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-126d6c2e-3a4d-4e89-9d55-becfdede2790 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:14.224478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-126d6c2e-3a4d-4e89-9d55-becfdede2790 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:14.241379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-126d6c2e-3a4d-4e89-9d55-becfdede2790 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.211067 Jul 25 19:58:14.242012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1597/3036] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:14 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:15.269823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-53103592-0d38-4553-9be5-80a984c7273c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:15.271073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-53103592-0d38-4553-9be5-80a984c7273c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:15.277679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53103592-0d38-4553-9be5-80a984c7273c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:15.278126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53103592-0d38-4553-9be5-80a984c7273c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:15.278969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53103592-0d38-4553-9be5-80a984c7273c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:15.279338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53103592-0d38-4553-9be5-80a984c7273c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:15.370276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c24db03c-9fb2-45aa-b5ef-37399c2a0efa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:15.370942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c24db03c-9fb2-45aa-b5ef-37399c2a0efa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:15.378195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c24db03c-9fb2-45aa-b5ef-37399c2a0efa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:15.378532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c24db03c-9fb2-45aa-b5ef-37399c2a0efa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:15.379347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c24db03c-9fb2-45aa-b5ef-37399c2a0efa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:15.380094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c24db03c-9fb2-45aa-b5ef-37399c2a0efa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:15.412463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c24db03c-9fb2-45aa-b5ef-37399c2a0efa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Going to try to terminate instance {{(pid=117952) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:58:15.449601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-53103592-0d38-4553-9be5-80a984c7273c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:15.460198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-53103592-0d38-4553-9be5-80a984c7273c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.194091 Jul 25 19:58:15.461148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1440/3037] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:15 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:58:15.527225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c24db03c-9fb2-45aa-b5ef-37399c2a0efa tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "DELETE /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 204 len: 0 microversion: 2.1 time: 0.160584 Jul 25 19:58:15.529251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1598/3038] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:58:15 2022] DELETE /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:58:15.543900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1702a0fc-b671-4e39-baff-1e04feec40a7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:15.544616 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1702a0fc-b671-4e39-baff-1e04feec40a7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:15.552865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1702a0fc-b671-4e39-baff-1e04feec40a7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:15.553405 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1702a0fc-b671-4e39-baff-1e04feec40a7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:15.554596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1702a0fc-b671-4e39-baff-1e04feec40a7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:15.555121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1702a0fc-b671-4e39-baff-1e04feec40a7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:15.760664 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1702a0fc-b671-4e39-baff-1e04feec40a7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:15.771844 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1702a0fc-b671-4e39-baff-1e04feec40a7 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1508 microversion: 2.1 time: 0.236136 Jul 25 19:58:15.773002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1441/3039] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:15 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:16.484262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-db593c32-0fba-4ca4-afcc-19ae1a82c164 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:16.484840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-db593c32-0fba-4ca4-afcc-19ae1a82c164 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:16.493647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db593c32-0fba-4ca4-afcc-19ae1a82c164 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:16.493647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db593c32-0fba-4ca4-afcc-19ae1a82c164 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:16.494089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db593c32-0fba-4ca4-afcc-19ae1a82c164 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:16.494429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db593c32-0fba-4ca4-afcc-19ae1a82c164 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:16.510322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:58:16.735860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-db593c32-0fba-4ca4-afcc-19ae1a82c164 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:16.744878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-db593c32-0fba-4ca4-afcc-19ae1a82c164 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.264866 Jul 25 19:58:16.745461 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1599/3040] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:16 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:16.793241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-21c3033a-bf85-47c5-a39e-af1d85c642c0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:16.793948 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-21c3033a-bf85-47c5-a39e-af1d85c642c0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:16.801035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21c3033a-bf85-47c5-a39e-af1d85c642c0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:16.802084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21c3033a-bf85-47c5-a39e-af1d85c642c0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:16.802803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21c3033a-bf85-47c5-a39e-af1d85c642c0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:16.803242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21c3033a-bf85-47c5-a39e-af1d85c642c0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:17.059264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-21c3033a-bf85-47c5-a39e-af1d85c642c0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:17.072783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-dd420bca-3320-485c-884b-a92071b89219 req-2a451af1-e9fe-4173-9e38-fc2fa737d7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d9ed8-749b-4f5b-9128-ee1dfda6c899", "name": "network-vif-deleted", "tag": "10478694-66f5-4da9-97eb-15b49a4ea4db"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:58:17.089023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-21c3033a-bf85-47c5-a39e-af1d85c642c0 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 200 len: 1508 microversion: 2.1 time: 0.300060 Jul 25 19:58:17.090022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1442/3041] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:16 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 1508 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:17.094749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-dd420bca-3320-485c-884b-a92071b89219 req-2a451af1-e9fe-4173-9e38-fc2fa737d7a5 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:17.095767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-dd420bca-3320-485c-884b-a92071b89219 req-2a451af1-e9fe-4173-9e38-fc2fa737d7a5 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:17.117175 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-dd420bca-3320-485c-884b-a92071b89219 req-2a451af1-e9fe-4173-9e38-fc2fa737d7a5 service nova] Creating event network-vif-deleted:10478694-66f5-4da9-97eb-15b49a4ea4db for instance 330d9ed8-749b-4f5b-9128-ee1dfda6c899 on hv-cinder-85093 Jul 25 19:58:17.124965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-dd420bca-3320-485c-884b-a92071b89219 req-2a451af1-e9fe-4173-9e38-fc2fa737d7a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058167 Jul 25 19:58:17.125592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1600/3042] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:58:17.767591 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3af6e8c-6d67-471b-8b5c-4517a448ea16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:17.768224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e3af6e8c-6d67-471b-8b5c-4517a448ea16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:17.777442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3af6e8c-6d67-471b-8b5c-4517a448ea16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:17.778187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3af6e8c-6d67-471b-8b5c-4517a448ea16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:17.779460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3af6e8c-6d67-471b-8b5c-4517a448ea16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:17.780231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3af6e8c-6d67-471b-8b5c-4517a448ea16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:17.953456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e3af6e8c-6d67-471b-8b5c-4517a448ea16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:17.962003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e3af6e8c-6d67-471b-8b5c-4517a448ea16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.198494 Jul 25 19:58:17.962589 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1443/3043] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:17 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:18.115592 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-910983f4-346e-4e18-8dd2-2c05b6f532ed tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:18.116323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-910983f4-346e-4e18-8dd2-2c05b6f532ed tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 330d9ed8-749b-4f5b-9128-ee1dfda6c899] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:18.123241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-910983f4-346e-4e18-8dd2-2c05b6f532ed tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:18.123718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-910983f4-346e-4e18-8dd2-2c05b6f532ed tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:18.124484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-910983f4-346e-4e18-8dd2-2c05b6f532ed tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:18.124916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-910983f4-346e-4e18-8dd2-2c05b6f532ed tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:18.139999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-910983f4-346e-4e18-8dd2-2c05b6f532ed tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] HTTP exception thrown: Instance 330d9ed8-749b-4f5b-9128-ee1dfda6c899 could not be found. Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-910983f4-346e-4e18-8dd2-2c05b6f532ed tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Request method failure captured: Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 HTTP/1.1 Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u4RwW5XrdAmalLWu-UjzkASXjpbGu2tZCZNseD7o5gCL2MvafO83Ceyp8CzD6VSawdixpEu6Te-06ubcjM_akZE1w84nOz0pRGBVicrlyIKvweTflnG8JsSYE8lePqoD0UzsngGHIDlSlc_98FrrRZ7hUprBHShVFnl4VqzxdpY0uk Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 1df108d610134859919e6bf8903f6190 Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1334671139 Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 19:58:18.141705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1df108d610134859919e6bf8903f6190"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1df108d610134859919e6bf8903f6190"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1df108d610134859919e6bf8903f6190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1df108d610134859919e6bf8903f6190", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1334671139 Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 1df108d610134859919e6bf8903f6190 Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1334671139 Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-ServerRescueNegativeTestJSON-1334671139-project Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 0ed3ed6183d34c73ba40d13af037f838 Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1334671139-project Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 330d9ed8-749b-4f5b-9128-ee1dfda6c899 could not be found. Jul 25 19:58:18.143473 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '330d9ed8-749b-4f5b-9128-ee1dfda6c899'} Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330d9ed8-749b-4f5b-9128-ee1dfda6c899 could not be found. Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:58:18.144498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330d9ed8-749b-4f5b-9128-ee1dfda6c899 could not be found. Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330d9ed8-749b-4f5b-9128-ee1dfda6c899 could not be found. Jul 25 19:58:18.147051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:58:18.148579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-910983f4-346e-4e18-8dd2-2c05b6f532ed tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Returning 404 to user: Instance 330d9ed8-749b-4f5b-9128-ee1dfda6c899 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:58:18.148579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-910983f4-346e-4e18-8dd2-2c05b6f532ed tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899" status: 404 len: 111 microversion: 2.1 time: 0.032687 Jul 25 19:58:18.148579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1601/3044] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:18 2022] GET /compute/v2.1/servers/330d9ed8-749b-4f5b-9128-ee1dfda6c899 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:58:18.154157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9e5f7c70-1e1e-4071-ab61-183d8f790e7b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:18.154651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9e5f7c70-1e1e-4071-ab61-183d8f790e7b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:18.161679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e5f7c70-1e1e-4071-ab61-183d8f790e7b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:18.162250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e5f7c70-1e1e-4071-ab61-183d8f790e7b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:18.163013 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e5f7c70-1e1e-4071-ab61-183d8f790e7b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:18.163454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e5f7c70-1e1e-4071-ab61-183d8f790e7b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:18.193292 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9e5f7c70-1e1e-4071-ab61-183d8f790e7b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:58:18.299198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9e5f7c70-1e1e-4071-ab61-183d8f790e7b tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 204 len: 0 microversion: 2.1 time: 0.147936 Jul 25 19:58:18.300216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1444/3045] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 19:58:18 2022] DELETE /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:58:18.309927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-046d5c6d-f568-46ae-98e8-1cef9f60fcc1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:18.310612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-046d5c6d-f568-46ae-98e8-1cef9f60fcc1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:18.317111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-046d5c6d-f568-46ae-98e8-1cef9f60fcc1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:18.317653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-046d5c6d-f568-46ae-98e8-1cef9f60fcc1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:18.318459 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-046d5c6d-f568-46ae-98e8-1cef9f60fcc1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:18.318892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-046d5c6d-f568-46ae-98e8-1cef9f60fcc1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:18.468449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-046d5c6d-f568-46ae-98e8-1cef9f60fcc1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:18.478971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-046d5c6d-f568-46ae-98e8-1cef9f60fcc1 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1520 microversion: 2.1 time: 0.172926 Jul 25 19:58:18.479694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1602/3046] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:18 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:18.984969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-192653e3-831b-45ac-9fad-3dc5d2f8e317 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:18.985674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-192653e3-831b-45ac-9fad-3dc5d2f8e317 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:18.994018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-192653e3-831b-45ac-9fad-3dc5d2f8e317 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:18.994472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-192653e3-831b-45ac-9fad-3dc5d2f8e317 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:18.995454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-192653e3-831b-45ac-9fad-3dc5d2f8e317 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:18.996021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-192653e3-831b-45ac-9fad-3dc5d2f8e317 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:19.261227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-192653e3-831b-45ac-9fad-3dc5d2f8e317 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:19.273893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-192653e3-831b-45ac-9fad-3dc5d2f8e317 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.291650 Jul 25 19:58:19.273893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1445/3047] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:18 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:19.502444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-47fab148-f8a7-40f3-a86b-21dc388f027d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:19.503388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-47fab148-f8a7-40f3-a86b-21dc388f027d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:19.521076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47fab148-f8a7-40f3-a86b-21dc388f027d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:19.521697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47fab148-f8a7-40f3-a86b-21dc388f027d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:19.523374 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47fab148-f8a7-40f3-a86b-21dc388f027d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:19.523950 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-47fab148-f8a7-40f3-a86b-21dc388f027d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:19.577985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-56c03f1b-d32c-4f03-8551-50f05a9758ad req-6a6e59ea-54dd-4433-9bac-082073a8e658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4c5ca9-5dfe-4ed1-895e-a0db055e690a", "name": "network-vif-deleted", "tag": "7d926653-f589-4d60-aaac-79517984d5e8"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:58:19.588723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:58:19.596015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-56c03f1b-d32c-4f03-8551-50f05a9758ad req-6a6e59ea-54dd-4433-9bac-082073a8e658 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:19.596560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-56c03f1b-d32c-4f03-8551-50f05a9758ad req-6a6e59ea-54dd-4433-9bac-082073a8e658 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:19.613400 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-56c03f1b-d32c-4f03-8551-50f05a9758ad req-6a6e59ea-54dd-4433-9bac-082073a8e658 service nova] Creating event network-vif-deleted:7d926653-f589-4d60-aaac-79517984d5e8 for instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a on hv-cinder-85093 Jul 25 19:58:19.620280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-56c03f1b-d32c-4f03-8551-50f05a9758ad req-6a6e59ea-54dd-4433-9bac-082073a8e658 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045675 Jul 25 19:58:19.621348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1446/3048] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:58:19.633283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-47fab148-f8a7-40f3-a86b-21dc388f027d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed3ed6183d34c73ba40d13af037f838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df108d610134859919e6bf8903f6190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:19.641366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-47fab148-f8a7-40f3-a86b-21dc388f027d tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 200 len: 1478 microversion: 2.1 time: 0.143180 Jul 25 19:58:19.641945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1603/3049] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:19 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 1478 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:58:20.302123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66ec0c28-aa3f-4a06-9152-6b3fcac0ae82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:20.302123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66ec0c28-aa3f-4a06-9152-6b3fcac0ae82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:20.307731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66ec0c28-aa3f-4a06-9152-6b3fcac0ae82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:20.308255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66ec0c28-aa3f-4a06-9152-6b3fcac0ae82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:20.309151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66ec0c28-aa3f-4a06-9152-6b3fcac0ae82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:20.309649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66ec0c28-aa3f-4a06-9152-6b3fcac0ae82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:20.456103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66ec0c28-aa3f-4a06-9152-6b3fcac0ae82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:20.464692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66ec0c28-aa3f-4a06-9152-6b3fcac0ae82 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.172419 Jul 25 19:58:20.465269 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1447/3050] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:20 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:20.663328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a0d40eeb-9c58-4439-a297-eda60f0a7ea5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:20.663988 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a0d40eeb-9c58-4439-a297-eda60f0a7ea5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] [instance: 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:20.666256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:58:20.672098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a0d40eeb-9c58-4439-a297-eda60f0a7ea5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:20.672548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a0d40eeb-9c58-4439-a297-eda60f0a7ea5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:20.673315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a0d40eeb-9c58-4439-a297-eda60f0a7ea5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:20.673745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a0d40eeb-9c58-4439-a297-eda60f0a7ea5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:20.689083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-a0d40eeb-9c58-4439-a297-eda60f0a7ea5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] HTTP exception thrown: Instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a could not be found. Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a0d40eeb-9c58-4439-a297-eda60f0a7ea5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Request method failure captured: Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a HTTP/1.1 Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u4RwW5XrdAmalLWu-UjzkASXjpbGu2tZCZNseD7o5gCL2MvafO83Ceyp8CzD6VSawdixpEu6Te-06ubcjM_akZE1w84nOz0pRGBVicrlyIKvweTflnG8JsSYE8lePqoD0UzsngGHIDlSlc_98FrrRZ7hUprBHShVFnl4VqzxdpY0uk Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 1df108d610134859919e6bf8903f6190 Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1334671139 Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 19:58:20.690628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1df108d610134859919e6bf8903f6190"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1df108d610134859919e6bf8903f6190"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1df108d610134859919e6bf8903f6190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1df108d610134859919e6bf8903f6190", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1334671139 Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 1df108d610134859919e6bf8903f6190 Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1334671139 Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-ServerRescueNegativeTestJSON-1334671139-project Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 0ed3ed6183d34c73ba40d13af037f838 Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1334671139-project Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a could not be found. Jul 25 19:58:20.693753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '3e4c5ca9-5dfe-4ed1-895e-a0db055e690a'} Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a could not be found. Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:58:20.694623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a could not be found. Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a could not be found. Jul 25 19:58:20.696034 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 19:58:20.697278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a0d40eeb-9c58-4439-a297-eda60f0a7ea5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] Returning 404 to user: Instance 3e4c5ca9-5dfe-4ed1-895e-a0db055e690a could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:58:20.697278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a0d40eeb-9c58-4439-a297-eda60f0a7ea5 tempest-ServerRescueNegativeTestJSON-1334671139 tempest-ServerRescueNegativeTestJSON-1334671139-project] 10.222.0.18 "GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a" status: 404 len: 111 microversion: 2.1 time: 0.033652 Jul 25 19:58:20.697278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1604/3051] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:20 2022] GET /compute/v2.1/servers/3e4c5ca9-5dfe-4ed1-895e-a0db055e690a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:58:21.486299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b46f964-ffc1-4fe8-9c8f-cfcf0334443e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:21.487062 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b46f964-ffc1-4fe8-9c8f-cfcf0334443e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:21.494772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b46f964-ffc1-4fe8-9c8f-cfcf0334443e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:21.495213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b46f964-ffc1-4fe8-9c8f-cfcf0334443e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:21.496016 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b46f964-ffc1-4fe8-9c8f-cfcf0334443e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:21.496450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b46f964-ffc1-4fe8-9c8f-cfcf0334443e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:21.636449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b46f964-ffc1-4fe8-9c8f-cfcf0334443e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:21.645557 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b46f964-ffc1-4fe8-9c8f-cfcf0334443e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.162493 Jul 25 19:58:21.646150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1448/3052] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:21 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:22.668853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8be9074d-bfef-4853-9efe-2852df907e51 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:22.669682 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8be9074d-bfef-4853-9efe-2852df907e51 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:22.677576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8be9074d-bfef-4853-9efe-2852df907e51 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:22.678364 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8be9074d-bfef-4853-9efe-2852df907e51 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:22.679917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8be9074d-bfef-4853-9efe-2852df907e51 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:22.680660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8be9074d-bfef-4853-9efe-2852df907e51 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:22.912279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8be9074d-bfef-4853-9efe-2852df907e51 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:22.924445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8be9074d-bfef-4853-9efe-2852df907e51 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.257397 Jul 25 19:58:22.934663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1605/3053] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:22 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:23.945383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-93a2c00a-4c87-4bf7-a3cc-f7f6f111d363 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:23.946250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93a2c00a-4c87-4bf7-a3cc-f7f6f111d363 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:23.955768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93a2c00a-4c87-4bf7-a3cc-f7f6f111d363 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:23.956250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93a2c00a-4c87-4bf7-a3cc-f7f6f111d363 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:23.957295 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93a2c00a-4c87-4bf7-a3cc-f7f6f111d363 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:23.957720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93a2c00a-4c87-4bf7-a3cc-f7f6f111d363 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:24.129984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93a2c00a-4c87-4bf7-a3cc-f7f6f111d363 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:24.144231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-93a2c00a-4c87-4bf7-a3cc-f7f6f111d363 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.203812 Jul 25 19:58:24.153871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1449/3054] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:23 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:25.173825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c85770cd-5cbb-4bd0-9d0b-db87bed4ee84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:25.174447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c85770cd-5cbb-4bd0-9d0b-db87bed4ee84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:25.181437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c85770cd-5cbb-4bd0-9d0b-db87bed4ee84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:25.181887 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c85770cd-5cbb-4bd0-9d0b-db87bed4ee84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:25.182663 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c85770cd-5cbb-4bd0-9d0b-db87bed4ee84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:25.183357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c85770cd-5cbb-4bd0-9d0b-db87bed4ee84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:25.332273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c85770cd-5cbb-4bd0-9d0b-db87bed4ee84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:25.341882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c85770cd-5cbb-4bd0-9d0b-db87bed4ee84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.171808 Jul 25 19:58:25.342491 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1606/3055] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:25 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:26.370559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-07d2d325-21bf-4e60-a1f6-7a2e34a9fbd2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:26.371339 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-07d2d325-21bf-4e60-a1f6-7a2e34a9fbd2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:26.381058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07d2d325-21bf-4e60-a1f6-7a2e34a9fbd2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:26.381577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07d2d325-21bf-4e60-a1f6-7a2e34a9fbd2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:26.382474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07d2d325-21bf-4e60-a1f6-7a2e34a9fbd2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:26.383027 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07d2d325-21bf-4e60-a1f6-7a2e34a9fbd2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:26.564192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07d2d325-21bf-4e60-a1f6-7a2e34a9fbd2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:26.574581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-07d2d325-21bf-4e60-a1f6-7a2e34a9fbd2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.208997 Jul 25 19:58:26.575425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1450/3056] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:26 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:27.597155 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-18c69f53-bdb9-464c-9f88-230d147a03cb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:27.598689 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-18c69f53-bdb9-464c-9f88-230d147a03cb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:27.608317 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18c69f53-bdb9-464c-9f88-230d147a03cb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:27.608771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18c69f53-bdb9-464c-9f88-230d147a03cb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:27.609556 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18c69f53-bdb9-464c-9f88-230d147a03cb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:27.610064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-18c69f53-bdb9-464c-9f88-230d147a03cb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:27.843661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-18c69f53-bdb9-464c-9f88-230d147a03cb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:27.856699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-18c69f53-bdb9-464c-9f88-230d147a03cb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.263808 Jul 25 19:58:27.857288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1607/3057] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:27 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:28.878548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-63ffddb0-7a8d-4cd0-a973-1ef19544eb1d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:28.880073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-63ffddb0-7a8d-4cd0-a973-1ef19544eb1d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:28.886846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63ffddb0-7a8d-4cd0-a973-1ef19544eb1d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:28.887525 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63ffddb0-7a8d-4cd0-a973-1ef19544eb1d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:28.888374 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63ffddb0-7a8d-4cd0-a973-1ef19544eb1d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:28.888888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63ffddb0-7a8d-4cd0-a973-1ef19544eb1d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:29.117360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-63ffddb0-7a8d-4cd0-a973-1ef19544eb1d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:29.128677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-63ffddb0-7a8d-4cd0-a973-1ef19544eb1d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.253638 Jul 25 19:58:29.130017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1451/3058] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:28 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:30.151841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3d0bf59c-b6b5-4699-bbf3-f9b3c7d1d433 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:30.153110 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3d0bf59c-b6b5-4699-bbf3-f9b3c7d1d433 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:30.159454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d0bf59c-b6b5-4699-bbf3-f9b3c7d1d433 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:30.159935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d0bf59c-b6b5-4699-bbf3-f9b3c7d1d433 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:30.161696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d0bf59c-b6b5-4699-bbf3-f9b3c7d1d433 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:30.162091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d0bf59c-b6b5-4699-bbf3-f9b3c7d1d433 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:30.329438 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3d0bf59c-b6b5-4699-bbf3-f9b3c7d1d433 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:30.339465 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3d0bf59c-b6b5-4699-bbf3-f9b3c7d1d433 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.191553 Jul 25 19:58:30.340098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1608/3059] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:30 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:31.362403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4abc0b17-dd54-4b55-a2ca-8ed7e7b76677 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:31.363055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4abc0b17-dd54-4b55-a2ca-8ed7e7b76677 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:31.371402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4abc0b17-dd54-4b55-a2ca-8ed7e7b76677 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:31.371889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4abc0b17-dd54-4b55-a2ca-8ed7e7b76677 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:31.372755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4abc0b17-dd54-4b55-a2ca-8ed7e7b76677 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:31.373092 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4abc0b17-dd54-4b55-a2ca-8ed7e7b76677 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:31.554159 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4abc0b17-dd54-4b55-a2ca-8ed7e7b76677 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:31.557343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:58:31.564714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4abc0b17-dd54-4b55-a2ca-8ed7e7b76677 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.206154 Jul 25 19:58:31.565312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1452/3060] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:31 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:32.589136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c37b35a6-b674-414a-9010-ba3ea1ee6127 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:32.589782 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c37b35a6-b674-414a-9010-ba3ea1ee6127 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:32.596583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c37b35a6-b674-414a-9010-ba3ea1ee6127 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:32.597038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c37b35a6-b674-414a-9010-ba3ea1ee6127 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:32.598744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c37b35a6-b674-414a-9010-ba3ea1ee6127 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:32.599194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c37b35a6-b674-414a-9010-ba3ea1ee6127 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:32.742219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c37b35a6-b674-414a-9010-ba3ea1ee6127 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:32.750417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c37b35a6-b674-414a-9010-ba3ea1ee6127 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.165365 Jul 25 19:58:32.751015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1609/3061] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:32 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:33.777939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77d28488-40f9-452f-97bf-45e2d54c853e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:33.778977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-77d28488-40f9-452f-97bf-45e2d54c853e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:33.790565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77d28488-40f9-452f-97bf-45e2d54c853e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:33.791294 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77d28488-40f9-452f-97bf-45e2d54c853e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:33.792637 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77d28488-40f9-452f-97bf-45e2d54c853e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:33.793356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77d28488-40f9-452f-97bf-45e2d54c853e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:34.011102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-77d28488-40f9-452f-97bf-45e2d54c853e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:34.020990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-77d28488-40f9-452f-97bf-45e2d54c853e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.250568 Jul 25 19:58:34.021419 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1453/3062] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:33 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:35.044991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b1229363-50fe-4811-afd2-bd7e7ae2eff4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:35.046018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b1229363-50fe-4811-afd2-bd7e7ae2eff4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:35.053701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1229363-50fe-4811-afd2-bd7e7ae2eff4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:35.054139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1229363-50fe-4811-afd2-bd7e7ae2eff4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:35.054941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1229363-50fe-4811-afd2-bd7e7ae2eff4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:35.055358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1229363-50fe-4811-afd2-bd7e7ae2eff4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:35.217879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b1229363-50fe-4811-afd2-bd7e7ae2eff4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:35.227187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b1229363-50fe-4811-afd2-bd7e7ae2eff4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.186295 Jul 25 19:58:35.227837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1610/3063] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:35 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:36.257512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-545a20c1-6258-44e9-be6f-cfe3e524b186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:36.258290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-545a20c1-6258-44e9-be6f-cfe3e524b186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:36.269345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-545a20c1-6258-44e9-be6f-cfe3e524b186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:36.270478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-545a20c1-6258-44e9-be6f-cfe3e524b186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:36.271980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-545a20c1-6258-44e9-be6f-cfe3e524b186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:36.272752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-545a20c1-6258-44e9-be6f-cfe3e524b186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:36.441213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-545a20c1-6258-44e9-be6f-cfe3e524b186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:36.450222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-545a20c1-6258-44e9-be6f-cfe3e524b186 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.196979 Jul 25 19:58:36.450820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1454/3064] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:36 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:37.477375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5a58eaff-8379-41ee-9ab5-1e5385d2101e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:37.478332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5a58eaff-8379-41ee-9ab5-1e5385d2101e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:37.486174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a58eaff-8379-41ee-9ab5-1e5385d2101e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:37.486624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a58eaff-8379-41ee-9ab5-1e5385d2101e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:37.487546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a58eaff-8379-41ee-9ab5-1e5385d2101e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:37.487863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a58eaff-8379-41ee-9ab5-1e5385d2101e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:37.658587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5a58eaff-8379-41ee-9ab5-1e5385d2101e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:37.672758 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5a58eaff-8379-41ee-9ab5-1e5385d2101e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.202809 Jul 25 19:58:37.673700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1611/3065] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:37 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:38.697248 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-27c6a294-7f89-49d1-9f8c-9c57102ffd65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:38.698125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-27c6a294-7f89-49d1-9f8c-9c57102ffd65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:38.707779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27c6a294-7f89-49d1-9f8c-9c57102ffd65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:38.708248 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27c6a294-7f89-49d1-9f8c-9c57102ffd65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:38.709063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27c6a294-7f89-49d1-9f8c-9c57102ffd65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:38.709823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27c6a294-7f89-49d1-9f8c-9c57102ffd65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:38.900477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-27c6a294-7f89-49d1-9f8c-9c57102ffd65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:38.909306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-27c6a294-7f89-49d1-9f8c-9c57102ffd65 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.216175 Jul 25 19:58:38.910498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1455/3066] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:38 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:39.933095 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-048dfb7a-7991-4ddc-a104-58b53af48819 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:39.933649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-048dfb7a-7991-4ddc-a104-58b53af48819 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:39.941925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-048dfb7a-7991-4ddc-a104-58b53af48819 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:39.942487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-048dfb7a-7991-4ddc-a104-58b53af48819 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:39.943260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-048dfb7a-7991-4ddc-a104-58b53af48819 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:39.943810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-048dfb7a-7991-4ddc-a104-58b53af48819 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:40.149396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-048dfb7a-7991-4ddc-a104-58b53af48819 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:40.160763 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-048dfb7a-7991-4ddc-a104-58b53af48819 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.230852 Jul 25 19:58:40.162821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1612/3067] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:39 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:58:41.189516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-061285c0-006d-4eb1-bdfd-69706b980d97 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:41.190126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-061285c0-006d-4eb1-bdfd-69706b980d97 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:41.196897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-061285c0-006d-4eb1-bdfd-69706b980d97 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:41.197348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-061285c0-006d-4eb1-bdfd-69706b980d97 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:41.198145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-061285c0-006d-4eb1-bdfd-69706b980d97 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:41.198566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-061285c0-006d-4eb1-bdfd-69706b980d97 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:41.355916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-061285c0-006d-4eb1-bdfd-69706b980d97 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:41.365899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-061285c0-006d-4eb1-bdfd-69706b980d97 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.180182 Jul 25 19:58:41.366495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1456/3068] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:41 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:42.388413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-befadf58-b8b3-4eed-8f00-2190d38af5da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:42.389369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-befadf58-b8b3-4eed-8f00-2190d38af5da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:42.396658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-befadf58-b8b3-4eed-8f00-2190d38af5da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:42.397111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-befadf58-b8b3-4eed-8f00-2190d38af5da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:42.398303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-befadf58-b8b3-4eed-8f00-2190d38af5da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:42.398894 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-befadf58-b8b3-4eed-8f00-2190d38af5da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:42.647844 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-befadf58-b8b3-4eed-8f00-2190d38af5da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:42.656736 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-befadf58-b8b3-4eed-8f00-2190d38af5da tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.272144 Jul 25 19:58:42.657322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1613/3069] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:42 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:43.681533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e06888ce-4767-47fe-89e9-96e788e49c01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:43.682348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e06888ce-4767-47fe-89e9-96e788e49c01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:43.688439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e06888ce-4767-47fe-89e9-96e788e49c01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:43.688895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e06888ce-4767-47fe-89e9-96e788e49c01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:43.689679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e06888ce-4767-47fe-89e9-96e788e49c01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:43.690121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e06888ce-4767-47fe-89e9-96e788e49c01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:43.840804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e06888ce-4767-47fe-89e9-96e788e49c01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:43.850768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e06888ce-4767-47fe-89e9-96e788e49c01 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.173505 Jul 25 19:58:43.851888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1457/3070] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:43 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:44.874371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0011f6a9-e574-4b1d-b4e6-302d26cb3a16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:44.874981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0011f6a9-e574-4b1d-b4e6-302d26cb3a16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:44.882282 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0011f6a9-e574-4b1d-b4e6-302d26cb3a16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:44.882719 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0011f6a9-e574-4b1d-b4e6-302d26cb3a16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:44.883493 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0011f6a9-e574-4b1d-b4e6-302d26cb3a16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:44.883957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0011f6a9-e574-4b1d-b4e6-302d26cb3a16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:45.032302 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0011f6a9-e574-4b1d-b4e6-302d26cb3a16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:45.041873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0011f6a9-e574-4b1d-b4e6-302d26cb3a16 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.171269 Jul 25 19:58:45.042453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1614/3071] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:44 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:46.065485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8dd2f7d2-c255-46b9-9380-6ee864214cdd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:46.066119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8dd2f7d2-c255-46b9-9380-6ee864214cdd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:46.074505 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dd2f7d2-c255-46b9-9380-6ee864214cdd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:46.074946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dd2f7d2-c255-46b9-9380-6ee864214cdd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:46.075780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dd2f7d2-c255-46b9-9380-6ee864214cdd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:46.076213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dd2f7d2-c255-46b9-9380-6ee864214cdd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:46.249390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8dd2f7d2-c255-46b9-9380-6ee864214cdd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:46.258813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8dd2f7d2-c255-46b9-9380-6ee864214cdd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.197286 Jul 25 19:58:46.259410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1458/3072] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:46 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:47.286455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6bc105c7-e6bb-47d9-ad0b-a392c0576c80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:47.287086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6bc105c7-e6bb-47d9-ad0b-a392c0576c80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:47.294621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6bc105c7-e6bb-47d9-ad0b-a392c0576c80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:47.295067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6bc105c7-e6bb-47d9-ad0b-a392c0576c80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:47.295881 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6bc105c7-e6bb-47d9-ad0b-a392c0576c80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:47.296322 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6bc105c7-e6bb-47d9-ad0b-a392c0576c80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:47.299357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=84 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:58:47.450082 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6bc105c7-e6bb-47d9-ad0b-a392c0576c80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:47.458915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6bc105c7-e6bb-47d9-ad0b-a392c0576c80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.176568 Jul 25 19:58:47.459500 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1615/3073] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:47 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:48.483657 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f82c1a9-b7c0-45e7-9b17-65d100aa71e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:48.484233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8f82c1a9-b7c0-45e7-9b17-65d100aa71e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:48.491541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f82c1a9-b7c0-45e7-9b17-65d100aa71e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:48.492005 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f82c1a9-b7c0-45e7-9b17-65d100aa71e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:48.492781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f82c1a9-b7c0-45e7-9b17-65d100aa71e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:48.493225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f82c1a9-b7c0-45e7-9b17-65d100aa71e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:48.640136 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f82c1a9-b7c0-45e7-9b17-65d100aa71e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:48.649187 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8f82c1a9-b7c0-45e7-9b17-65d100aa71e8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.169354 Jul 25 19:58:48.650217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1459/3074] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:48 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:49.674757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6ac2d5d0-edff-477e-bb4e-4cfc906dd55d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:49.676118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6ac2d5d0-edff-477e-bb4e-4cfc906dd55d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:49.683479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ac2d5d0-edff-477e-bb4e-4cfc906dd55d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:49.683953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ac2d5d0-edff-477e-bb4e-4cfc906dd55d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:49.684724 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ac2d5d0-edff-477e-bb4e-4cfc906dd55d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:49.685159 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6ac2d5d0-edff-477e-bb4e-4cfc906dd55d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:49.828678 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6ac2d5d0-edff-477e-bb4e-4cfc906dd55d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:49.837412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6ac2d5d0-edff-477e-bb4e-4cfc906dd55d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.167151 Jul 25 19:58:49.838008 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1616/3075] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:49 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:58:50.859777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-53a26602-dea1-4de4-8970-16cebb3d013b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:50.860423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-53a26602-dea1-4de4-8970-16cebb3d013b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:50.863058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=28 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:58:50.869361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53a26602-dea1-4de4-8970-16cebb3d013b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:50.869813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53a26602-dea1-4de4-8970-16cebb3d013b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:50.870696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53a26602-dea1-4de4-8970-16cebb3d013b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:50.871161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53a26602-dea1-4de4-8970-16cebb3d013b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:51.021253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-53a26602-dea1-4de4-8970-16cebb3d013b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:51.029698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-53a26602-dea1-4de4-8970-16cebb3d013b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.173944 Jul 25 19:58:51.030280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1460/3076] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:50 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:52.054101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d8a22aeb-0242-4ae8-9520-598cca490489 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:52.054837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d8a22aeb-0242-4ae8-9520-598cca490489 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:52.057219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=26 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:58:52.062729 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8a22aeb-0242-4ae8-9520-598cca490489 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:52.063189 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8a22aeb-0242-4ae8-9520-598cca490489 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:52.063971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8a22aeb-0242-4ae8-9520-598cca490489 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:52.064404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d8a22aeb-0242-4ae8-9520-598cca490489 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:52.220035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d8a22aeb-0242-4ae8-9520-598cca490489 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:52.229323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d8a22aeb-0242-4ae8-9520-598cca490489 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.180440 Jul 25 19:58:52.229915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1617/3077] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:58:52.939703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-54c80686-6b62-4220-93f7-212f68f7c20a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:52.941130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-54c80686-6b62-4220-93f7-212f68f7c20a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:52.948147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54c80686-6b62-4220-93f7-212f68f7c20a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:52.948593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54c80686-6b62-4220-93f7-212f68f7c20a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:52.949655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54c80686-6b62-4220-93f7-212f68f7c20a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:52.950323 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54c80686-6b62-4220-93f7-212f68f7c20a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:52.984738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-54c80686-6b62-4220-93f7-212f68f7c20a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:58:53.083833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-54c80686-6b62-4220-93f7-212f68f7c20a tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 204 len: 0 microversion: 2.20 time: 0.147464 Jul 25 19:58:53.087638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1461/3078] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Jul 25 19:58:52 2022] DELETE /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 19:58:53.095049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8430c229-ce9f-49c3-a2a6-4c55517b7c16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:53.095714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8430c229-ce9f-49c3-a2a6-4c55517b7c16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:53.105599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8430c229-ce9f-49c3-a2a6-4c55517b7c16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:53.106101 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8430c229-ce9f-49c3-a2a6-4c55517b7c16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:53.106916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8430c229-ce9f-49c3-a2a6-4c55517b7c16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:53.107361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8430c229-ce9f-49c3-a2a6-4c55517b7c16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:53.254511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9a64bb6f-86f2-4ee6-a7e5-47f76a68426e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:53.255216 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9a64bb6f-86f2-4ee6-a7e5-47f76a68426e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:53.262176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a64bb6f-86f2-4ee6-a7e5-47f76a68426e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:53.263002 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a64bb6f-86f2-4ee6-a7e5-47f76a68426e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:53.264317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a64bb6f-86f2-4ee6-a7e5-47f76a68426e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:53.265068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a64bb6f-86f2-4ee6-a7e5-47f76a68426e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:53.276895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8430c229-ce9f-49c3-a2a6-4c55517b7c16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:53.285699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8430c229-ce9f-49c3-a2a6-4c55517b7c16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:53.287385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8430c229-ce9f-49c3-a2a6-4c55517b7c16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:53.288622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8430c229-ce9f-49c3-a2a6-4c55517b7c16 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1720 microversion: 2.20 time: 0.198918 Jul 25 19:58:53.289181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1618/3079] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:58:53 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:58:53.451265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9a64bb6f-86f2-4ee6-a7e5-47f76a68426e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:53.463855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9a64bb6f-86f2-4ee6-a7e5-47f76a68426e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.214929 Jul 25 19:58:53.464595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1462/3080] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:53 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:54.327265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-91a7f9ff-533d-409d-9111-c4b415beedb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:54.328725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-91a7f9ff-533d-409d-9111-c4b415beedb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:54.337127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91a7f9ff-533d-409d-9111-c4b415beedb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:54.338531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91a7f9ff-533d-409d-9111-c4b415beedb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:54.339943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91a7f9ff-533d-409d-9111-c4b415beedb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:54.340629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-91a7f9ff-533d-409d-9111-c4b415beedb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:54.495325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-701adbd4-8722-49de-93f8-0475bc072b02 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:54.496007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-701adbd4-8722-49de-93f8-0475bc072b02 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:54.505392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-701adbd4-8722-49de-93f8-0475bc072b02 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:54.505849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-701adbd4-8722-49de-93f8-0475bc072b02 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:54.506854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-701adbd4-8722-49de-93f8-0475bc072b02 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:54.507302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-701adbd4-8722-49de-93f8-0475bc072b02 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:54.727727 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-91a7f9ff-533d-409d-9111-c4b415beedb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:54.737301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-91a7f9ff-533d-409d-9111-c4b415beedb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:54.741695 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-91a7f9ff-533d-409d-9111-c4b415beedb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:54.742956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-91a7f9ff-533d-409d-9111-c4b415beedb2 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1720 microversion: 2.20 time: 0.425315 Jul 25 19:58:54.744474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1619/3081] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:58:54 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1720 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:58:54.796034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-701adbd4-8722-49de-93f8-0475bc072b02 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:54.805788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-701adbd4-8722-49de-93f8-0475bc072b02 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.321818 Jul 25 19:58:54.806819 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1463/3082] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:54 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:55.255278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-44d8b562-c9bd-4476-bcda-446d020b7df6 req-92b6471e-720b-4afb-961d-b85b31cf9683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df24471-2352-4e79-be15-e395eabf66e8", "name": "network-vif-deleted", "tag": "a3db8d82-3435-4460-803e-926d12177856"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:58:55.271893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-44d8b562-c9bd-4476-bcda-446d020b7df6 req-92b6471e-720b-4afb-961d-b85b31cf9683 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:55.272467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-44d8b562-c9bd-4476-bcda-446d020b7df6 req-92b6471e-720b-4afb-961d-b85b31cf9683 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:55.285547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-44d8b562-c9bd-4476-bcda-446d020b7df6 req-92b6471e-720b-4afb-961d-b85b31cf9683 service nova] Creating event network-vif-deleted:a3db8d82-3435-4460-803e-926d12177856 for instance 2df24471-2352-4e79-be15-e395eabf66e8 on hv-cinder-85093 Jul 25 19:58:55.292039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-44d8b562-c9bd-4476-bcda-446d020b7df6 req-92b6471e-720b-4afb-961d-b85b31cf9683 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044457 Jul 25 19:58:55.293066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1620/3083] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 19:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:58:55.773269 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:55.776164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:55.786359 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:55.787044 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:55.788293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:55.788748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:55.829763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:55.830215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:55.830879 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lazy-loading 'fault' on Instance uuid 2df24471-2352-4e79-be15-e395eabf66e8 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:58:55.835202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-685fb93b-8dcf-436d-b081-bd15ee548f3c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:55.837642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-685fb93b-8dcf-436d-b081-bd15ee548f3c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:55.849026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-685fb93b-8dcf-436d-b081-bd15ee548f3c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:55.849928 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-685fb93b-8dcf-436d-b081-bd15ee548f3c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:55.851048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-685fb93b-8dcf-436d-b081-bd15ee548f3c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:55.851937 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-685fb93b-8dcf-436d-b081-bd15ee548f3c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:55.926410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:55.946350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:55.961856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2e584f88cd46f280b7fe04aa1382fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef063ca1eb846d78ff8901d2a3fc0a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:55.965937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aa084019-a2fd-4f74-a9ab-18d30f2cf101 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 200 len: 1367 microversion: 2.20 time: 0.197500 Jul 25 19:58:55.969765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1464/3084] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:58:55 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:58:56.075855 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-685fb93b-8dcf-436d-b081-bd15ee548f3c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:56.088824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-685fb93b-8dcf-436d-b081-bd15ee548f3c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.263102 Jul 25 19:58:56.090125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1621/3085] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:55 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:56.995585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-63e0618a-17e4-4191-a6f0-02a5c2a6b158 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:56.996261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-63e0618a-17e4-4191-a6f0-02a5c2a6b158 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:57.004259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e0618a-17e4-4191-a6f0-02a5c2a6b158 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:57.005235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e0618a-17e4-4191-a6f0-02a5c2a6b158 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:57.006072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e0618a-17e4-4191-a6f0-02a5c2a6b158 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:57.006657 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e0618a-17e4-4191-a6f0-02a5c2a6b158 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:57.026757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-63e0618a-17e4-4191-a6f0-02a5c2a6b158 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] HTTP exception thrown: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-63e0618a-17e4-4191-a6f0-02a5c2a6b158 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Request method failure captured: Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 HTTP/1.1 Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u389jrmBnFdq0d4Fb_QneBmvFS3U6iO7d6ZbyfNOsvEyFIEO5HLyG9aj20qJwgM9KwwqJWQTvRdI0DCncJdkA33gS33QZo48b7hNXnnUfQt90mh5iuRuc7DvEakocyEqZmtgfH4oZ8XKMFTF0iGtFOvlyTBwn7OfjF3H_xkAEBbgus Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 5ef063ca1eb846d78ff8901d2a3fc0a3 Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 19:58:57.028676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ef063ca1eb846d78ff8901d2a3fc0a3", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 5ef063ca1eb846d78ff8901d2a3fc0a3 Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeShelveTestJSON-1599472047-project Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: ac2e584f88cd46f280b7fe04aa1382fd Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599472047-project Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 19:58:57.031478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '2df24471-2352-4e79-be15-e395eabf66e8'} Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:58:57.033029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 19:58:57.035778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 19:58:57.038452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-63e0618a-17e4-4191-a6f0-02a5c2a6b158 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Returning 404 to user: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:58:57.038452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-63e0618a-17e4-4191-a6f0-02a5c2a6b158 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 404 len: 111 microversion: 2.20 time: 0.039186 Jul 25 19:58:57.038452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1465/3086] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 19:58:56 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:58:57.040380 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-08fe0e20-5c22-40ce-b860-5d2e5b3280ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '.version_select at 0x7feafb36de50>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:57.062686 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-08fe0e20-5c22-40ce-b860-5d2e5b3280ec tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7386311" status: 204 len: 0 microversion: 2.20 time: 0.026740 Jul 25 19:58:57.063471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1622/3087] 10.222.0.18 () {60 vars in 1253 bytes} [Mon Jul 25 19:58:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7386311 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 19:58:57.120598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c6dd525-edb4-4058-9f0d-df8dd4df0f8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:57.121790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c6dd525-edb4-4058-9f0d-df8dd4df0f8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:57.134306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c6dd525-edb4-4058-9f0d-df8dd4df0f8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:57.135409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c6dd525-edb4-4058-9f0d-df8dd4df0f8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:57.136876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c6dd525-edb4-4058-9f0d-df8dd4df0f8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:57.137679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c6dd525-edb4-4058-9f0d-df8dd4df0f8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:57.343959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c6dd525-edb4-4058-9f0d-df8dd4df0f8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:57.353370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c6dd525-edb4-4058-9f0d-df8dd4df0f8b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.240736 Jul 25 19:58:57.354606 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1466/3088] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:57 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:58.377746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3fa9eaeb-1ca0-412d-9d3b-ac4d25fc1a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:58.378865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3fa9eaeb-1ca0-412d-9d3b-ac4d25fc1a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:58.387206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3fa9eaeb-1ca0-412d-9d3b-ac4d25fc1a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:58.387823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3fa9eaeb-1ca0-412d-9d3b-ac4d25fc1a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:58.388609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3fa9eaeb-1ca0-412d-9d3b-ac4d25fc1a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:58.389172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3fa9eaeb-1ca0-412d-9d3b-ac4d25fc1a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:58.542841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3fa9eaeb-1ca0-412d-9d3b-ac4d25fc1a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:58.554201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3fa9eaeb-1ca0-412d-9d3b-ac4d25fc1a85 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.180480 Jul 25 19:58:58.554823 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1623/3089] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:58 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:58:59.577591 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b2fdb015-f171-406b-b973-bf6f3a1dcf0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:58:59.578211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b2fdb015-f171-406b-b973-bf6f3a1dcf0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:58:59.586040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2fdb015-f171-406b-b973-bf6f3a1dcf0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:59.586487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2fdb015-f171-406b-b973-bf6f3a1dcf0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:59.587263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2fdb015-f171-406b-b973-bf6f3a1dcf0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:58:59.587737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2fdb015-f171-406b-b973-bf6f3a1dcf0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:58:59.730221 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2fdb015-f171-406b-b973-bf6f3a1dcf0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:58:59.740946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b2fdb015-f171-406b-b973-bf6f3a1dcf0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.166512 Jul 25 19:58:59.741546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1467/3090] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:58:59 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:00.766383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5edb66dd-0528-4ef6-9918-0479b6b52ecb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:00.767625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5edb66dd-0528-4ef6-9918-0479b6b52ecb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:00.777705 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5edb66dd-0528-4ef6-9918-0479b6b52ecb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:00.778156 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5edb66dd-0528-4ef6-9918-0479b6b52ecb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:00.779097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5edb66dd-0528-4ef6-9918-0479b6b52ecb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:00.779568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5edb66dd-0528-4ef6-9918-0479b6b52ecb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:00.951096 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5edb66dd-0528-4ef6-9918-0479b6b52ecb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:00.960628 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5edb66dd-0528-4ef6-9918-0479b6b52ecb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.200576 Jul 25 19:59:00.961227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1624/3091] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:00 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:01.984327 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-09fe85ae-bc65-420f-8ad3-c520ff2b5224 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:01.985334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-09fe85ae-bc65-420f-8ad3-c520ff2b5224 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:01.994095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09fe85ae-bc65-420f-8ad3-c520ff2b5224 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:01.994533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09fe85ae-bc65-420f-8ad3-c520ff2b5224 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:01.995299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09fe85ae-bc65-420f-8ad3-c520ff2b5224 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:01.995763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09fe85ae-bc65-420f-8ad3-c520ff2b5224 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:01.998579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:59:02.417575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-09fe85ae-bc65-420f-8ad3-c520ff2b5224 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:02.426273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-09fe85ae-bc65-420f-8ad3-c520ff2b5224 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.447681 Jul 25 19:59:02.426859 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1468/3092] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:01 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:59:03.450590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1152e2bb-05f3-4c54-b848-977ab8f835d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:03.451219 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1152e2bb-05f3-4c54-b848-977ab8f835d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:03.458614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1152e2bb-05f3-4c54-b848-977ab8f835d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:03.459094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1152e2bb-05f3-4c54-b848-977ab8f835d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:03.459951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1152e2bb-05f3-4c54-b848-977ab8f835d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:03.460445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1152e2bb-05f3-4c54-b848-977ab8f835d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:03.599562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1152e2bb-05f3-4c54-b848-977ab8f835d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:03.608241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1152e2bb-05f3-4c54-b848-977ab8f835d5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.161713 Jul 25 19:59:03.608827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1625/3093] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:03 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:04.631112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7208d496-9a42-4df7-adb0-e5de48871df5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:04.631972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7208d496-9a42-4df7-adb0-e5de48871df5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:04.638148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7208d496-9a42-4df7-adb0-e5de48871df5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:04.638602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7208d496-9a42-4df7-adb0-e5de48871df5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:04.639378 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7208d496-9a42-4df7-adb0-e5de48871df5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:04.639855 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7208d496-9a42-4df7-adb0-e5de48871df5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:04.790663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7208d496-9a42-4df7-adb0-e5de48871df5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:04.800755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7208d496-9a42-4df7-adb0-e5de48871df5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.173977 Jul 25 19:59:04.801233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1469/3094] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:04 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:05.822811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-54c4ae2a-e97a-4123-8607-25e3dd9f92c3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:05.823440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-54c4ae2a-e97a-4123-8607-25e3dd9f92c3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:05.830217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54c4ae2a-e97a-4123-8607-25e3dd9f92c3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:05.830661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54c4ae2a-e97a-4123-8607-25e3dd9f92c3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:05.831692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54c4ae2a-e97a-4123-8607-25e3dd9f92c3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:05.832344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-54c4ae2a-e97a-4123-8607-25e3dd9f92c3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:05.978892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-54c4ae2a-e97a-4123-8607-25e3dd9f92c3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:05.988911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-54c4ae2a-e97a-4123-8607-25e3dd9f92c3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.168484 Jul 25 19:59:05.989519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1626/3095] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:05 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:07.012523 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0f6db527-4db1-49b7-8b42-34c88a63977b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:07.013190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0f6db527-4db1-49b7-8b42-34c88a63977b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:07.021633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6db527-4db1-49b7-8b42-34c88a63977b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:07.022087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6db527-4db1-49b7-8b42-34c88a63977b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:07.022877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6db527-4db1-49b7-8b42-34c88a63977b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:07.023314 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6db527-4db1-49b7-8b42-34c88a63977b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:07.189068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f6db527-4db1-49b7-8b42-34c88a63977b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:07.200104 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0f6db527-4db1-49b7-8b42-34c88a63977b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.191333 Jul 25 19:59:07.200683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1470/3096] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:07 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:08.222469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3aa21a75-1f59-4bf7-b690-8a126e830e39 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:08.223089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3aa21a75-1f59-4bf7-b690-8a126e830e39 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:08.229792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3aa21a75-1f59-4bf7-b690-8a126e830e39 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:08.230246 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3aa21a75-1f59-4bf7-b690-8a126e830e39 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:08.231022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3aa21a75-1f59-4bf7-b690-8a126e830e39 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:08.231460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3aa21a75-1f59-4bf7-b690-8a126e830e39 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:08.395841 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3aa21a75-1f59-4bf7-b690-8a126e830e39 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:08.404784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3aa21a75-1f59-4bf7-b690-8a126e830e39 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.186048 Jul 25 19:59:08.405381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1627/3097] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:08 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:09.426753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f8d71f7-4f09-4c44-8195-004bae80ea00 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:09.427674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8f8d71f7-4f09-4c44-8195-004bae80ea00 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:09.434365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8d71f7-4f09-4c44-8195-004bae80ea00 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:09.434894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8d71f7-4f09-4c44-8195-004bae80ea00 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:09.435760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8d71f7-4f09-4c44-8195-004bae80ea00 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:09.436185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8d71f7-4f09-4c44-8195-004bae80ea00 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:09.601164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f8d71f7-4f09-4c44-8195-004bae80ea00 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:09.611158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8f8d71f7-4f09-4c44-8195-004bae80ea00 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.188870 Jul 25 19:59:09.611831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1471/3098] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:09 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:10.639692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e8bd12c9-26dc-4141-9211-74ad16cef184 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:10.640835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e8bd12c9-26dc-4141-9211-74ad16cef184 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:10.652026 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8bd12c9-26dc-4141-9211-74ad16cef184 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:10.652448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8bd12c9-26dc-4141-9211-74ad16cef184 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:10.653425 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8bd12c9-26dc-4141-9211-74ad16cef184 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:10.654429 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e8bd12c9-26dc-4141-9211-74ad16cef184 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:10.825617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e8bd12c9-26dc-4141-9211-74ad16cef184 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:10.834832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e8bd12c9-26dc-4141-9211-74ad16cef184 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.200664 Jul 25 19:59:10.835420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1628/3099] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:10 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:11.857485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aba49bc3-d44c-444c-9e4c-f80c3f635b80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:11.858110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aba49bc3-d44c-444c-9e4c-f80c3f635b80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:11.866704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aba49bc3-d44c-444c-9e4c-f80c3f635b80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:11.867154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aba49bc3-d44c-444c-9e4c-f80c3f635b80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:11.867988 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aba49bc3-d44c-444c-9e4c-f80c3f635b80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:11.868441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aba49bc3-d44c-444c-9e4c-f80c3f635b80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:12.022667 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aba49bc3-d44c-444c-9e4c-f80c3f635b80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:12.035973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aba49bc3-d44c-444c-9e4c-f80c3f635b80 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.182156 Jul 25 19:59:12.036772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1472/3100] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:11 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:13.279336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5c86db6a-837b-479c-9145-8de7892b6991 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:13.279980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5c86db6a-837b-479c-9145-8de7892b6991 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:13.286862 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c86db6a-837b-479c-9145-8de7892b6991 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:13.287325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c86db6a-837b-479c-9145-8de7892b6991 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:13.288139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c86db6a-837b-479c-9145-8de7892b6991 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:13.288576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c86db6a-837b-479c-9145-8de7892b6991 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:13.460435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5c86db6a-837b-479c-9145-8de7892b6991 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:13.468923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5c86db6a-837b-479c-9145-8de7892b6991 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.412108 Jul 25 19:59:13.469504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1629/3101] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:13 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:14.491686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f199f713-3f78-42e8-8cc4-5bfb53d6a6c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:14.492253 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f199f713-3f78-42e8-8cc4-5bfb53d6a6c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:14.498961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f199f713-3f78-42e8-8cc4-5bfb53d6a6c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:14.499404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f199f713-3f78-42e8-8cc4-5bfb53d6a6c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:14.500190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f199f713-3f78-42e8-8cc4-5bfb53d6a6c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:14.500624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f199f713-3f78-42e8-8cc4-5bfb53d6a6c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:14.638244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f199f713-3f78-42e8-8cc4-5bfb53d6a6c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:14.646672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f199f713-3f78-42e8-8cc4-5bfb53d6a6c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.159772 Jul 25 19:59:14.647242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1473/3102] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:14 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:15.670671 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-398359e7-c874-4b11-a530-1f8d95b4a212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:15.671551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-398359e7-c874-4b11-a530-1f8d95b4a212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:15.681204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-398359e7-c874-4b11-a530-1f8d95b4a212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:15.681711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-398359e7-c874-4b11-a530-1f8d95b4a212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:15.682577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-398359e7-c874-4b11-a530-1f8d95b4a212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:15.683060 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-398359e7-c874-4b11-a530-1f8d95b4a212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:15.868298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-398359e7-c874-4b11-a530-1f8d95b4a212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:15.877952 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-398359e7-c874-4b11-a530-1f8d95b4a212 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.211892 Jul 25 19:59:15.878926 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1630/3103] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:15 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:16.907924 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e56c1bab-8188-4a8b-a82d-0ff23ceb227c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:16.908565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e56c1bab-8188-4a8b-a82d-0ff23ceb227c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:16.916022 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e56c1bab-8188-4a8b-a82d-0ff23ceb227c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:16.916486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e56c1bab-8188-4a8b-a82d-0ff23ceb227c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:16.917263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e56c1bab-8188-4a8b-a82d-0ff23ceb227c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:16.917704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e56c1bab-8188-4a8b-a82d-0ff23ceb227c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:17.061248 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e56c1bab-8188-4a8b-a82d-0ff23ceb227c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:17.071183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e56c1bab-8188-4a8b-a82d-0ff23ceb227c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.167059 Jul 25 19:59:17.072068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1474/3104] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:16 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:18.094125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-81820ce3-7bd8-4f6e-8dd0-50a91be46e6e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:18.094750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-81820ce3-7bd8-4f6e-8dd0-50a91be46e6e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:18.101864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-81820ce3-7bd8-4f6e-8dd0-50a91be46e6e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:18.102312 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-81820ce3-7bd8-4f6e-8dd0-50a91be46e6e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:18.103097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-81820ce3-7bd8-4f6e-8dd0-50a91be46e6e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:18.103558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-81820ce3-7bd8-4f6e-8dd0-50a91be46e6e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:18.106504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=86 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:59:18.265286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-81820ce3-7bd8-4f6e-8dd0-50a91be46e6e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:18.275561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-81820ce3-7bd8-4f6e-8dd0-50a91be46e6e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.185157 Jul 25 19:59:18.276166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1631/3105] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:18 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:19.302106 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-97937644-7136-4072-a497-573a7169cd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:19.302766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-97937644-7136-4072-a497-573a7169cd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:19.309655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97937644-7136-4072-a497-573a7169cd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:19.310107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97937644-7136-4072-a497-573a7169cd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:19.310887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97937644-7136-4072-a497-573a7169cd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:19.311333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97937644-7136-4072-a497-573a7169cd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:19.466804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97937644-7136-4072-a497-573a7169cd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:19.482472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-97937644-7136-4072-a497-573a7169cd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.184629 Jul 25 19:59:19.483561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1475/3106] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:19 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:20.508167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-24d9911e-4147-4927-aafa-4484050cb6c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:20.509063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-24d9911e-4147-4927-aafa-4484050cb6c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:20.516963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24d9911e-4147-4927-aafa-4484050cb6c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:20.517704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24d9911e-4147-4927-aafa-4484050cb6c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:20.519084 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24d9911e-4147-4927-aafa-4484050cb6c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:20.519840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-24d9911e-4147-4927-aafa-4484050cb6c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:20.672861 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-24d9911e-4147-4927-aafa-4484050cb6c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:20.686756 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-24d9911e-4147-4927-aafa-4484050cb6c6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.183307 Jul 25 19:59:20.687401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1632/3107] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:20 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:21.710153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b3c59623-4107-47c4-a5bc-7d0b6369f56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:21.710821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b3c59623-4107-47c4-a5bc-7d0b6369f56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:21.713478 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:59:21.719169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3c59623-4107-47c4-a5bc-7d0b6369f56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:21.719648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3c59623-4107-47c4-a5bc-7d0b6369f56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:21.720504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3c59623-4107-47c4-a5bc-7d0b6369f56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:21.720906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3c59623-4107-47c4-a5bc-7d0b6369f56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:21.877560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b3c59623-4107-47c4-a5bc-7d0b6369f56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:21.886490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b3c59623-4107-47c4-a5bc-7d0b6369f56b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.180445 Jul 25 19:59:21.887073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1476/3108] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:21 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:22.911210 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-094fc8a2-e5c5-41a6-b571-60a18ac3a423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:22.915056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-094fc8a2-e5c5-41a6-b571-60a18ac3a423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:22.915056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:59:22.920147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-094fc8a2-e5c5-41a6-b571-60a18ac3a423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:22.920589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-094fc8a2-e5c5-41a6-b571-60a18ac3a423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:22.921368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-094fc8a2-e5c5-41a6-b571-60a18ac3a423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:22.921796 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-094fc8a2-e5c5-41a6-b571-60a18ac3a423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:22.950872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:59:22.951668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:59:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:59:23.079488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-094fc8a2-e5c5-41a6-b571-60a18ac3a423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:23.088641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-094fc8a2-e5c5-41a6-b571-60a18ac3a423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.182573 Jul 25 19:59:23.089236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1633/3109] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:22 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:24.113384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8a7a2909-8865-4ac7-83f1-b6b7abd5f157 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:24.114498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8a7a2909-8865-4ac7-83f1-b6b7abd5f157 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:24.122531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a7a2909-8865-4ac7-83f1-b6b7abd5f157 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:24.122943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a7a2909-8865-4ac7-83f1-b6b7abd5f157 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:24.123750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a7a2909-8865-4ac7-83f1-b6b7abd5f157 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:24.124177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a7a2909-8865-4ac7-83f1-b6b7abd5f157 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:24.299330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8a7a2909-8865-4ac7-83f1-b6b7abd5f157 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:24.310196 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8a7a2909-8865-4ac7-83f1-b6b7abd5f157 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.201191 Jul 25 19:59:24.310794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1477/3110] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:24 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:25.332150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b7f8181f-79cd-4f3d-8022-57af15ad372b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:25.333056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b7f8181f-79cd-4f3d-8022-57af15ad372b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:25.339878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7f8181f-79cd-4f3d-8022-57af15ad372b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:25.340676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7f8181f-79cd-4f3d-8022-57af15ad372b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:25.341529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7f8181f-79cd-4f3d-8022-57af15ad372b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:25.342029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b7f8181f-79cd-4f3d-8022-57af15ad372b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:25.481648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b7f8181f-79cd-4f3d-8022-57af15ad372b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:25.491375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b7f8181f-79cd-4f3d-8022-57af15ad372b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.163229 Jul 25 19:59:25.491991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1634/3111] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:25 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:26.514127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f01fbd1-9d53-472e-bc3c-6da2167ee557 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:26.514698 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f01fbd1-9d53-472e-bc3c-6da2167ee557 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:26.522624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f01fbd1-9d53-472e-bc3c-6da2167ee557 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:26.523073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f01fbd1-9d53-472e-bc3c-6da2167ee557 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:26.523872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f01fbd1-9d53-472e-bc3c-6da2167ee557 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:26.524307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f01fbd1-9d53-472e-bc3c-6da2167ee557 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:26.663293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f01fbd1-9d53-472e-bc3c-6da2167ee557 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:26.671424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f01fbd1-9d53-472e-bc3c-6da2167ee557 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.161137 Jul 25 19:59:26.672015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1478/3112] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:26 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:27.695005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ba809c20-3413-4946-a09b-865df102a32f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:27.695732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ba809c20-3413-4946-a09b-865df102a32f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:27.702255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba809c20-3413-4946-a09b-865df102a32f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:27.702698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba809c20-3413-4946-a09b-865df102a32f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:27.703456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba809c20-3413-4946-a09b-865df102a32f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:27.703911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba809c20-3413-4946-a09b-865df102a32f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:27.842987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ba809c20-3413-4946-a09b-865df102a32f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:27.852510 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ba809c20-3413-4946-a09b-865df102a32f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.162192 Jul 25 19:59:27.853091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1635/3113] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:27 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:28.876051 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ebed28bc-980c-4da7-b525-f07d505e11c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:28.876683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ebed28bc-980c-4da7-b525-f07d505e11c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:28.884581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebed28bc-980c-4da7-b525-f07d505e11c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:28.885026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebed28bc-980c-4da7-b525-f07d505e11c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:28.885790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebed28bc-980c-4da7-b525-f07d505e11c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:28.886220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebed28bc-980c-4da7-b525-f07d505e11c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:29.024507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ebed28bc-980c-4da7-b525-f07d505e11c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:29.032696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ebed28bc-980c-4da7-b525-f07d505e11c4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.161127 Jul 25 19:59:29.033265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1479/3114] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:28 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:30.056136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-43dd55e2-0ed8-4706-aa52-e8a5e7907451 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:30.056766 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-43dd55e2-0ed8-4706-aa52-e8a5e7907451 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:30.063332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43dd55e2-0ed8-4706-aa52-e8a5e7907451 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:30.063811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43dd55e2-0ed8-4706-aa52-e8a5e7907451 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:30.064580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43dd55e2-0ed8-4706-aa52-e8a5e7907451 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:30.065018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-43dd55e2-0ed8-4706-aa52-e8a5e7907451 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:30.207908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-43dd55e2-0ed8-4706-aa52-e8a5e7907451 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:30.216001 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-43dd55e2-0ed8-4706-aa52-e8a5e7907451 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.163729 Jul 25 19:59:30.216584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1636/3115] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:30 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:31.241740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b02d099-7e24-44e2-beed-395185f34423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:31.242882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b02d099-7e24-44e2-beed-395185f34423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:31.249663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b02d099-7e24-44e2-beed-395185f34423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:31.250131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b02d099-7e24-44e2-beed-395185f34423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:31.250890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b02d099-7e24-44e2-beed-395185f34423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:31.251331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b02d099-7e24-44e2-beed-395185f34423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:31.387424 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b02d099-7e24-44e2-beed-395185f34423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:31.398119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b02d099-7e24-44e2-beed-395185f34423 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.162195 Jul 25 19:59:31.398119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1480/3116] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:31 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:32.421813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1346838c-efda-46fb-bc74-e382f253e047 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:32.422401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1346838c-efda-46fb-bc74-e382f253e047 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:32.429369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1346838c-efda-46fb-bc74-e382f253e047 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:32.429808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1346838c-efda-46fb-bc74-e382f253e047 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:32.430618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1346838c-efda-46fb-bc74-e382f253e047 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:32.431005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1346838c-efda-46fb-bc74-e382f253e047 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:32.570875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1346838c-efda-46fb-bc74-e382f253e047 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:32.579192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1346838c-efda-46fb-bc74-e382f253e047 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.161287 Jul 25 19:59:32.579799 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1637/3117] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:32 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:33.603205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-945f1eb3-0a25-4baa-9ef5-8ab61c25ccab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:33.603839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-945f1eb3-0a25-4baa-9ef5-8ab61c25ccab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:33.610232 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-945f1eb3-0a25-4baa-9ef5-8ab61c25ccab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:33.610677 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-945f1eb3-0a25-4baa-9ef5-8ab61c25ccab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:33.611441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-945f1eb3-0a25-4baa-9ef5-8ab61c25ccab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:33.611903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-945f1eb3-0a25-4baa-9ef5-8ab61c25ccab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:33.615756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:59:33.760250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-945f1eb3-0a25-4baa-9ef5-8ab61c25ccab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:33.770353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-945f1eb3-0a25-4baa-9ef5-8ab61c25ccab tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.170526 Jul 25 19:59:33.770957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1481/3118] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:33 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:34.794124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-377f79fa-b912-471c-b67a-65001e49ef0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:34.794753 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-377f79fa-b912-471c-b67a-65001e49ef0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:34.801771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-377f79fa-b912-471c-b67a-65001e49ef0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:34.802224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-377f79fa-b912-471c-b67a-65001e49ef0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:34.803003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-377f79fa-b912-471c-b67a-65001e49ef0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:34.803445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-377f79fa-b912-471c-b67a-65001e49ef0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:34.940074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-377f79fa-b912-471c-b67a-65001e49ef0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:34.949203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-377f79fa-b912-471c-b67a-65001e49ef0d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.159188 Jul 25 19:59:34.949784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1638/3119] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:34 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:35.971422 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd2f71ff-1025-4a3f-a44b-bfdc96e801e3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:35.972285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd2f71ff-1025-4a3f-a44b-bfdc96e801e3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:35.978887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd2f71ff-1025-4a3f-a44b-bfdc96e801e3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:35.979331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd2f71ff-1025-4a3f-a44b-bfdc96e801e3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:35.980127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd2f71ff-1025-4a3f-a44b-bfdc96e801e3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:35.980561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd2f71ff-1025-4a3f-a44b-bfdc96e801e3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:36.121674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd2f71ff-1025-4a3f-a44b-bfdc96e801e3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:36.130588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd2f71ff-1025-4a3f-a44b-bfdc96e801e3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.163523 Jul 25 19:59:36.131163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1482/3120] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:35 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:37.153187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f7afab9b-fa8d-4765-899c-7c0922494d94 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:37.153792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f7afab9b-fa8d-4765-899c-7c0922494d94 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:37.160992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7afab9b-fa8d-4765-899c-7c0922494d94 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:37.161434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7afab9b-fa8d-4765-899c-7c0922494d94 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:37.162200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7afab9b-fa8d-4765-899c-7c0922494d94 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:37.162630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7afab9b-fa8d-4765-899c-7c0922494d94 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:37.301442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f7afab9b-fa8d-4765-899c-7c0922494d94 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:37.309668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f7afab9b-fa8d-4765-899c-7c0922494d94 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.160359 Jul 25 19:59:37.310257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1639/3121] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:37 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:59:38.332647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4746558d-2378-4efa-8fe2-476ee159a5e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:38.333263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4746558d-2378-4efa-8fe2-476ee159a5e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:38.340157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4746558d-2378-4efa-8fe2-476ee159a5e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:38.340602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4746558d-2378-4efa-8fe2-476ee159a5e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:38.341373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4746558d-2378-4efa-8fe2-476ee159a5e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:38.341809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4746558d-2378-4efa-8fe2-476ee159a5e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:38.481985 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4746558d-2378-4efa-8fe2-476ee159a5e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:38.491923 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4746558d-2378-4efa-8fe2-476ee159a5e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.163809 Jul 25 19:59:38.492510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1483/3122] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:38 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:39.514272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a3bcccc4-a8ec-4b3b-bcbd-9e303469eb0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:39.514895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a3bcccc4-a8ec-4b3b-bcbd-9e303469eb0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:39.525932 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3bcccc4-a8ec-4b3b-bcbd-9e303469eb0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:39.526381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3bcccc4-a8ec-4b3b-bcbd-9e303469eb0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:39.527165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3bcccc4-a8ec-4b3b-bcbd-9e303469eb0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:39.528203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3bcccc4-a8ec-4b3b-bcbd-9e303469eb0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:39.670981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a3bcccc4-a8ec-4b3b-bcbd-9e303469eb0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:39.679784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a3bcccc4-a8ec-4b3b-bcbd-9e303469eb0c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.169411 Jul 25 19:59:39.680371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1640/3123] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:39 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:40.704252 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4eda182f-5bf4-4fa9-abc9-9d72b49567b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:40.705360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4eda182f-5bf4-4fa9-abc9-9d72b49567b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:40.715633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4eda182f-5bf4-4fa9-abc9-9d72b49567b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:40.716081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4eda182f-5bf4-4fa9-abc9-9d72b49567b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:40.716854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4eda182f-5bf4-4fa9-abc9-9d72b49567b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:40.717289 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4eda182f-5bf4-4fa9-abc9-9d72b49567b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:40.865068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4eda182f-5bf4-4fa9-abc9-9d72b49567b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:40.873543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4eda182f-5bf4-4fa9-abc9-9d72b49567b5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.176196 Jul 25 19:59:40.874117 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1484/3124] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:40 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:41.895997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6299da80-fc5f-4816-ac5e-f0b1a376f14a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:41.896606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6299da80-fc5f-4816-ac5e-f0b1a376f14a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:41.903409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6299da80-fc5f-4816-ac5e-f0b1a376f14a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:41.903884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6299da80-fc5f-4816-ac5e-f0b1a376f14a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:41.904655 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6299da80-fc5f-4816-ac5e-f0b1a376f14a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:41.905094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6299da80-fc5f-4816-ac5e-f0b1a376f14a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:42.099934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6299da80-fc5f-4816-ac5e-f0b1a376f14a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:42.108706 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6299da80-fc5f-4816-ac5e-f0b1a376f14a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.216649 Jul 25 19:59:42.109300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1641/3125] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:41 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:43.132824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c55b5820-08d1-4ae3-865a-04ccead9e0e7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:43.133441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c55b5820-08d1-4ae3-865a-04ccead9e0e7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:43.140776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c55b5820-08d1-4ae3-865a-04ccead9e0e7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:43.141223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c55b5820-08d1-4ae3-865a-04ccead9e0e7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:43.141987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c55b5820-08d1-4ae3-865a-04ccead9e0e7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:43.142412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c55b5820-08d1-4ae3-865a-04ccead9e0e7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:43.287764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c55b5820-08d1-4ae3-865a-04ccead9e0e7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:43.296000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c55b5820-08d1-4ae3-865a-04ccead9e0e7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.166924 Jul 25 19:59:43.296581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1485/3126] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:43 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:44.318293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-afb8e903-e273-4505-bbf7-0b3050158d45 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:44.318966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-afb8e903-e273-4505-bbf7-0b3050158d45 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:44.325573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afb8e903-e273-4505-bbf7-0b3050158d45 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:44.326025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afb8e903-e273-4505-bbf7-0b3050158d45 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:44.326786 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afb8e903-e273-4505-bbf7-0b3050158d45 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:44.327578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-afb8e903-e273-4505-bbf7-0b3050158d45 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:44.468154 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-afb8e903-e273-4505-bbf7-0b3050158d45 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:44.476989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-afb8e903-e273-4505-bbf7-0b3050158d45 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.162477 Jul 25 19:59:44.477572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1642/3127] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:44 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:45.499592 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5a631eef-555c-4e61-8bd5-74f5832d99b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:45.500738 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5a631eef-555c-4e61-8bd5-74f5832d99b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:45.507111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a631eef-555c-4e61-8bd5-74f5832d99b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:45.507586 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a631eef-555c-4e61-8bd5-74f5832d99b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:45.508366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a631eef-555c-4e61-8bd5-74f5832d99b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:45.508812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a631eef-555c-4e61-8bd5-74f5832d99b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:45.653466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5a631eef-555c-4e61-8bd5-74f5832d99b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:45.662922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5a631eef-555c-4e61-8bd5-74f5832d99b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.167322 Jul 25 19:59:45.663504 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1486/3128] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:45 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:59:46.685420 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1b7457ae-017e-4083-bcf6-e91a49c99073 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:46.686027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1b7457ae-017e-4083-bcf6-e91a49c99073 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:46.693048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b7457ae-017e-4083-bcf6-e91a49c99073 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:46.693496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b7457ae-017e-4083-bcf6-e91a49c99073 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:46.694278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b7457ae-017e-4083-bcf6-e91a49c99073 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:46.694715 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1b7457ae-017e-4083-bcf6-e91a49c99073 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:46.836327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1b7457ae-017e-4083-bcf6-e91a49c99073 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:46.844711 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1b7457ae-017e-4083-bcf6-e91a49c99073 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.163094 Jul 25 19:59:46.845335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1643/3129] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:46 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:47.866707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d44273cc-5d83-4fb3-beeb-0d060a2df9eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:47.867354 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d44273cc-5d83-4fb3-beeb-0d060a2df9eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:47.874225 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d44273cc-5d83-4fb3-beeb-0d060a2df9eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:47.874673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d44273cc-5d83-4fb3-beeb-0d060a2df9eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:47.875471 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d44273cc-5d83-4fb3-beeb-0d060a2df9eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:47.875937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d44273cc-5d83-4fb3-beeb-0d060a2df9eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:48.015997 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d44273cc-5d83-4fb3-beeb-0d060a2df9eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:48.025224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d44273cc-5d83-4fb3-beeb-0d060a2df9eb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.162666 Jul 25 19:59:48.025807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1487/3130] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:47 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:49.048018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-371c4169-7d23-4103-8fb3-1c425685b7ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:49.048607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-371c4169-7d23-4103-8fb3-1c425685b7ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:49.056810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-371c4169-7d23-4103-8fb3-1c425685b7ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:49.057257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-371c4169-7d23-4103-8fb3-1c425685b7ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:49.058033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-371c4169-7d23-4103-8fb3-1c425685b7ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:49.058470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-371c4169-7d23-4103-8fb3-1c425685b7ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:49.061212 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=78 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:59:49.202205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-371c4169-7d23-4103-8fb3-1c425685b7ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:49.210814 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-371c4169-7d23-4103-8fb3-1c425685b7ba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.166525 Jul 25 19:59:49.211405 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1644/3131] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:49 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:50.233152 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ef4e5c43-a5e1-42b9-ac3e-8884fcb4efc8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:50.233753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ef4e5c43-a5e1-42b9-ac3e-8884fcb4efc8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:50.241531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef4e5c43-a5e1-42b9-ac3e-8884fcb4efc8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:50.241976 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef4e5c43-a5e1-42b9-ac3e-8884fcb4efc8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:50.242757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef4e5c43-a5e1-42b9-ac3e-8884fcb4efc8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:50.243195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef4e5c43-a5e1-42b9-ac3e-8884fcb4efc8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:50.380057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ef4e5c43-a5e1-42b9-ac3e-8884fcb4efc8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:50.388217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ef4e5c43-a5e1-42b9-ac3e-8884fcb4efc8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.158910 Jul 25 19:59:50.388803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1488/3132] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:50 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:51.410513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6c063f42-f923-49e9-bd92-b23e473a7a96 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:51.411097 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6c063f42-f923-49e9-bd92-b23e473a7a96 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:51.417713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c063f42-f923-49e9-bd92-b23e473a7a96 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:51.418235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c063f42-f923-49e9-bd92-b23e473a7a96 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:51.419004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c063f42-f923-49e9-bd92-b23e473a7a96 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:51.419432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6c063f42-f923-49e9-bd92-b23e473a7a96 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:51.565134 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6c063f42-f923-49e9-bd92-b23e473a7a96 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:51.573292 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6c063f42-f923-49e9-bd92-b23e473a7a96 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.166761 Jul 25 19:59:51.573872 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1645/3133] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:51 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:52.595151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b8ddcca-00bf-4e2f-aad6-bd4528b7e71c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:52.595971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b8ddcca-00bf-4e2f-aad6-bd4528b7e71c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:52.598790 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:59:52.604220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b8ddcca-00bf-4e2f-aad6-bd4528b7e71c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:52.604578 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b8ddcca-00bf-4e2f-aad6-bd4528b7e71c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:52.605340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b8ddcca-00bf-4e2f-aad6-bd4528b7e71c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:52.605771 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b8ddcca-00bf-4e2f-aad6-bd4528b7e71c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:52.749080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b8ddcca-00bf-4e2f-aad6-bd4528b7e71c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:52.761183 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b8ddcca-00bf-4e2f-aad6-bd4528b7e71c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.169843 Jul 25 19:59:52.761896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1489/3134] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:53.784361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-19ddad2c-f6be-4c89-9060-d0f373667894 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:53.785142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-19ddad2c-f6be-4c89-9060-d0f373667894 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:53.788067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=26 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:59:53.796057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-19ddad2c-f6be-4c89-9060-d0f373667894 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:53.796537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-19ddad2c-f6be-4c89-9060-d0f373667894 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:53.797304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-19ddad2c-f6be-4c89-9060-d0f373667894 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:53.797737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-19ddad2c-f6be-4c89-9060-d0f373667894 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:53.944742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-19ddad2c-f6be-4c89-9060-d0f373667894 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:53.953160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-19ddad2c-f6be-4c89-9060-d0f373667894 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.173270 Jul 25 19:59:53.953746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1646/3135] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:53 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:54.976158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c13e9d62-fac9-44f8-b3f1-72aac0b7704d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:54.976786 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c13e9d62-fac9-44f8-b3f1-72aac0b7704d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:54.983291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c13e9d62-fac9-44f8-b3f1-72aac0b7704d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:54.983787 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c13e9d62-fac9-44f8-b3f1-72aac0b7704d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:54.984528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c13e9d62-fac9-44f8-b3f1-72aac0b7704d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:54.984958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c13e9d62-fac9-44f8-b3f1-72aac0b7704d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:55.138588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c13e9d62-fac9-44f8-b3f1-72aac0b7704d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:55.147535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c13e9d62-fac9-44f8-b3f1-72aac0b7704d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.175917 Jul 25 19:59:55.148757 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1490/3136] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:54 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:56.170581 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-83f9dae6-c93c-4d95-b50c-359ef4069e20 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:56.171192 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-83f9dae6-c93c-4d95-b50c-359ef4069e20 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:56.178834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83f9dae6-c93c-4d95-b50c-359ef4069e20 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:56.179280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83f9dae6-c93c-4d95-b50c-359ef4069e20 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:56.180102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83f9dae6-c93c-4d95-b50c-359ef4069e20 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:56.180538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-83f9dae6-c93c-4d95-b50c-359ef4069e20 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:56.321602 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-83f9dae6-c93c-4d95-b50c-359ef4069e20 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:56.329833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-83f9dae6-c93c-4d95-b50c-359ef4069e20 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.163230 Jul 25 19:59:56.331392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1647/3137] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:56 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:57.353241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8559e825-d3e6-4d99-98b0-9903a182d13c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:57.353848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8559e825-d3e6-4d99-98b0-9903a182d13c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:57.360558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8559e825-d3e6-4d99-98b0-9903a182d13c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:57.360999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8559e825-d3e6-4d99-98b0-9903a182d13c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:57.362383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8559e825-d3e6-4d99-98b0-9903a182d13c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:57.362913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8559e825-d3e6-4d99-98b0-9903a182d13c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:57.508393 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8559e825-d3e6-4d99-98b0-9903a182d13c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:57.516588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8559e825-d3e6-4d99-98b0-9903a182d13c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.167177 Jul 25 19:59:57.517165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1491/3138] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:57 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:58.539987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-34d9ea38-0ba5-4f25-968f-44ee8852c422 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:58.540558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-34d9ea38-0ba5-4f25-968f-44ee8852c422 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:58.547363 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34d9ea38-0ba5-4f25-968f-44ee8852c422 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:58.547839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34d9ea38-0ba5-4f25-968f-44ee8852c422 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:58.548605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34d9ea38-0ba5-4f25-968f-44ee8852c422 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:58.549329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34d9ea38-0ba5-4f25-968f-44ee8852c422 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:58.686710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-34d9ea38-0ba5-4f25-968f-44ee8852c422 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:58.695263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-34d9ea38-0ba5-4f25-968f-44ee8852c422 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.159233 Jul 25 19:59:58.695884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1648/3139] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:58 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:59:58.963926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:59:58.964555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 19:59:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:59:59.717244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9611a257-90bd-4608-a8f0-17c9bdbc1e1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:59.717849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9611a257-90bd-4608-a8f0-17c9bdbc1e1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:59:59.724817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9611a257-90bd-4608-a8f0-17c9bdbc1e1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:59.725255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9611a257-90bd-4608-a8f0-17c9bdbc1e1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:59.726017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9611a257-90bd-4608-a8f0-17c9bdbc1e1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:59.726450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9611a257-90bd-4608-a8f0-17c9bdbc1e1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:59.863190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9611a257-90bd-4608-a8f0-17c9bdbc1e1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:59:59.871989 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9611a257-90bd-4608-a8f0-17c9bdbc1e1b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.158528 Jul 25 19:59:59.872660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1492/3140] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 19:59:59 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:00.896367 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a14b3997-04a7-4edc-b64a-74aea5e4703f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:00.897036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a14b3997-04a7-4edc-b64a-74aea5e4703f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:00.904045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a14b3997-04a7-4edc-b64a-74aea5e4703f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:00.904494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a14b3997-04a7-4edc-b64a-74aea5e4703f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:00.905263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a14b3997-04a7-4edc-b64a-74aea5e4703f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:00.905699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a14b3997-04a7-4edc-b64a-74aea5e4703f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:01.045123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a14b3997-04a7-4edc-b64a-74aea5e4703f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:01.054401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a14b3997-04a7-4edc-b64a-74aea5e4703f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.162818 Jul 25 20:00:01.054991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1649/3141] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:00 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:02.077707 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ebb59cc6-dc46-427d-b143-6d8796fd38b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:02.078312 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ebb59cc6-dc46-427d-b143-6d8796fd38b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:02.085895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebb59cc6-dc46-427d-b143-6d8796fd38b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:02.086334 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebb59cc6-dc46-427d-b143-6d8796fd38b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:02.087097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebb59cc6-dc46-427d-b143-6d8796fd38b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:02.087547 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebb59cc6-dc46-427d-b143-6d8796fd38b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:02.232093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ebb59cc6-dc46-427d-b143-6d8796fd38b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:02.241043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ebb59cc6-dc46-427d-b143-6d8796fd38b7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.166816 Jul 25 20:00:02.241626 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1493/3142] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:02 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:03.264253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f5408c9c-2168-49f3-b7e1-4969049e60cf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:03.265173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f5408c9c-2168-49f3-b7e1-4969049e60cf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:03.271971 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5408c9c-2168-49f3-b7e1-4969049e60cf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:03.272423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5408c9c-2168-49f3-b7e1-4969049e60cf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:03.273207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5408c9c-2168-49f3-b7e1-4969049e60cf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:03.273648 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f5408c9c-2168-49f3-b7e1-4969049e60cf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:03.420710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f5408c9c-2168-49f3-b7e1-4969049e60cf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:03.429835 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f5408c9c-2168-49f3-b7e1-4969049e60cf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.170135 Jul 25 20:00:03.430423 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1650/3143] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:03 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:04.452950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d7c3759-394b-41fd-92bf-31516bfcbd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:04.453515 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d7c3759-394b-41fd-92bf-31516bfcbd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:04.461258 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d7c3759-394b-41fd-92bf-31516bfcbd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:04.462890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d7c3759-394b-41fd-92bf-31516bfcbd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:04.462890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d7c3759-394b-41fd-92bf-31516bfcbd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:04.462890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d7c3759-394b-41fd-92bf-31516bfcbd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:04.465802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:00:04.606481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d7c3759-394b-41fd-92bf-31516bfcbd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:04.615970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d7c3759-394b-41fd-92bf-31516bfcbd9a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.167107 Jul 25 20:00:04.616550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1494/3144] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:04 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:05.638442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f8b469ff-7f92-4f8f-934e-6b109c53054e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:05.639332 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f8b469ff-7f92-4f8f-934e-6b109c53054e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:05.646329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8b469ff-7f92-4f8f-934e-6b109c53054e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:05.646738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8b469ff-7f92-4f8f-934e-6b109c53054e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:05.647504 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8b469ff-7f92-4f8f-934e-6b109c53054e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:05.647960 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f8b469ff-7f92-4f8f-934e-6b109c53054e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:05.790580 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f8b469ff-7f92-4f8f-934e-6b109c53054e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:05.799460 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f8b469ff-7f92-4f8f-934e-6b109c53054e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.164845 Jul 25 20:00:05.800243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1651/3145] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:05 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:06.821825 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-701f3cce-1cb4-4757-900c-2a6286431d12 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:06.822496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-701f3cce-1cb4-4757-900c-2a6286431d12 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:06.829480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-701f3cce-1cb4-4757-900c-2a6286431d12 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:06.830059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-701f3cce-1cb4-4757-900c-2a6286431d12 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:06.831775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-701f3cce-1cb4-4757-900c-2a6286431d12 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:06.832208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-701f3cce-1cb4-4757-900c-2a6286431d12 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:06.980838 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-701f3cce-1cb4-4757-900c-2a6286431d12 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:06.989516 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-701f3cce-1cb4-4757-900c-2a6286431d12 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.171451 Jul 25 20:00:06.990103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1495/3146] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:06 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:08.011999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dc421dca-20ff-4ec5-ba28-0de72e2e8ccb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:08.012593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dc421dca-20ff-4ec5-ba28-0de72e2e8ccb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:08.020146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc421dca-20ff-4ec5-ba28-0de72e2e8ccb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:08.020651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc421dca-20ff-4ec5-ba28-0de72e2e8ccb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:08.021539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc421dca-20ff-4ec5-ba28-0de72e2e8ccb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:08.022012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dc421dca-20ff-4ec5-ba28-0de72e2e8ccb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:08.160197 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-dc421dca-20ff-4ec5-ba28-0de72e2e8ccb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:08.168570 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dc421dca-20ff-4ec5-ba28-0de72e2e8ccb tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.160514 Jul 25 20:00:08.169161 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1652/3147] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:08 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:09.190884 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4e3c1078-def3-48a4-aacb-1de7eb5e899a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:09.191748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4e3c1078-def3-48a4-aacb-1de7eb5e899a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:09.198518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e3c1078-def3-48a4-aacb-1de7eb5e899a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:09.198965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e3c1078-def3-48a4-aacb-1de7eb5e899a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:09.199768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e3c1078-def3-48a4-aacb-1de7eb5e899a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:09.200217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e3c1078-def3-48a4-aacb-1de7eb5e899a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:09.341288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4e3c1078-def3-48a4-aacb-1de7eb5e899a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:09.350474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4e3c1078-def3-48a4-aacb-1de7eb5e899a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.163484 Jul 25 20:00:09.351066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1496/3148] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:09 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:10.372641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-48b76d74-71c9-4bab-b2c3-30b66ea29087 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:10.373244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-48b76d74-71c9-4bab-b2c3-30b66ea29087 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:10.380954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48b76d74-71c9-4bab-b2c3-30b66ea29087 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:10.381399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48b76d74-71c9-4bab-b2c3-30b66ea29087 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:10.382171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48b76d74-71c9-4bab-b2c3-30b66ea29087 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:10.382606 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48b76d74-71c9-4bab-b2c3-30b66ea29087 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:10.520998 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-48b76d74-71c9-4bab-b2c3-30b66ea29087 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:10.529124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-48b76d74-71c9-4bab-b2c3-30b66ea29087 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.160313 Jul 25 20:00:10.529704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1653/3149] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:10 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:11.551423 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-71c2fbac-fcb2-4c8d-918e-fb251b0b5822 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:11.552072 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-71c2fbac-fcb2-4c8d-918e-fb251b0b5822 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:11.558910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71c2fbac-fcb2-4c8d-918e-fb251b0b5822 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:11.559271 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71c2fbac-fcb2-4c8d-918e-fb251b0b5822 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:11.560655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71c2fbac-fcb2-4c8d-918e-fb251b0b5822 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:11.560655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71c2fbac-fcb2-4c8d-918e-fb251b0b5822 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:11.704392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-71c2fbac-fcb2-4c8d-918e-fb251b0b5822 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:11.713246 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-71c2fbac-fcb2-4c8d-918e-fb251b0b5822 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.166303 Jul 25 20:00:11.713824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1497/3150] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:11 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:12.735781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e1e9a5f6-5161-4d51-af35-b6374a464314 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:12.736457 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e1e9a5f6-5161-4d51-af35-b6374a464314 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:12.743805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1e9a5f6-5161-4d51-af35-b6374a464314 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:12.744255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1e9a5f6-5161-4d51-af35-b6374a464314 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:12.745036 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1e9a5f6-5161-4d51-af35-b6374a464314 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:12.745472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e1e9a5f6-5161-4d51-af35-b6374a464314 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:12.883290 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e1e9a5f6-5161-4d51-af35-b6374a464314 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:12.891365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e1e9a5f6-5161-4d51-af35-b6374a464314 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.159462 Jul 25 20:00:12.891990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1654/3151] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:12 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:13.915821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b067779c-8359-43ac-a032-2da23cfcd490 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:13.916470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b067779c-8359-43ac-a032-2da23cfcd490 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:13.924244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b067779c-8359-43ac-a032-2da23cfcd490 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:13.924937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b067779c-8359-43ac-a032-2da23cfcd490 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:13.926298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b067779c-8359-43ac-a032-2da23cfcd490 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:13.926952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b067779c-8359-43ac-a032-2da23cfcd490 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:14.075124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b067779c-8359-43ac-a032-2da23cfcd490 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:14.084719 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b067779c-8359-43ac-a032-2da23cfcd490 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.174162 Jul 25 20:00:14.085304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1498/3152] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:13 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:15.106657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-87e2e150-c145-4a8e-8005-303e69906429 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:15.107295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-87e2e150-c145-4a8e-8005-303e69906429 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:15.114158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87e2e150-c145-4a8e-8005-303e69906429 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:15.114610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87e2e150-c145-4a8e-8005-303e69906429 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:15.115747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87e2e150-c145-4a8e-8005-303e69906429 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:15.116132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-87e2e150-c145-4a8e-8005-303e69906429 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:15.260857 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-87e2e150-c145-4a8e-8005-303e69906429 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:15.270079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-87e2e150-c145-4a8e-8005-303e69906429 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.167246 Jul 25 20:00:15.270668 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1655/3153] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:15 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:16.292103 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2860e0fc-f4a6-4b20-8010-709b7773b520 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:16.292693 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2860e0fc-f4a6-4b20-8010-709b7773b520 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:16.300065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2860e0fc-f4a6-4b20-8010-709b7773b520 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:16.300512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2860e0fc-f4a6-4b20-8010-709b7773b520 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:16.301273 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2860e0fc-f4a6-4b20-8010-709b7773b520 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:16.301711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2860e0fc-f4a6-4b20-8010-709b7773b520 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:16.447261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2860e0fc-f4a6-4b20-8010-709b7773b520 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:16.457455 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2860e0fc-f4a6-4b20-8010-709b7773b520 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.169141 Jul 25 20:00:16.458041 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1499/3154] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:16 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:17.479830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-03258f18-0b86-4aca-9cf2-735d4ece5e59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:17.480379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-03258f18-0b86-4aca-9cf2-735d4ece5e59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:17.487658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03258f18-0b86-4aca-9cf2-735d4ece5e59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:17.488171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03258f18-0b86-4aca-9cf2-735d4ece5e59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:17.489047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03258f18-0b86-4aca-9cf2-735d4ece5e59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:17.489540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-03258f18-0b86-4aca-9cf2-735d4ece5e59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:17.630315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-03258f18-0b86-4aca-9cf2-735d4ece5e59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:17.638043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-03258f18-0b86-4aca-9cf2-735d4ece5e59 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.162113 Jul 25 20:00:17.638622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1656/3155] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:17 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:18.661192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f26cdd71-fd3e-4c64-a860-14c192879656 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:18.661822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f26cdd71-fd3e-4c64-a860-14c192879656 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:18.670796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f26cdd71-fd3e-4c64-a860-14c192879656 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:18.671238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f26cdd71-fd3e-4c64-a860-14c192879656 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:18.672050 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f26cdd71-fd3e-4c64-a860-14c192879656 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:18.672482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f26cdd71-fd3e-4c64-a860-14c192879656 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:18.803493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f26cdd71-fd3e-4c64-a860-14c192879656 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:18.811766 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f26cdd71-fd3e-4c64-a860-14c192879656 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.154424 Jul 25 20:00:18.812335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1500/3156] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:18 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:19.054970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:00:19.055571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 20:00:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:00:19.835941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c4de871a-d457-4046-b077-408056f77919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:19.836549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c4de871a-d457-4046-b077-408056f77919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:19.842980 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4de871a-d457-4046-b077-408056f77919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:19.843422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4de871a-d457-4046-b077-408056f77919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:19.844206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4de871a-d457-4046-b077-408056f77919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:19.844640 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c4de871a-d457-4046-b077-408056f77919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:19.847625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=78 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:00:19.975324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c4de871a-d457-4046-b077-408056f77919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:19.989080 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c4de871a-d457-4046-b077-408056f77919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.154428 Jul 25 20:00:19.989676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1657/3157] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:19 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:21.010900 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8a71a16d-c7f4-4e1e-bf2b-fd3c0b708919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:21.011526 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8a71a16d-c7f4-4e1e-bf2b-fd3c0b708919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:21.018604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a71a16d-c7f4-4e1e-bf2b-fd3c0b708919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:21.019160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a71a16d-c7f4-4e1e-bf2b-fd3c0b708919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:21.019950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a71a16d-c7f4-4e1e-bf2b-fd3c0b708919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:21.020389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a71a16d-c7f4-4e1e-bf2b-fd3c0b708919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:21.171249 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8a71a16d-c7f4-4e1e-bf2b-fd3c0b708919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:21.182229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8a71a16d-c7f4-4e1e-bf2b-fd3c0b708919 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.175030 Jul 25 20:00:21.182826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1501/3158] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:21 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:22.204991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-31f88738-1678-4621-a495-a42eca9cc185 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:22.206086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-31f88738-1678-4621-a495-a42eca9cc185 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:22.212577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31f88738-1678-4621-a495-a42eca9cc185 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:22.213018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31f88738-1678-4621-a495-a42eca9cc185 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:22.213776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31f88738-1678-4621-a495-a42eca9cc185 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:22.214206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-31f88738-1678-4621-a495-a42eca9cc185 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:22.347860 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-31f88738-1678-4621-a495-a42eca9cc185 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:22.355812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-31f88738-1678-4621-a495-a42eca9cc185 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.154716 Jul 25 20:00:22.356389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1658/3159] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:22 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:23.379052 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-307e57ca-6198-42f2-92c4-24758b195443 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:23.379686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-307e57ca-6198-42f2-92c4-24758b195443 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:23.382179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:00:23.387480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-307e57ca-6198-42f2-92c4-24758b195443 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:23.387963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-307e57ca-6198-42f2-92c4-24758b195443 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:23.388729 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-307e57ca-6198-42f2-92c4-24758b195443 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:23.389165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-307e57ca-6198-42f2-92c4-24758b195443 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:23.524927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-307e57ca-6198-42f2-92c4-24758b195443 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:23.532810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-307e57ca-6198-42f2-92c4-24758b195443 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.158616 Jul 25 20:00:23.533446 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1502/3160] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:23 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:24.554335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9043f990-8928-4939-900a-94b2b2c694c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:24.554941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9043f990-8928-4939-900a-94b2b2c694c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:24.557357 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=26 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:00:24.563630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9043f990-8928-4939-900a-94b2b2c694c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:24.564618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9043f990-8928-4939-900a-94b2b2c694c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:24.565455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9043f990-8928-4939-900a-94b2b2c694c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:24.565882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9043f990-8928-4939-900a-94b2b2c694c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:24.710803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9043f990-8928-4939-900a-94b2b2c694c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:24.719679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9043f990-8928-4939-900a-94b2b2c694c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.169060 Jul 25 20:00:24.721047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1659/3161] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:24 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:25.743753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d2aa4a4a-76b1-42b7-849c-2324509a13ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:25.744372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d2aa4a4a-76b1-42b7-849c-2324509a13ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:25.751045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2aa4a4a-76b1-42b7-849c-2324509a13ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:25.751492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2aa4a4a-76b1-42b7-849c-2324509a13ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:25.753228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2aa4a4a-76b1-42b7-849c-2324509a13ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:25.753398 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2aa4a4a-76b1-42b7-849c-2324509a13ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:25.900073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d2aa4a4a-76b1-42b7-849c-2324509a13ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:25.909732 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d2aa4a4a-76b1-42b7-849c-2324509a13ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.169910 Jul 25 20:00:25.910335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1503/3162] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:25 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:26.932571 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-93b4c166-5caf-4b27-8f71-b7f4238ef696 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:26.933262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-93b4c166-5caf-4b27-8f71-b7f4238ef696 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:26.940230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-93b4c166-5caf-4b27-8f71-b7f4238ef696 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:26.940677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-93b4c166-5caf-4b27-8f71-b7f4238ef696 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:26.941455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-93b4c166-5caf-4b27-8f71-b7f4238ef696 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:26.941893 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-93b4c166-5caf-4b27-8f71-b7f4238ef696 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:27.088795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-93b4c166-5caf-4b27-8f71-b7f4238ef696 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:27.098610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-93b4c166-5caf-4b27-8f71-b7f4238ef696 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.169804 Jul 25 20:00:27.099280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1660/3163] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:26 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:28.128201 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bab94ed0-4d4c-46af-8631-c7d5019071bc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:28.128861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bab94ed0-4d4c-46af-8631-c7d5019071bc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:28.135810 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bab94ed0-4d4c-46af-8631-c7d5019071bc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:28.136247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bab94ed0-4d4c-46af-8631-c7d5019071bc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:28.137024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bab94ed0-4d4c-46af-8631-c7d5019071bc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:28.137457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bab94ed0-4d4c-46af-8631-c7d5019071bc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:28.292474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bab94ed0-4d4c-46af-8631-c7d5019071bc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:28.300851 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bab94ed0-4d4c-46af-8631-c7d5019071bc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.176468 Jul 25 20:00:28.301451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1504/3164] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:28 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:29.326879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-58f54d35-977d-4780-b34d-b65baa5c9174 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:29.327488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-58f54d35-977d-4780-b34d-b65baa5c9174 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:29.334527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58f54d35-977d-4780-b34d-b65baa5c9174 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:29.334974 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58f54d35-977d-4780-b34d-b65baa5c9174 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:29.335789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58f54d35-977d-4780-b34d-b65baa5c9174 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:29.336231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58f54d35-977d-4780-b34d-b65baa5c9174 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:29.500078 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-58f54d35-977d-4780-b34d-b65baa5c9174 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:29.509116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-58f54d35-977d-4780-b34d-b65baa5c9174 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.187684 Jul 25 20:00:29.509709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1661/3165] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:29 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:30.532399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da2b39dc-5fd7-48ef-939d-053f934681c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:30.533744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da2b39dc-5fd7-48ef-939d-053f934681c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:30.542037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da2b39dc-5fd7-48ef-939d-053f934681c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:30.542756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da2b39dc-5fd7-48ef-939d-053f934681c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:30.543775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da2b39dc-5fd7-48ef-939d-053f934681c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:30.544304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da2b39dc-5fd7-48ef-939d-053f934681c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:30.720190 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-da2b39dc-5fd7-48ef-939d-053f934681c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:30.729934 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da2b39dc-5fd7-48ef-939d-053f934681c9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.201601 Jul 25 20:00:30.730522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1505/3166] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:30 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:31.753079 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5db31b0d-c204-4a07-83fd-a248e3bcddc7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:31.753692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5db31b0d-c204-4a07-83fd-a248e3bcddc7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:31.760320 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5db31b0d-c204-4a07-83fd-a248e3bcddc7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:31.760764 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5db31b0d-c204-4a07-83fd-a248e3bcddc7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:31.761528 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5db31b0d-c204-4a07-83fd-a248e3bcddc7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:31.761958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5db31b0d-c204-4a07-83fd-a248e3bcddc7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:31.919479 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5db31b0d-c204-4a07-83fd-a248e3bcddc7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:31.929288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5db31b0d-c204-4a07-83fd-a248e3bcddc7 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.180775 Jul 25 20:00:31.929879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1662/3167] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:31 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:32.957080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3eb3998a-479d-4169-906b-e6a1c2ba9ae0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:32.957863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3eb3998a-479d-4169-906b-e6a1c2ba9ae0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:32.964054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3eb3998a-479d-4169-906b-e6a1c2ba9ae0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:32.964508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3eb3998a-479d-4169-906b-e6a1c2ba9ae0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:32.965279 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3eb3998a-479d-4169-906b-e6a1c2ba9ae0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:32.965712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3eb3998a-479d-4169-906b-e6a1c2ba9ae0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:33.130710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3eb3998a-479d-4169-906b-e6a1c2ba9ae0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:33.140021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3eb3998a-479d-4169-906b-e6a1c2ba9ae0 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.188845 Jul 25 20:00:33.140611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1506/3168] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:32 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:34.169229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f361bda5-cb0b-4971-9e83-c3859e634662 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:34.169852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f361bda5-cb0b-4971-9e83-c3859e634662 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:34.177471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f361bda5-cb0b-4971-9e83-c3859e634662 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:34.177930 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f361bda5-cb0b-4971-9e83-c3859e634662 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:34.178734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f361bda5-cb0b-4971-9e83-c3859e634662 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:34.179178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f361bda5-cb0b-4971-9e83-c3859e634662 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:34.328424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f361bda5-cb0b-4971-9e83-c3859e634662 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:34.336915 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f361bda5-cb0b-4971-9e83-c3859e634662 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.171840 Jul 25 20:00:34.337495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1663/3169] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:34 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:35.359143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de8db7c6-471c-4765-97bf-191447aa1dc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:35.359774 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de8db7c6-471c-4765-97bf-191447aa1dc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:35.367660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de8db7c6-471c-4765-97bf-191447aa1dc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:35.368024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de8db7c6-471c-4765-97bf-191447aa1dc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:35.368798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de8db7c6-471c-4765-97bf-191447aa1dc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:35.369234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de8db7c6-471c-4765-97bf-191447aa1dc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:35.372120 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:00:35.514350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de8db7c6-471c-4765-97bf-191447aa1dc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:35.523416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de8db7c6-471c-4765-97bf-191447aa1dc4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.168082 Jul 25 20:00:35.524032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1507/3170] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:35 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:36.549757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5c57a74c-b8cb-4b81-8ad3-f775f305fc6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:36.550437 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5c57a74c-b8cb-4b81-8ad3-f775f305fc6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:36.557832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c57a74c-b8cb-4b81-8ad3-f775f305fc6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:36.558274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c57a74c-b8cb-4b81-8ad3-f775f305fc6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:36.559051 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c57a74c-b8cb-4b81-8ad3-f775f305fc6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:36.559487 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5c57a74c-b8cb-4b81-8ad3-f775f305fc6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:36.718308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5c57a74c-b8cb-4b81-8ad3-f775f305fc6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:36.727833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5c57a74c-b8cb-4b81-8ad3-f775f305fc6a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.182660 Jul 25 20:00:36.728421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1664/3171] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:36 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:37.750541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e815fb54-c671-4823-873a-50b89ee3d63a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:37.751991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e815fb54-c671-4823-873a-50b89ee3d63a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:37.759553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e815fb54-c671-4823-873a-50b89ee3d63a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:37.759986 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e815fb54-c671-4823-873a-50b89ee3d63a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:37.760780 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e815fb54-c671-4823-873a-50b89ee3d63a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:37.761230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e815fb54-c671-4823-873a-50b89ee3d63a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:37.899217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e815fb54-c671-4823-873a-50b89ee3d63a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:37.907343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e815fb54-c671-4823-873a-50b89ee3d63a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.160740 Jul 25 20:00:37.908195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1508/3172] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:37 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:38.934252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-121d15b1-c45f-4893-830d-76a2a83fd4ae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:38.934871 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-121d15b1-c45f-4893-830d-76a2a83fd4ae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:38.942248 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-121d15b1-c45f-4893-830d-76a2a83fd4ae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:38.942864 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-121d15b1-c45f-4893-830d-76a2a83fd4ae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:38.943914 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-121d15b1-c45f-4893-830d-76a2a83fd4ae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:38.944431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-121d15b1-c45f-4893-830d-76a2a83fd4ae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:39.086265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-121d15b1-c45f-4893-830d-76a2a83fd4ae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:39.094263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-121d15b1-c45f-4893-830d-76a2a83fd4ae tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.166754 Jul 25 20:00:39.094839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1665/3173] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:38 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:40.117358 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3dba46a5-4efa-46b8-b657-a1ac51578bed tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:40.118345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3dba46a5-4efa-46b8-b657-a1ac51578bed tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:40.127364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dba46a5-4efa-46b8-b657-a1ac51578bed tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:40.127873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dba46a5-4efa-46b8-b657-a1ac51578bed tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:40.128714 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dba46a5-4efa-46b8-b657-a1ac51578bed tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:40.129155 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dba46a5-4efa-46b8-b657-a1ac51578bed tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:40.299148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3dba46a5-4efa-46b8-b657-a1ac51578bed tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:40.308275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3dba46a5-4efa-46b8-b657-a1ac51578bed tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.194988 Jul 25 20:00:40.308885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1509/3174] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:40 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:41.330986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b519f0f6-812f-4563-9223-9123984a7ac6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:41.331611 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b519f0f6-812f-4563-9223-9123984a7ac6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:41.338391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b519f0f6-812f-4563-9223-9123984a7ac6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:41.338834 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b519f0f6-812f-4563-9223-9123984a7ac6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:41.339653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b519f0f6-812f-4563-9223-9123984a7ac6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:41.340088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b519f0f6-812f-4563-9223-9123984a7ac6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:41.487274 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b519f0f6-812f-4563-9223-9123984a7ac6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:41.495524 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b519f0f6-812f-4563-9223-9123984a7ac6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.168575 Jul 25 20:00:41.496099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1666/3175] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:41 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:42.522063 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-28af1c54-dafd-412d-a010-76a1fa21e924 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:42.523083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-28af1c54-dafd-412d-a010-76a1fa21e924 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:42.529895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28af1c54-dafd-412d-a010-76a1fa21e924 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:42.530342 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28af1c54-dafd-412d-a010-76a1fa21e924 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:42.531124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28af1c54-dafd-412d-a010-76a1fa21e924 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:42.531589 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28af1c54-dafd-412d-a010-76a1fa21e924 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:43.019490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-28af1c54-dafd-412d-a010-76a1fa21e924 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:43.028074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-28af1c54-dafd-412d-a010-76a1fa21e924 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.514115 Jul 25 20:00:43.028665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1510/3176] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:42 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:44.050858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3c09f415-fc99-4520-96ca-f1a772345aba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:44.051617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3c09f415-fc99-4520-96ca-f1a772345aba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:44.058511 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c09f415-fc99-4520-96ca-f1a772345aba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:44.058964 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c09f415-fc99-4520-96ca-f1a772345aba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:44.059791 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c09f415-fc99-4520-96ca-f1a772345aba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:44.060230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3c09f415-fc99-4520-96ca-f1a772345aba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:44.224272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3c09f415-fc99-4520-96ca-f1a772345aba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:44.233298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3c09f415-fc99-4520-96ca-f1a772345aba tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.186412 Jul 25 20:00:44.233878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1667/3177] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:44 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:45.256868 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f712f5e0-8229-4d53-9386-6a5904c7ed17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:45.257483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f712f5e0-8229-4d53-9386-6a5904c7ed17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:45.264550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f712f5e0-8229-4d53-9386-6a5904c7ed17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:45.264999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f712f5e0-8229-4d53-9386-6a5904c7ed17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:45.265776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f712f5e0-8229-4d53-9386-6a5904c7ed17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:45.266213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f712f5e0-8229-4d53-9386-6a5904c7ed17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:45.409416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f712f5e0-8229-4d53-9386-6a5904c7ed17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:45.423633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f712f5e0-8229-4d53-9386-6a5904c7ed17 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.170535 Jul 25 20:00:45.424865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1511/3178] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:45 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:46.446564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-93c90897-5bc2-4680-943c-df448303d78a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:46.447139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-93c90897-5bc2-4680-943c-df448303d78a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:46.453690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-93c90897-5bc2-4680-943c-df448303d78a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:46.454150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-93c90897-5bc2-4680-943c-df448303d78a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:46.454945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-93c90897-5bc2-4680-943c-df448303d78a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:46.455382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-93c90897-5bc2-4680-943c-df448303d78a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:46.593053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-93c90897-5bc2-4680-943c-df448303d78a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:46.602339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-93c90897-5bc2-4680-943c-df448303d78a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.159647 Jul 25 20:00:46.602927 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1668/3179] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:46 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:47.624948 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f109907d-dace-40b8-8135-0187948e7a52 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:47.625645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f109907d-dace-40b8-8135-0187948e7a52 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:47.632673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f109907d-dace-40b8-8135-0187948e7a52 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:47.633128 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f109907d-dace-40b8-8135-0187948e7a52 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:47.633898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f109907d-dace-40b8-8135-0187948e7a52 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:47.634364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f109907d-dace-40b8-8135-0187948e7a52 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:47.780160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f109907d-dace-40b8-8135-0187948e7a52 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:47.789821 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f109907d-dace-40b8-8135-0187948e7a52 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.168573 Jul 25 20:00:47.790404 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1512/3180] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:47 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:48.812537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9e49e935-47b0-46b7-8313-45f8005da70e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:48.813234 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9e49e935-47b0-46b7-8313-45f8005da70e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:48.822535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e49e935-47b0-46b7-8313-45f8005da70e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:48.823139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e49e935-47b0-46b7-8313-45f8005da70e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:48.824421 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e49e935-47b0-46b7-8313-45f8005da70e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:48.825193 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e49e935-47b0-46b7-8313-45f8005da70e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:49.023464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9e49e935-47b0-46b7-8313-45f8005da70e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:49.033127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9e49e935-47b0-46b7-8313-45f8005da70e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.223857 Jul 25 20:00:49.033478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1669/3181] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:48 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:50.060724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ef37d41-b7d1-424e-918b-a4e6ca639095 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:50.061760 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ef37d41-b7d1-424e-918b-a4e6ca639095 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:50.070667 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ef37d41-b7d1-424e-918b-a4e6ca639095 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:50.071169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ef37d41-b7d1-424e-918b-a4e6ca639095 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:50.072084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ef37d41-b7d1-424e-918b-a4e6ca639095 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:50.072575 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ef37d41-b7d1-424e-918b-a4e6ca639095 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:50.260192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0ef37d41-b7d1-424e-918b-a4e6ca639095 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:50.271293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ef37d41-b7d1-424e-918b-a4e6ca639095 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.214686 Jul 25 20:00:50.271928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1513/3182] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:50 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:51.296901 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a3e9160b-0b03-4460-83e1-08b663cb876f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:51.299003 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a3e9160b-0b03-4460-83e1-08b663cb876f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:51.307220 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3e9160b-0b03-4460-83e1-08b663cb876f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:51.307956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3e9160b-0b03-4460-83e1-08b663cb876f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:51.309057 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3e9160b-0b03-4460-83e1-08b663cb876f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:51.309552 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a3e9160b-0b03-4460-83e1-08b663cb876f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:51.316201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=78 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:00:51.474538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a3e9160b-0b03-4460-83e1-08b663cb876f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:51.483216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a3e9160b-0b03-4460-83e1-08b663cb876f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.191941 Jul 25 20:00:51.484081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1670/3183] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:51 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:52.507432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a0b973d5-c05d-403a-b3e4-58fb0646b803 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:52.513979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a0b973d5-c05d-403a-b3e4-58fb0646b803 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:52.514971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0b973d5-c05d-403a-b3e4-58fb0646b803 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:52.515534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0b973d5-c05d-403a-b3e4-58fb0646b803 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:52.516347 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0b973d5-c05d-403a-b3e4-58fb0646b803 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:52.516893 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0b973d5-c05d-403a-b3e4-58fb0646b803 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:52.662158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0b973d5-c05d-403a-b3e4-58fb0646b803 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:52.670748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a0b973d5-c05d-403a-b3e4-58fb0646b803 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.167283 Jul 25 20:00:52.671330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1514/3184] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:52 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:53.696276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e77ec4c4-c15a-43ee-9464-595fd5d3f62e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:53.696992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e77ec4c4-c15a-43ee-9464-595fd5d3f62e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:53.704553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e77ec4c4-c15a-43ee-9464-595fd5d3f62e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:53.705002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e77ec4c4-c15a-43ee-9464-595fd5d3f62e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:53.705790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e77ec4c4-c15a-43ee-9464-595fd5d3f62e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:53.706233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e77ec4c4-c15a-43ee-9464-595fd5d3f62e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:53.892623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e77ec4c4-c15a-43ee-9464-595fd5d3f62e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:53.901568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e77ec4c4-c15a-43ee-9464-595fd5d3f62e tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.210293 Jul 25 20:00:53.902133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1671/3185] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:53 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:54.924629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-10013895-634c-46ce-9f0d-d79e9604abc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:54.925300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-10013895-634c-46ce-9f0d-d79e9604abc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:54.927967 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:00:54.933926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10013895-634c-46ce-9f0d-d79e9604abc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:54.934377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10013895-634c-46ce-9f0d-d79e9604abc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:54.935160 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10013895-634c-46ce-9f0d-d79e9604abc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:54.935633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10013895-634c-46ce-9f0d-d79e9604abc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:55.099917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10013895-634c-46ce-9f0d-d79e9604abc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:55.108172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-10013895-634c-46ce-9f0d-d79e9604abc2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.188306 Jul 25 20:00:55.108763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1515/3186] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:54 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:56.131555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-335ee307-1c0f-4913-8dc7-fa452db0c685 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:56.132318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-335ee307-1c0f-4913-8dc7-fa452db0c685 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:56.134600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=26 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:00:56.140455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-335ee307-1c0f-4913-8dc7-fa452db0c685 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:56.140899 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-335ee307-1c0f-4913-8dc7-fa452db0c685 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:56.142385 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-335ee307-1c0f-4913-8dc7-fa452db0c685 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:56.142817 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-335ee307-1c0f-4913-8dc7-fa452db0c685 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:56.297207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-335ee307-1c0f-4913-8dc7-fa452db0c685 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:56.305953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-335ee307-1c0f-4913-8dc7-fa452db0c685 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.178239 Jul 25 20:00:56.306525 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1672/3187] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:56 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:00:57.331840 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5d656083-e952-49e4-9f0d-5395c7cfaa47 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:57.332823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5d656083-e952-49e4-9f0d-5395c7cfaa47 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:57.343261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d656083-e952-49e4-9f0d-5395c7cfaa47 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:57.344018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d656083-e952-49e4-9f0d-5395c7cfaa47 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:57.345270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d656083-e952-49e4-9f0d-5395c7cfaa47 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:57.345969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d656083-e952-49e4-9f0d-5395c7cfaa47 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:57.494610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5d656083-e952-49e4-9f0d-5395c7cfaa47 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:57.505972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5d656083-e952-49e4-9f0d-5395c7cfaa47 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.181178 Jul 25 20:00:57.506551 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1516/3188] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:57 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:58.529409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-58c0f810-1554-4560-9e86-facd6b845621 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:58.529990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-58c0f810-1554-4560-9e86-facd6b845621 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:58.538148 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58c0f810-1554-4560-9e86-facd6b845621 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:58.538588 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58c0f810-1554-4560-9e86-facd6b845621 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:58.539362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58c0f810-1554-4560-9e86-facd6b845621 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:58.539820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-58c0f810-1554-4560-9e86-facd6b845621 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:58.691386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-58c0f810-1554-4560-9e86-facd6b845621 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:58.699883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-58c0f810-1554-4560-9e86-facd6b845621 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.174550 Jul 25 20:00:58.700463 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1673/3189] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:58 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:00:59.722913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d445fa64-d685-4930-abed-896365c4e9c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:00:59.723600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d445fa64-d685-4930-abed-896365c4e9c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:00:59.730285 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d445fa64-d685-4930-abed-896365c4e9c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:59.730730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d445fa64-d685-4930-abed-896365c4e9c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:59.731501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d445fa64-d685-4930-abed-896365c4e9c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:59.731962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d445fa64-d685-4930-abed-896365c4e9c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:59.885911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d445fa64-d685-4930-abed-896365c4e9c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:00:59.894303 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d445fa64-d685-4930-abed-896365c4e9c2 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.175725 Jul 25 20:00:59.894888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1517/3190] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:00:59 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:00.918185 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4d3d48ea-c1a0-45b2-8cdb-b6090183d3fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:00.918863 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4d3d48ea-c1a0-45b2-8cdb-b6090183d3fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:00.926353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d3d48ea-c1a0-45b2-8cdb-b6090183d3fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:00.926801 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d3d48ea-c1a0-45b2-8cdb-b6090183d3fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:00.927600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d3d48ea-c1a0-45b2-8cdb-b6090183d3fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:00.928038 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4d3d48ea-c1a0-45b2-8cdb-b6090183d3fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:01.066431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-4d3d48ea-c1a0-45b2-8cdb-b6090183d3fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:01.074709 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4d3d48ea-c1a0-45b2-8cdb-b6090183d3fe tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.160348 Jul 25 20:01:01.075496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1674/3191] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:00 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:02.099297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5e869d31-019d-4c17-aa13-30733f49d730 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:02.100085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5e869d31-019d-4c17-aa13-30733f49d730 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:02.109318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e869d31-019d-4c17-aa13-30733f49d730 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:02.110068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e869d31-019d-4c17-aa13-30733f49d730 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:02.111831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e869d31-019d-4c17-aa13-30733f49d730 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:02.112581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e869d31-019d-4c17-aa13-30733f49d730 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:02.274926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5e869d31-019d-4c17-aa13-30733f49d730 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:02.291869 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5e869d31-019d-4c17-aa13-30733f49d730 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.198366 Jul 25 20:01:02.292345 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1518/3192] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:02 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:03.317808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-40ae7177-a0db-40b5-a467-e2bac5d10c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:03.318732 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-40ae7177-a0db-40b5-a467-e2bac5d10c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:03.326262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40ae7177-a0db-40b5-a467-e2bac5d10c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:03.326714 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40ae7177-a0db-40b5-a467-e2bac5d10c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:03.327495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40ae7177-a0db-40b5-a467-e2bac5d10c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:03.327965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-40ae7177-a0db-40b5-a467-e2bac5d10c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:03.508630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-40ae7177-a0db-40b5-a467-e2bac5d10c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:03.520140 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-40ae7177-a0db-40b5-a467-e2bac5d10c14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.206822 Jul 25 20:01:03.520739 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1675/3193] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:03 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:04.542275 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5a276487-bebb-40a4-a923-5920e68eda08 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:04.542980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5a276487-bebb-40a4-a923-5920e68eda08 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:04.549959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a276487-bebb-40a4-a923-5920e68eda08 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:04.550409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a276487-bebb-40a4-a923-5920e68eda08 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:04.551197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a276487-bebb-40a4-a923-5920e68eda08 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:04.551668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a276487-bebb-40a4-a923-5920e68eda08 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:04.690892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5a276487-bebb-40a4-a923-5920e68eda08 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:04.699169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5a276487-bebb-40a4-a923-5920e68eda08 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.161018 Jul 25 20:01:04.699795 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1519/3194] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:04 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:05.722676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-584d1501-2de5-4bd0-9ce9-a78ff0b8c1ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:05.723372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-584d1501-2de5-4bd0-9ce9-a78ff0b8c1ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:05.730092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-584d1501-2de5-4bd0-9ce9-a78ff0b8c1ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:05.730536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-584d1501-2de5-4bd0-9ce9-a78ff0b8c1ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:05.731305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-584d1501-2de5-4bd0-9ce9-a78ff0b8c1ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:05.731784 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-584d1501-2de5-4bd0-9ce9-a78ff0b8c1ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:05.885235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-584d1501-2de5-4bd0-9ce9-a78ff0b8c1ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:05.893794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-584d1501-2de5-4bd0-9ce9-a78ff0b8c1ce tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.175736 Jul 25 20:01:05.894378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1676/3195] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:05 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:06.916228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6badf150-333e-42ae-9647-f08f6bb521a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:06.916842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6badf150-333e-42ae-9647-f08f6bb521a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:06.924449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6badf150-333e-42ae-9647-f08f6bb521a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:06.924938 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6badf150-333e-42ae-9647-f08f6bb521a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:06.925723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6badf150-333e-42ae-9647-f08f6bb521a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:06.926157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6badf150-333e-42ae-9647-f08f6bb521a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:06.929102 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:07.077200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6badf150-333e-42ae-9647-f08f6bb521a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:07.089770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6badf150-333e-42ae-9647-f08f6bb521a4 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.177010 Jul 25 20:01:07.090638 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1520/3196] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:06 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:08.115031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c930fef2-e4a5-4053-921a-6ef3d28c47e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:08.115951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c930fef2-e4a5-4053-921a-6ef3d28c47e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:08.126495 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c930fef2-e4a5-4053-921a-6ef3d28c47e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:08.127163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c930fef2-e4a5-4053-921a-6ef3d28c47e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:08.128028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c930fef2-e4a5-4053-921a-6ef3d28c47e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:08.128476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c930fef2-e4a5-4053-921a-6ef3d28c47e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:08.288762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c930fef2-e4a5-4053-921a-6ef3d28c47e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:08.296973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c930fef2-e4a5-4053-921a-6ef3d28c47e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.186082 Jul 25 20:01:08.298225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1677/3197] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:08 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:09.323151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd396839-a29d-494a-bb26-6a5373c00386 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:09.323861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd396839-a29d-494a-bb26-6a5373c00386 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:09.332153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd396839-a29d-494a-bb26-6a5373c00386 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:09.332661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd396839-a29d-494a-bb26-6a5373c00386 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:09.333587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd396839-a29d-494a-bb26-6a5373c00386 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:09.334082 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd396839-a29d-494a-bb26-6a5373c00386 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:09.495007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd396839-a29d-494a-bb26-6a5373c00386 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:09.505540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd396839-a29d-494a-bb26-6a5373c00386 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.186376 Jul 25 20:01:09.506511 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1521/3198] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:09 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:10.438851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-979cd7c2-058e-47ea-b979-4596f03f6d77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b39ef8e8-c290-4917-85ff-0478bebddb52"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:10.441924 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-979cd7c2-058e-47ea-b979-4596f03f6d77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:10.449458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-979cd7c2-058e-47ea-b979-4596f03f6d77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:10.449911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-979cd7c2-058e-47ea-b979-4596f03f6d77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:10.450737 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-979cd7c2-058e-47ea-b979-4596f03f6d77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:10.451143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-979cd7c2-058e-47ea-b979-4596f03f6d77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:10.529724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2acd5626-303e-4ef0-9dac-f6eeb5fd015b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:10.530354 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2acd5626-303e-4ef0-9dac-f6eeb5fd015b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:10.540459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2acd5626-303e-4ef0-9dac-f6eeb5fd015b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:10.540993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2acd5626-303e-4ef0-9dac-f6eeb5fd015b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:10.542224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2acd5626-303e-4ef0-9dac-f6eeb5fd015b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:10.542788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2acd5626-303e-4ef0-9dac-f6eeb5fd015b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:10.660278 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR oslo.messaging._drivers.impl_rabbit [None req-979cd7c2-058e-47ea-b979-4596f03f6d77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [47e596c0-772b-4872-b6b4-6b10f3470139] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 20:01:10.702387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2acd5626-303e-4ef0-9dac-f6eeb5fd015b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:10.712037 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2acd5626-303e-4ef0-9dac-f6eeb5fd015b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1717 microversion: 2.1 time: 0.186134 Jul 25 20:01:10.712615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1522/3199] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:10 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1717 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:11.667882 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [None req-979cd7c2-058e-47ea-b979-4596f03f6d77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [47e596c0-772b-4872-b6b4-6b10f3470139] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42544. Jul 25 20:01:11.736651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d4243076-23bf-4c7f-b2fa-be8c18955990 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:11.737264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d4243076-23bf-4c7f-b2fa-be8c18955990 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:11.744382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4243076-23bf-4c7f-b2fa-be8c18955990 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:11.744927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4243076-23bf-4c7f-b2fa-be8c18955990 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:11.745793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4243076-23bf-4c7f-b2fa-be8c18955990 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:11.746301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4243076-23bf-4c7f-b2fa-be8c18955990 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:11.891491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d4243076-23bf-4c7f-b2fa-be8c18955990 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:11.899454 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d4243076-23bf-4c7f-b2fa-be8c18955990 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1671 microversion: 2.1 time: 0.167037 Jul 25 20:01:11.903561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1523/3200] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:11 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:12.922921 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-59931d25-e9fb-49c2-ab6a-a3ec215908e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:12.923669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-59931d25-e9fb-49c2-ab6a-a3ec215908e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:12.930230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59931d25-e9fb-49c2-ab6a-a3ec215908e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:12.930675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59931d25-e9fb-49c2-ab6a-a3ec215908e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:12.931439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59931d25-e9fb-49c2-ab6a-a3ec215908e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:12.931904 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59931d25-e9fb-49c2-ab6a-a3ec215908e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:13.071717 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-59931d25-e9fb-49c2-ab6a-a3ec215908e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:13.080261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-59931d25-e9fb-49c2-ab6a-a3ec215908e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1671 microversion: 2.1 time: 0.161744 Jul 25 20:01:13.080999 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1524/3201] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:12 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:14.102812 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-522a89b2-0ef1-47c8-ba65-cbf202772b76 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:14.103558 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-522a89b2-0ef1-47c8-ba65-cbf202772b76 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:14.110979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-522a89b2-0ef1-47c8-ba65-cbf202772b76 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:14.111683 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-522a89b2-0ef1-47c8-ba65-cbf202772b76 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:14.112475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-522a89b2-0ef1-47c8-ba65-cbf202772b76 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:14.112914 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-522a89b2-0ef1-47c8-ba65-cbf202772b76 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:14.251890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-522a89b2-0ef1-47c8-ba65-cbf202772b76 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:14.259540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-522a89b2-0ef1-47c8-ba65-cbf202772b76 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1671 microversion: 2.1 time: 0.160544 Jul 25 20:01:14.260224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1525/3202] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:14 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:15.283058 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f065ed1-ec52-4f33-97e6-99fa66f0d644 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:15.283831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2f065ed1-ec52-4f33-97e6-99fa66f0d644 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:15.290241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f065ed1-ec52-4f33-97e6-99fa66f0d644 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:15.290894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f065ed1-ec52-4f33-97e6-99fa66f0d644 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:15.291699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f065ed1-ec52-4f33-97e6-99fa66f0d644 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:15.292330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f065ed1-ec52-4f33-97e6-99fa66f0d644 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:15.436727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2f065ed1-ec52-4f33-97e6-99fa66f0d644 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:15.445593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2f065ed1-ec52-4f33-97e6-99fa66f0d644 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1671 microversion: 2.1 time: 0.167132 Jul 25 20:01:15.453177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-979cd7c2-058e-47ea-b979-4596f03f6d77 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "POST /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.018399 Jul 25 20:01:15.455717 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1678/3203] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 20:01:10 2022] POST /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-volume_attachments => generated 194 bytes in 5021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:15.460372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1526/3204] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:15 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:16.477198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a2719ffc-040d-47c6-bd50-cf558c15d799 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:16.478202 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a2719ffc-040d-47c6-bd50-cf558c15d799 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:16.489091 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2719ffc-040d-47c6-bd50-cf558c15d799 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:16.489849 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2719ffc-040d-47c6-bd50-cf558c15d799 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:16.491177 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2719ffc-040d-47c6-bd50-cf558c15d799 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:16.492561 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a2719ffc-040d-47c6-bd50-cf558c15d799 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:16.590416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a2719ffc-040d-47c6-bd50-cf558c15d799 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:16.601418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a2719ffc-040d-47c6-bd50-cf558c15d799 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1605 microversion: 2.1 time: 0.128234 Jul 25 20:01:16.603231 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1679/3205] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:16 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1605 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:16.623227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-274ec882-ee63-4c75-83e7-c9b406164fd1 req-ca98b473-6f43-4895-b186-bda74f16b599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f20ea26-3cf4-4cfd-820d-dc05ed15b079", "name": "network-vif-deleted", "tag": "1ade161c-f9c0-488a-9248-931d1a9d4469"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:16.634593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-274ec882-ee63-4c75-83e7-c9b406164fd1 req-ca98b473-6f43-4895-b186-bda74f16b599 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:16.635330 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-274ec882-ee63-4c75-83e7-c9b406164fd1 req-ca98b473-6f43-4895-b186-bda74f16b599 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:16.652382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-274ec882-ee63-4c75-83e7-c9b406164fd1 req-ca98b473-6f43-4895-b186-bda74f16b599 service nova] Creating event network-vif-deleted:1ade161c-f9c0-488a-9248-931d1a9d4469 for instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 on hv-cinder-85093 Jul 25 20:01:16.658365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-274ec882-ee63-4c75-83e7-c9b406164fd1 req-ca98b473-6f43-4895-b186-bda74f16b599 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151153 Jul 25 20:01:16.659647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1527/3206] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:01:17.632200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:17.633891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:17.643045 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:17.644010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:17.645957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:17.646713 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:17.693169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:17.693734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:17.694464 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lazy-loading 'fault' on Instance uuid 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:01:17.784273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:17.796836 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-65a7c34b-3f3f-4790-98d0-345c083f435b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 200 len: 1327 microversion: 2.1 time: 0.172487 Jul 25 20:01:17.803923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1680/3207] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:17 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 1327 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:18.675762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-2da9fe9a-5647-4b11-8204-ddf95500ccdb req-ec07fa96-9fca-4264-b560-2299580a8dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d238c56a-d3fb-4eaa-abb6-4f9155523e90", "name": "network-vif-deleted", "tag": "3eb28b0d-848d-465c-8ce3-db043d446935"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:18.685750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-2da9fe9a-5647-4b11-8204-ddf95500ccdb req-ec07fa96-9fca-4264-b560-2299580a8dc7 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:18.686164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-2da9fe9a-5647-4b11-8204-ddf95500ccdb req-ec07fa96-9fca-4264-b560-2299580a8dc7 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:18.697613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-2da9fe9a-5647-4b11-8204-ddf95500ccdb req-ec07fa96-9fca-4264-b560-2299580a8dc7 service nova] Creating event network-vif-deleted:3eb28b0d-848d-465c-8ce3-db043d446935 for instance d238c56a-d3fb-4eaa-abb6-4f9155523e90 on hv-cinder-85093 Jul 25 20:01:18.702832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-2da9fe9a-5647-4b11-8204-ddf95500ccdb req-ec07fa96-9fca-4264-b560-2299580a8dc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032998 Jul 25 20:01:18.703741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1528/3208] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:18.824777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-abf83b39-98dc-4550-afd9-cb0298b0107d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:18.825388 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-abf83b39-98dc-4550-afd9-cb0298b0107d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:18.833413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-abf83b39-98dc-4550-afd9-cb0298b0107d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:18.834195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-abf83b39-98dc-4550-afd9-cb0298b0107d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:18.835076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-abf83b39-98dc-4550-afd9-cb0298b0107d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:18.835717 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-abf83b39-98dc-4550-afd9-cb0298b0107d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:18.851902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-abf83b39-98dc-4550-afd9-cb0298b0107d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] HTTP exception thrown: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-abf83b39-98dc-4550-afd9-cb0298b0107d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Request method failure captured: Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 HTTP/1.1 Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u6VVUYSQHIFG-L_lu1e7YcRk8eV3szLxOlsgNguJe0NgzH51ENH5GUwS7heM4UePn22C8zgQywzGDDa5aZrsEN_vha-ETr2N912yVLwwXtt1JMJhFHjkEYS1-86Xu3zvGj0F-hKtueeQiB0XZ_dq7nCtSS6W3eb5GFSilgh1C10ELY Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:01:18.853583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac9a533f6f6f49e2bd73771fc99919c0", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 581ae6d40d34447da6651f3b2c21bdf0 Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:01:18.855204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '7f20ea26-3cf4-4cfd-820d-dc05ed15b079'} Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:18.856347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:01:18.857824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:18.859180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-abf83b39-98dc-4550-afd9-cb0298b0107d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Returning 404 to user: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:18.859180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-abf83b39-98dc-4550-afd9-cb0298b0107d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 404 len: 111 microversion: 2.1 time: 0.034754 Jul 25 20:01:18.859180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1681/3209] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:18 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:18.866936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-14e200aa-ef63-4330-b7a2-f80a27df4dd8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '.version_select at 0x7feb087a7dc0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:18.893916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-14e200aa-ef63-4330-b7a2-f80a27df4dd8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925335282" status: 202 len: 0 microversion: 2.1 time: 0.032069 Jul 25 20:01:18.894706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1529/3210] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Jul 25 20:01:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925335282 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:19.761166 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9bb01c6b-4b06-448e-ab3a-78356328b825 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Action: 'create', calling method: .version_select at 0x7feb0c46b9d0>, body: {"keypair": {"name": "tempest-keypair-886499556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzSuHmIpY/w1vq6EsFxQtlFJEkoopLXDNMgTJaN9tJYI6S+2i6w90t7x99NPqenOXFmKXBnMgDvtmU39od0K+3y37x4iGCvctFo3RgsZ89iWdhH04q2h6d+M45ErxjOPA=="}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:19.780411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-9bb01c6b-4b06-448e-ab3a-78356328b825 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Getting quotas for project ac9a533f6f6f49e2bd73771fc99919c0. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:01:19.785440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-9bb01c6b-4b06-448e-ab3a-78356328b825 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Getting quotas for user 581ae6d40d34447da6651f3b2c21bdf0 and project ac9a533f6f6f49e2bd73771fc99919c0. Resources: {'key_pairs'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:01:19.811981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9bb01c6b-4b06-448e-ab3a-78356328b825 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058941 Jul 25 20:01:19.812651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1682/3211] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Jul 25 20:01:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:21.498642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1489326809", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34810a1c-22b1-48d9-b272-3e2c508f82c9"}], "security_groups": [{"name": "tempest-securitygroup--1116473617"}], "key_name": "tempest-keypair-886499556", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:21.835434 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] validate_networks() for [('34810a1c-22b1-48d9-b272-3e2c508f82c9', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:01:22.517299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:01:22.517943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:01:22.518175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:01:22.518678 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:01:22.518993 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:01:22.528718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:22.529363 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:22.530259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:22.530736 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:22.550332 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Getting quotas for project ac9a533f6f6f49e2bd73771fc99919c0. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:01:22.554752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Getting quotas for user 581ae6d40d34447da6651f3b2c21bdf0 and project ac9a533f6f6f49e2bd73771fc99919c0. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:01:22.567580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:01:22.570213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:01:22.619620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8dff620f-f005-475c-af98-363a13461a0b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.125737 Jul 25 20:01:22.620528 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1530/3212] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:01:22.632515 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-19f3a791-2751-40ae-844a-928afa5cb60f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:22.633943 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-19f3a791-2751-40ae-844a-928afa5cb60f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:22.713271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-19f3a791-2751-40ae-844a-928afa5cb60f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:22.721158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-19f3a791-2751-40ae-844a-928afa5cb60f tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1237 microversion: 2.1 time: 0.093048 Jul 25 20:01:22.721749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1683/3213] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:22 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:23.745304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e19830ea-50e7-4a4e-9862-ad899524531d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:23.746845 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e19830ea-50e7-4a4e-9862-ad899524531d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:23.756965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e19830ea-50e7-4a4e-9862-ad899524531d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:23.757746 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e19830ea-50e7-4a4e-9862-ad899524531d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:23.759020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e19830ea-50e7-4a4e-9862-ad899524531d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:23.759702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e19830ea-50e7-4a4e-9862-ad899524531d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:23.851899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e19830ea-50e7-4a4e-9862-ad899524531d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:23.860749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e19830ea-50e7-4a4e-9862-ad899524531d tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1233 microversion: 2.1 time: 0.121154 Jul 25 20:01:23.861340 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1531/3214] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:23 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1233 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:24.653113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3f9d7ed6-ce78-46d2-85ba-288cec6678e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:24.653722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3f9d7ed6-ce78-46d2-85ba-288cec6678e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:24.659990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f9d7ed6-ce78-46d2-85ba-288cec6678e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:24.660441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f9d7ed6-ce78-46d2-85ba-288cec6678e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:24.661389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f9d7ed6-ce78-46d2-85ba-288cec6678e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:24.662030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3f9d7ed6-ce78-46d2-85ba-288cec6678e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:24.666502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:24.772070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-3f9d7ed6-ce78-46d2-85ba-288cec6678e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lazy-loading 'services' on Instance uuid 31db936e-3df3-4d8b-82f6-2022cfcc5227 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:01:24.885119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e6a57991-88d2-48af-b47b-e25f2c99f70b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:24.886023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e6a57991-88d2-48af-b47b-e25f2c99f70b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:24.887215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3f9d7ed6-ce78-46d2-85ba-288cec6678e3 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-volume_attachments/b39ef8e8-c290-4917-85ff-0478bebddb52" status: 202 len: 0 microversion: 2.1 time: 0.237773 Jul 25 20:01:24.887869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1684/3215] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 20:01:24 2022] DELETE /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-volume_attachments/b39ef8e8-c290-4917-85ff-0478bebddb52 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:24.897472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6a57991-88d2-48af-b47b-e25f2c99f70b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:24.898223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6a57991-88d2-48af-b47b-e25f2c99f70b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:24.899371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6a57991-88d2-48af-b47b-e25f2c99f70b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:24.905305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6a57991-88d2-48af-b47b-e25f2c99f70b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:24.911409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cecbfa6b-ab2d-4009-81ec-612c0083ae9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:24.915127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cecbfa6b-ab2d-4009-81ec-612c0083ae9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:24.939496 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cecbfa6b-ab2d-4009-81ec-612c0083ae9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:24.941126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cecbfa6b-ab2d-4009-81ec-612c0083ae9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:24.943092 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cecbfa6b-ab2d-4009-81ec-612c0083ae9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:24.943665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cecbfa6b-ab2d-4009-81ec-612c0083ae9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:24.997657 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cecbfa6b-ab2d-4009-81ec-612c0083ae9c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101052 Jul 25 20:01:24.998516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1685/3216] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 20:01:24 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:01:25.016356 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e6a57991-88d2-48af-b47b-e25f2c99f70b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:25.024277 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e6a57991-88d2-48af-b47b-e25f2c99f70b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1307 microversion: 2.1 time: 0.143772 Jul 25 20:01:25.024860 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1532/3217] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:24 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1307 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:26.010456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a74fd774-6ef0-4ce8-918d-45fc66802784 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:26.013506 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a74fd774-6ef0-4ce8-918d-45fc66802784 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:26.025281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a74fd774-6ef0-4ce8-918d-45fc66802784 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:26.025785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a74fd774-6ef0-4ce8-918d-45fc66802784 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:26.026573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a74fd774-6ef0-4ce8-918d-45fc66802784 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:26.027039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a74fd774-6ef0-4ce8-918d-45fc66802784 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:26.050752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e471db23-7498-48df-aa1b-41681454eb98 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:26.053604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e471db23-7498-48df-aa1b-41681454eb98 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:26.057495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:26.074658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a74fd774-6ef0-4ce8-918d-45fc66802784 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067978 Jul 25 20:01:26.075807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1686/3218] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 20:01:26 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:26.089272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e471db23-7498-48df-aa1b-41681454eb98 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:26.089735 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e471db23-7498-48df-aa1b-41681454eb98 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:26.093898 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e471db23-7498-48df-aa1b-41681454eb98 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:26.094377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e471db23-7498-48df-aa1b-41681454eb98 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:26.387767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e471db23-7498-48df-aa1b-41681454eb98 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:26.403337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e471db23-7498-48df-aa1b-41681454eb98 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1363 microversion: 2.1 time: 0.357022 Jul 25 20:01:26.404440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1533/3219] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:26 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:27.119224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-febef29e-5a1a-4e3d-9d5d-5f071b40fdc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:27.132334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-febef29e-5a1a-4e3d-9d5d-5f071b40fdc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:27.147826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:27.175328 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-febef29e-5a1a-4e3d-9d5d-5f071b40fdc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:27.176793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-febef29e-5a1a-4e3d-9d5d-5f071b40fdc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:27.179353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-febef29e-5a1a-4e3d-9d5d-5f071b40fdc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:27.180477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-febef29e-5a1a-4e3d-9d5d-5f071b40fdc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:27.280709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-729b1756-f96c-4a6f-a55d-7714addef9d8 req-a3464774-3cf6-4ee4-9495-0bbd8a8ad1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ebc6aab-df38-4a7b-a10a-5c283a8843ee", "tag": "e19cb456-2276-48ce-9c45-b121d994a82f"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:27.322158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-febef29e-5a1a-4e3d-9d5d-5f071b40fdc1 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.232756 Jul 25 20:01:27.326742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-729b1756-f96c-4a6f-a55d-7714addef9d8 req-a3464774-3cf6-4ee4-9495-0bbd8a8ad1e9 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:27.327765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-729b1756-f96c-4a6f-a55d-7714addef9d8 req-a3464774-3cf6-4ee4-9495-0bbd8a8ad1e9 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:27.332000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1687/3220] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 20:01:27 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227/os-volume_attachments => generated 25 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:01:27.367319 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-729b1756-f96c-4a6f-a55d-7714addef9d8 req-a3464774-3cf6-4ee4-9495-0bbd8a8ad1e9 service nova] Creating event network-changed:e19cb456-2276-48ce-9c45-b121d994a82f for instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee on hv-cinder-85093 Jul 25 20:01:27.375466 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-729b1756-f96c-4a6f-a55d-7714addef9d8 req-a3464774-3cf6-4ee4-9495-0bbd8a8ad1e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109750 Jul 25 20:01:27.376942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1534/3221] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:01:27.427788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c38e1479-263f-47b6-86b3-4e01b9298234 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:27.428587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c38e1479-263f-47b6-86b3-4e01b9298234 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:27.442940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c38e1479-263f-47b6-86b3-4e01b9298234 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:27.442940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c38e1479-263f-47b6-86b3-4e01b9298234 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:27.442940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c38e1479-263f-47b6-86b3-4e01b9298234 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:27.442940 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c38e1479-263f-47b6-86b3-4e01b9298234 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:27.460734 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a09ac1f6-d72a-4def-ba7c-4603fc68a23b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:27.461486 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a09ac1f6-d72a-4def-ba7c-4603fc68a23b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:27.469126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a09ac1f6-d72a-4def-ba7c-4603fc68a23b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:27.469730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a09ac1f6-d72a-4def-ba7c-4603fc68a23b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:27.470881 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a09ac1f6-d72a-4def-ba7c-4603fc68a23b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:27.471612 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a09ac1f6-d72a-4def-ba7c-4603fc68a23b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:27.523833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a09ac1f6-d72a-4def-ba7c-4603fc68a23b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:01:27.669070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a09ac1f6-d72a-4def-ba7c-4603fc68a23b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 204 len: 0 microversion: 2.1 time: 0.216172 Jul 25 20:01:27.669981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1535/3222] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:01:27 2022] DELETE /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:01:27.688365 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-36f294ad-b220-418f-8f88-9f6f6d23c883 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:27.689441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-36f294ad-b220-418f-8f88-9f6f6d23c883 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:27.699817 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36f294ad-b220-418f-8f88-9f6f6d23c883 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:27.700473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36f294ad-b220-418f-8f88-9f6f6d23c883 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:27.701564 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36f294ad-b220-418f-8f88-9f6f6d23c883 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:27.702158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36f294ad-b220-418f-8f88-9f6f6d23c883 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:27.772476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c38e1479-263f-47b6-86b3-4e01b9298234 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:27.780856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c38e1479-263f-47b6-86b3-4e01b9298234 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1363 microversion: 2.1 time: 0.357823 Jul 25 20:01:27.782477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1688/3223] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:27 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:27.883107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-36f294ad-b220-418f-8f88-9f6f6d23c883 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:27.890957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-36f294ad-b220-418f-8f88-9f6f6d23c883 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1680 microversion: 2.1 time: 0.212351 Jul 25 20:01:27.891563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1536/3224] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:27 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:28.805626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-10cb180b-f438-4bae-8d2c-6dfb88aa2552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:28.806035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-10cb180b-f438-4bae-8d2c-6dfb88aa2552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:28.813276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-10cb180b-f438-4bae-8d2c-6dfb88aa2552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:28.813789 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-10cb180b-f438-4bae-8d2c-6dfb88aa2552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:28.814751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-10cb180b-f438-4bae-8d2c-6dfb88aa2552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:28.815200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-10cb180b-f438-4bae-8d2c-6dfb88aa2552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:28.918130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1267fa68-1a84-4ddf-a096-4f4838bd6646 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:28.920946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1267fa68-1a84-4ddf-a096-4f4838bd6646 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:28.931036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1267fa68-1a84-4ddf-a096-4f4838bd6646 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:28.931820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1267fa68-1a84-4ddf-a096-4f4838bd6646 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:28.932857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1267fa68-1a84-4ddf-a096-4f4838bd6646 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:28.933493 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1267fa68-1a84-4ddf-a096-4f4838bd6646 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:29.323029 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-10cb180b-f438-4bae-8d2c-6dfb88aa2552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:29.335595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1267fa68-1a84-4ddf-a096-4f4838bd6646 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:29.335977 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-10cb180b-f438-4bae-8d2c-6dfb88aa2552 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1363 microversion: 2.1 time: 0.534751 Jul 25 20:01:29.336626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1689/3225] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:28 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1363 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:29.362594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1267fa68-1a84-4ddf-a096-4f4838bd6646 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1680 microversion: 2.1 time: 0.452575 Jul 25 20:01:29.363209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1537/3226] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:28 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1680 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:30.363225 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7fe67355-8538-4bec-b1d7-345567827fdf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:30.363898 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7fe67355-8538-4bec-b1d7-345567827fdf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:30.370749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe67355-8538-4bec-b1d7-345567827fdf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:30.371200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe67355-8538-4bec-b1d7-345567827fdf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:30.372012 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe67355-8538-4bec-b1d7-345567827fdf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:30.372454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7fe67355-8538-4bec-b1d7-345567827fdf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:30.384928 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-60906321-3afe-4b57-9835-171abf5eb601 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:30.385550 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-60906321-3afe-4b57-9835-171abf5eb601 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:30.392658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60906321-3afe-4b57-9835-171abf5eb601 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:30.394209 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60906321-3afe-4b57-9835-171abf5eb601 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:30.395009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60906321-3afe-4b57-9835-171abf5eb601 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:30.395452 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60906321-3afe-4b57-9835-171abf5eb601 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:30.591455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7fe67355-8538-4bec-b1d7-345567827fdf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:30.595997 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60906321-3afe-4b57-9835-171abf5eb601 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:30.598803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:30.600158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7fe67355-8538-4bec-b1d7-345567827fdf tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1363 microversion: 2.1 time: 0.240820 Jul 25 20:01:30.601227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1690/3227] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:30 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:30.606163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-60906321-3afe-4b57-9835-171abf5eb601 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1680 microversion: 2.1 time: 0.224919 Jul 25 20:01:30.606807 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1538/3228] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:30 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:31.621859 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-48b1d326-d719-4430-b091-6de628233d14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:31.624545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-48b1d326-d719-4430-b091-6de628233d14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:31.632907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48b1d326-d719-4430-b091-6de628233d14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:31.633297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a0095d0e-6e91-4494-ae5e-47c0f4a051de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:31.633819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48b1d326-d719-4430-b091-6de628233d14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:31.633932 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a0095d0e-6e91-4494-ae5e-47c0f4a051de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:31.634597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48b1d326-d719-4430-b091-6de628233d14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:31.635612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-48b1d326-d719-4430-b091-6de628233d14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:31.645943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0095d0e-6e91-4494-ae5e-47c0f4a051de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:31.646918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0095d0e-6e91-4494-ae5e-47c0f4a051de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:31.648064 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0095d0e-6e91-4494-ae5e-47c0f4a051de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:31.648871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0095d0e-6e91-4494-ae5e-47c0f4a051de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:31.805510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0095d0e-6e91-4494-ae5e-47c0f4a051de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:31.814399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a0095d0e-6e91-4494-ae5e-47c0f4a051de tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1613 microversion: 2.1 time: 0.188241 Jul 25 20:01:31.814994 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1539/3229] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:31 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1613 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:31.932115 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-48b1d326-d719-4430-b091-6de628233d14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:31.942661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-48b1d326-d719-4430-b091-6de628233d14 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1363 microversion: 2.1 time: 0.324708 Jul 25 20:01:31.943476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1691/3230] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:31 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:32.147882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-0dea2b24-044b-46ac-9ac8-394ced271712 req-aaff24b7-3c3c-4a1e-a152-b837a9c1da64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31db936e-3df3-4d8b-82f6-2022cfcc5227", "name": "network-vif-deleted", "tag": "ae264aa0-c829-48d9-9c93-f11be9a04f72"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:32.170647 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0dea2b24-044b-46ac-9ac8-394ced271712 req-aaff24b7-3c3c-4a1e-a152-b837a9c1da64 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:32.172278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0dea2b24-044b-46ac-9ac8-394ced271712 req-aaff24b7-3c3c-4a1e-a152-b837a9c1da64 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:32.192682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-0dea2b24-044b-46ac-9ac8-394ced271712 req-aaff24b7-3c3c-4a1e-a152-b837a9c1da64 service nova] Creating event network-vif-deleted:ae264aa0-c829-48d9-9c93-f11be9a04f72 for instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 on hv-cinder-85093 Jul 25 20:01:32.200193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-0dea2b24-044b-46ac-9ac8-394ced271712 req-aaff24b7-3c3c-4a1e-a152-b837a9c1da64 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056456 Jul 25 20:01:32.201941 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1540/3231] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:32.838451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:32.839164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:32.843049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=6 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:32.848805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:32.849361 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:32.850244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:32.851024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:32.906931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:32.912401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:32.913346 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lazy-loading 'fault' on Instance uuid 31db936e-3df3-4d8b-82f6-2022cfcc5227 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:01:32.969703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1823438e-f704-4665-8634-ee29658e2e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:32.971536 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1823438e-f704-4665-8634-ee29658e2e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:32.974645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecf34ceee294b53b5be7c1723b42950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8185baa0f3e3465f813c0e2dc29ad847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:32.975351 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:32.976673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:32.983722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1823438e-f704-4665-8634-ee29658e2e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:32.985166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1823438e-f704-4665-8634-ee29658e2e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:32.985957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-af60bf5c-cceb-4cd5-8ab1-717bf4884d0b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 200 len: 1332 microversion: 2.1 time: 0.151458 Jul 25 20:01:32.986674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1823438e-f704-4665-8634-ee29658e2e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:32.987481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1823438e-f704-4665-8634-ee29658e2e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:32.991382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1692/3232] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:32 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 1332 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:33.201863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1823438e-f704-4665-8634-ee29658e2e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:33.212913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1823438e-f704-4665-8634-ee29658e2e84 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1363 microversion: 2.1 time: 0.250238 Jul 25 20:01:33.214397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1541/3233] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:32 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:34.010947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9e9c7f76-96d8-481e-87f1-bb407fac6544 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:34.011718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9e9c7f76-96d8-481e-87f1-bb407fac6544 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:34.020170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e9c7f76-96d8-481e-87f1-bb407fac6544 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:34.020979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e9c7f76-96d8-481e-87f1-bb407fac6544 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:34.021804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e9c7f76-96d8-481e-87f1-bb407fac6544 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:34.022303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9e9c7f76-96d8-481e-87f1-bb407fac6544 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:34.037536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-9e9c7f76-96d8-481e-87f1-bb407fac6544 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9e9c7f76-96d8-481e-87f1-bb407fac6544 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 HTTP/1.1 Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:01:34.039335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:34.041518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '31db936e-3df3-4d8b-82f6-2022cfcc5227'} Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:34.042616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:34.044136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:34.045746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9e9c7f76-96d8-481e-87f1-bb407fac6544 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:34.045746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9e9c7f76-96d8-481e-87f1-bb407fac6544 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 404 len: 111 microversion: 2.1 time: 0.034195 Jul 25 20:01:34.045746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1693/3234] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:34 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:34.051837 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c34ffb52-47a3-4561-b956-c4df57a5f238 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '.version_select at 0x7feb0c49ff70>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:34.074383 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c34ffb52-47a3-4561-b956-c4df57a5f238 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188869481" status: 202 len: 0 microversion: 2.1 time: 0.027035 Jul 25 20:01:34.074974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1542/3235] 10.222.0.18 () {58 vars in 1221 bytes} [Mon Jul 25 20:01:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188869481 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:34.247180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cbcaae82-2ec5-4de6-98d9-f63c5c6e5ae3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:34.253023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cbcaae82-2ec5-4de6-98d9-f63c5c6e5ae3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:34.263111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cbcaae82-2ec5-4de6-98d9-f63c5c6e5ae3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:34.263944 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cbcaae82-2ec5-4de6-98d9-f63c5c6e5ae3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:34.265362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cbcaae82-2ec5-4de6-98d9-f63c5c6e5ae3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:34.265983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cbcaae82-2ec5-4de6-98d9-f63c5c6e5ae3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:34.515630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-52c8a359-dbaf-4e83-9f46-90237443b6d2 req-8b5c8223-e590-40a1-95ae-1c67037ff543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebc6aab-df38-4a7b-a10a-5c283a8843ee", "name": "network-vif-plugged", "status": "completed", "tag": "e19cb456-2276-48ce-9c45-b121d994a82f"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:34.534498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-52c8a359-dbaf-4e83-9f46-90237443b6d2 req-8b5c8223-e590-40a1-95ae-1c67037ff543 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:34.535433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-52c8a359-dbaf-4e83-9f46-90237443b6d2 req-8b5c8223-e590-40a1-95ae-1c67037ff543 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:34.552116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-52c8a359-dbaf-4e83-9f46-90237443b6d2 req-8b5c8223-e590-40a1-95ae-1c67037ff543 service nova] Creating event network-vif-plugged:e19cb456-2276-48ce-9c45-b121d994a82f for instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee on hv-cinder-85093 Jul 25 20:01:34.558288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-52c8a359-dbaf-4e83-9f46-90237443b6d2 req-8b5c8223-e590-40a1-95ae-1c67037ff543 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048175 Jul 25 20:01:34.560531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1543/3236] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:34.597697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cbcaae82-2ec5-4de6-98d9-f63c5c6e5ae3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:34.616195 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cbcaae82-2ec5-4de6-98d9-f63c5c6e5ae3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1363 microversion: 2.1 time: 0.381598 Jul 25 20:01:34.632180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1694/3237] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:34 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:35.640957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-30b9198b-a0da-4d59-a072-fa0b62735bef tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:35.642112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-30b9198b-a0da-4d59-a072-fa0b62735bef tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:35.650548 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30b9198b-a0da-4d59-a072-fa0b62735bef tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:35.651310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30b9198b-a0da-4d59-a072-fa0b62735bef tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:35.652663 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30b9198b-a0da-4d59-a072-fa0b62735bef tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:35.653412 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30b9198b-a0da-4d59-a072-fa0b62735bef tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:35.814197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-30b9198b-a0da-4d59-a072-fa0b62735bef tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:35.822087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-30b9198b-a0da-4d59-a072-fa0b62735bef tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1363 microversion: 2.1 time: 0.186635 Jul 25 20:01:35.822669 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1544/3238] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:35 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:36.293911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-41b7d6ef-f495-4251-b01b-741a7005c0ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:36.294476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-41b7d6ef-f495-4251-b01b-741a7005c0ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:36.301224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41b7d6ef-f495-4251-b01b-741a7005c0ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:36.301669 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41b7d6ef-f495-4251-b01b-741a7005c0ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:36.302446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41b7d6ef-f495-4251-b01b-741a7005c0ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:36.302884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-41b7d6ef-f495-4251-b01b-741a7005c0ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:36.317085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-41b7d6ef-f495-4251-b01b-741a7005c0ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-41b7d6ef-f495-4251-b01b-741a7005c0ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: DELETE /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 HTTP/1.1 Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:01:36.318697 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:36.320508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '31db936e-3df3-4d8b-82f6-2022cfcc5227'} Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:36.321513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:36.323113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:36.325672 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-41b7d6ef-f495-4251-b01b-741a7005c0ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:36.326538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-41b7d6ef-f495-4251-b01b-741a7005c0ad tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 404 len: 111 microversion: 2.1 time: 0.036871 Jul 25 20:01:36.327283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1695/3239] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:01:36 2022] DELETE /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:36.342524 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8eeac0e6-61d5-4661-8cf2-925667ae0bcf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:36.343476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8eeac0e6-61d5-4661-8cf2-925667ae0bcf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 31db936e-3df3-4d8b-82f6-2022cfcc5227] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:36.352894 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8eeac0e6-61d5-4661-8cf2-925667ae0bcf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:36.353708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8eeac0e6-61d5-4661-8cf2-925667ae0bcf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:36.355125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8eeac0e6-61d5-4661-8cf2-925667ae0bcf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:36.356095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8eeac0e6-61d5-4661-8cf2-925667ae0bcf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:36.376433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-8eeac0e6-61d5-4661-8cf2-925667ae0bcf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8eeac0e6-61d5-4661-8cf2-925667ae0bcf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 HTTP/1.1 Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:01:36.378145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:36.380426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '31db936e-3df3-4d8b-82f6-2022cfcc5227'} Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:36.381415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. Jul 25 20:01:36.382792 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:36.384085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8eeac0e6-61d5-4661-8cf2-925667ae0bcf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance 31db936e-3df3-4d8b-82f6-2022cfcc5227 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:36.384085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8eeac0e6-61d5-4661-8cf2-925667ae0bcf tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227" status: 404 len: 111 microversion: 2.1 time: 0.046867 Jul 25 20:01:36.384085 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1545/3240] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:36 2022] GET /compute/v2.1/servers/31db936e-3df3-4d8b-82f6-2022cfcc5227 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:36.848431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ac20cdce-eac1-42cd-b36b-c1e7da1289be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:36.849053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ac20cdce-eac1-42cd-b36b-c1e7da1289be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:36.856173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac20cdce-eac1-42cd-b36b-c1e7da1289be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:36.857518 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac20cdce-eac1-42cd-b36b-c1e7da1289be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:36.858567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac20cdce-eac1-42cd-b36b-c1e7da1289be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:36.859826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ac20cdce-eac1-42cd-b36b-c1e7da1289be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.023209 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ac20cdce-eac1-42cd-b36b-c1e7da1289be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:37.030830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ac20cdce-eac1-42cd-b36b-c1e7da1289be tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1549 microversion: 2.1 time: 0.189920 Jul 25 20:01:37.032109 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1696/3241] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:36 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1549 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:37.054171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-42c24e1f-f693-4690-a4a4-0bacf045b1a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:37.054642 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-42c24e1f-f693-4690-a4a4-0bacf045b1a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:37.063565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42c24e1f-f693-4690-a4a4-0bacf045b1a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:37.063565 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42c24e1f-f693-4690-a4a4-0bacf045b1a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.064080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42c24e1f-f693-4690-a4a4-0bacf045b1a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:37.064718 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42c24e1f-f693-4690-a4a4-0bacf045b1a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.156485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-42c24e1f-f693-4690-a4a4-0bacf045b1a9 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107161 Jul 25 20:01:37.157497 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1546/3242] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Jul 25 20:01:37 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:37.610507 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bb1a3d87-33c8-48dc-b14e-2dc1d229935b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:37.611165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bb1a3d87-33c8-48dc-b14e-2dc1d229935b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:37.622002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb1a3d87-33c8-48dc-b14e-2dc1d229935b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:37.622704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb1a3d87-33c8-48dc-b14e-2dc1d229935b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.623656 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb1a3d87-33c8-48dc-b14e-2dc1d229935b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:37.624342 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bb1a3d87-33c8-48dc-b14e-2dc1d229935b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.643647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-bb1a3d87-33c8-48dc-b14e-2dc1d229935b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bb1a3d87-33c8-48dc-b14e-2dc1d229935b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: DELETE /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 HTTP/1.1 Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:01:37.645325 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 20:01:37.647178 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '2f473a58-cf08-414e-8307-99283263dd30'} Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:37.648384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 20:01:37.650488 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.652371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bb1a3d87-33c8-48dc-b14e-2dc1d229935b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:37.652371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bb1a3d87-33c8-48dc-b14e-2dc1d229935b tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 404 len: 111 microversion: 2.1 time: 0.043677 Jul 25 20:01:37.652371 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1697/3243] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:01:37 2022] DELETE /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:37.660913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-53c936be-14d6-42b2-ad1e-a61a11b95d0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:37.661508 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-53c936be-14d6-42b2-ad1e-a61a11b95d0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 2f473a58-cf08-414e-8307-99283263dd30] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:37.667971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53c936be-14d6-42b2-ad1e-a61a11b95d0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:37.668430 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53c936be-14d6-42b2-ad1e-a61a11b95d0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.669239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53c936be-14d6-42b2-ad1e-a61a11b95d0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:37.669727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-53c936be-14d6-42b2-ad1e-a61a11b95d0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.685360 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-53c936be-14d6-42b2-ad1e-a61a11b95d0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-53c936be-14d6-42b2-ad1e-a61a11b95d0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 HTTP/1.1 Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:01:37.687336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 20:01:37.689462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '2f473a58-cf08-414e-8307-99283263dd30'} Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:37.690487 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. Jul 25 20:01:37.692220 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.693756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-53c936be-14d6-42b2-ad1e-a61a11b95d0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance 2f473a58-cf08-414e-8307-99283263dd30 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:37.693756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-53c936be-14d6-42b2-ad1e-a61a11b95d0e tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30" status: 404 len: 111 microversion: 2.1 time: 0.033214 Jul 25 20:01:37.693756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1547/3244] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:37 2022] GET /compute/v2.1/servers/2f473a58-cf08-414e-8307-99283263dd30 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:37.699226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-74eecd24-7868-4111-af21-d290ac249cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:37.699808 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-74eecd24-7868-4111-af21-d290ac249cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:37.707397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74eecd24-7868-4111-af21-d290ac249cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:37.707912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74eecd24-7868-4111-af21-d290ac249cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.708692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74eecd24-7868-4111-af21-d290ac249cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:37.709443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-74eecd24-7868-4111-af21-d290ac249cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.728911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-74eecd24-7868-4111-af21-d290ac249cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-74eecd24-7868-4111-af21-d290ac249cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: DELETE /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d HTTP/1.1 Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:01:37.730490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 20:01:37.732409 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': 'd25205dc-2b73-4c21-b5c9-ee7b365ac47d'} Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:37.733368 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 20:01:37.735651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.737211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-74eecd24-7868-4111-af21-d290ac249cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:37.737211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-74eecd24-7868-4111-af21-d290ac249cd8 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 404 len: 111 microversion: 2.1 time: 0.036719 Jul 25 20:01:37.737211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1698/3245] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:01:37 2022] DELETE /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:37.742958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b653114f-d46e-4918-bce9-272cc3540f0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:37.743580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b653114f-d46e-4918-bce9-272cc3540f0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: d25205dc-2b73-4c21-b5c9-ee7b365ac47d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:37.751124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b653114f-d46e-4918-bce9-272cc3540f0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:37.751611 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b653114f-d46e-4918-bce9-272cc3540f0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.752379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b653114f-d46e-4918-bce9-272cc3540f0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:37.752809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b653114f-d46e-4918-bce9-272cc3540f0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:37.769552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-b653114f-d46e-4918-bce9-272cc3540f0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b653114f-d46e-4918-bce9-272cc3540f0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d HTTP/1.1 Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:01:37.771110 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 20:01:37.772961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'd25205dc-2b73-4c21-b5c9-ee7b365ac47d'} Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:37.773839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. Jul 25 20:01:37.775261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:01:37.777068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b653114f-d46e-4918-bce9-272cc3540f0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance d25205dc-2b73-4c21-b5c9-ee7b365ac47d could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:37.777068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b653114f-d46e-4918-bce9-272cc3540f0c tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d" status: 404 len: 111 microversion: 2.1 time: 0.034210 Jul 25 20:01:37.777068 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1548/3246] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:37 2022] GET /compute/v2.1/servers/d25205dc-2b73-4c21-b5c9-ee7b365ac47d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:38.223815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-12474626-bc31-4ea6-bd1a-cfbe7f9f6cad req-2f1e94d4-0ab8-4bee-b21b-347168fd7ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ebc6aab-df38-4a7b-a10a-5c283a8843ee", "tag": "e19cb456-2276-48ce-9c45-b121d994a82f"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:38.234279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-12474626-bc31-4ea6-bd1a-cfbe7f9f6cad req-2f1e94d4-0ab8-4bee-b21b-347168fd7ed2 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:38.234896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-12474626-bc31-4ea6-bd1a-cfbe7f9f6cad req-2f1e94d4-0ab8-4bee-b21b-347168fd7ed2 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:38.247609 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-12474626-bc31-4ea6-bd1a-cfbe7f9f6cad req-2f1e94d4-0ab8-4bee-b21b-347168fd7ed2 service nova] Creating event network-changed:e19cb456-2276-48ce-9c45-b121d994a82f for instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee on hv-cinder-85093 Jul 25 20:01:38.254277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-12474626-bc31-4ea6-bd1a-cfbe7f9f6cad req-2f1e94d4-0ab8-4bee-b21b-347168fd7ed2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034001 Jul 25 20:01:38.254877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1699/3247] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:02:18.631959 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df1c3c40-f07c-43ef-9821-892f1b59591a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Action: 'create', calling method: .version_select at 0x7feb0c49f550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1030959817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0oWjUmgO+IQxvWEMj4Fo7v03d7hYkm3tfvEuQRsR8v6/JNOXxoocA2G+XiYS6TWZaROMhLIYHBNuyshaqjWOxGXoDbNSwpI7U9zulKlbxuIcQqMuFnPx9usd2U8+HTOQ=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:18.637950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:18.638791 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=33 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:18.654700 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-df1c3c40-f07c-43ef-9821-892f1b59591a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Getting quotas for project e56f16131082413896ec23ec60378226. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:02:18.663930 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-df1c3c40-f07c-43ef-9821-892f1b59591a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Getting quotas for user a0fadb91a8b54ece9ece2b5756be399e and project e56f16131082413896ec23ec60378226. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:02:18.688450 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df1c3c40-f07c-43ef-9821-892f1b59591a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060533 Jul 25 20:02:18.689087 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1549/3248] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Jul 25 20:02:18 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:18.761022 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=27 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:18.762061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:18.767566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2012393955", "imageRef": "bfca0470-52a2-4fbf-93f6-7437bfd26fb8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1030959817", "networks": [{"uuid": "ca89fce2-4080-476a-b321-f7b37f339dae"}]}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:18.821987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] validate_networks() for [('ca89fce2-4080-476a-b321-f7b37f339dae', None, None, None, None, None)] {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:02:19.339047 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:02:19.339466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:02:19.339989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:02:19.340586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:02:19.340986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:02:19.351352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:19.351813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:19.352793 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:19.353067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:19.372722 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Getting quotas for project e56f16131082413896ec23ec60378226. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:02:19.377200 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Getting quotas for user a0fadb91a8b54ece9ece2b5756be399e and project e56f16131082413896ec23ec60378226. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:02:19.388258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:02:19.390939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfca0470-52a2-4fbf-93f6-7437bfd26fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:02:19.439824 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5616e870-fb79-4432-bb16-4cdd63f24d78 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680773 Jul 25 20:02:19.440466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1700/3249] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 20:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:02:19.451080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-92411439-2d65-4a5f-939f-8d8bf05b7e63 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:19.451978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-92411439-2d65-4a5f-939f-8d8bf05b7e63 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:19.517214 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-92411439-2d65-4a5f-939f-8d8bf05b7e63 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:19.527406 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-92411439-2d65-4a5f-939f-8d8bf05b7e63 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1259 microversion: 2.1 time: 0.080101 Jul 25 20:02:19.528164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1550/3250] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:19 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:20.551163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d5e8be29-ecb1-4821-93ba-a8e988b4e7b7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:20.551996 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d5e8be29-ecb1-4821-93ba-a8e988b4e7b7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:20.559293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5e8be29-ecb1-4821-93ba-a8e988b4e7b7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:20.559954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5e8be29-ecb1-4821-93ba-a8e988b4e7b7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:20.561194 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5e8be29-ecb1-4821-93ba-a8e988b4e7b7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:20.562622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5e8be29-ecb1-4821-93ba-a8e988b4e7b7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:20.629280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d5e8be29-ecb1-4821-93ba-a8e988b4e7b7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:20.636923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d5e8be29-ecb1-4821-93ba-a8e988b4e7b7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1311 microversion: 2.1 time: 0.091049 Jul 25 20:02:20.637490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1701/3251] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:20 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:21.661038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-efd68736-a6cb-490d-847e-d07cf8f53134 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:21.663071 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-efd68736-a6cb-490d-847e-d07cf8f53134 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:21.673430 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efd68736-a6cb-490d-847e-d07cf8f53134 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:21.674965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efd68736-a6cb-490d-847e-d07cf8f53134 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:21.676853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efd68736-a6cb-490d-847e-d07cf8f53134 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:21.677874 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efd68736-a6cb-490d-847e-d07cf8f53134 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:22.280742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-efd68736-a6cb-490d-847e-d07cf8f53134 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:22.289169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-efd68736-a6cb-490d-847e-d07cf8f53134 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.634504 Jul 25 20:02:22.290538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1551/3252] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:21 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:23.312293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b1780227-8404-4b28-954b-a5116dbe5919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:23.312934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b1780227-8404-4b28-954b-a5116dbe5919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:23.320280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1780227-8404-4b28-954b-a5116dbe5919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:23.320805 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1780227-8404-4b28-954b-a5116dbe5919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:23.321778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1780227-8404-4b28-954b-a5116dbe5919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:23.322294 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b1780227-8404-4b28-954b-a5116dbe5919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:23.501787 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b1780227-8404-4b28-954b-a5116dbe5919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:23.511865 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b1780227-8404-4b28-954b-a5116dbe5919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.203769 Jul 25 20:02:23.512654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1702/3253] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:23 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:24.535004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ce4a6ff7-4f65-4973-8dd2-ed5390c3435b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:24.535723 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ce4a6ff7-4f65-4973-8dd2-ed5390c3435b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:24.542590 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce4a6ff7-4f65-4973-8dd2-ed5390c3435b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:24.543032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce4a6ff7-4f65-4973-8dd2-ed5390c3435b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:24.543836 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce4a6ff7-4f65-4973-8dd2-ed5390c3435b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:24.544276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce4a6ff7-4f65-4973-8dd2-ed5390c3435b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:24.709506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ce4a6ff7-4f65-4973-8dd2-ed5390c3435b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:24.724033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ce4a6ff7-4f65-4973-8dd2-ed5390c3435b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.193403 Jul 25 20:02:24.724621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1552/3254] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:24 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:25.269173 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3d7b164c-35ac-4bb8-98fd-8d9a9edcc3ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:25.269702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3d7b164c-35ac-4bb8-98fd-8d9a9edcc3ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:25.277833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d7b164c-35ac-4bb8-98fd-8d9a9edcc3ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:25.277833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d7b164c-35ac-4bb8-98fd-8d9a9edcc3ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:25.278287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d7b164c-35ac-4bb8-98fd-8d9a9edcc3ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:25.278815 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3d7b164c-35ac-4bb8-98fd-8d9a9edcc3ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:25.304674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3d7b164c-35ac-4bb8-98fd-8d9a9edcc3ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/ips" status: 200 len: 146 microversion: 2.1 time: 0.039330 Jul 25 20:02:25.305269 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1703/3255] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Jul 25 20:02:25 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:25.750318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fc4e925d-cfa0-450b-8804-747529d54cdf tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:25.752767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fc4e925d-cfa0-450b-8804-747529d54cdf tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:25.766135 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc4e925d-cfa0-450b-8804-747529d54cdf tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:25.766873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc4e925d-cfa0-450b-8804-747529d54cdf tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:25.768093 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc4e925d-cfa0-450b-8804-747529d54cdf tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:25.768796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc4e925d-cfa0-450b-8804-747529d54cdf tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:25.950875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fc4e925d-cfa0-450b-8804-747529d54cdf tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:25.963560 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fc4e925d-cfa0-450b-8804-747529d54cdf tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.220372 Jul 25 20:02:25.964811 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1553/3256] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:25 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:26.705698 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-977525a5-2811-4f30-952a-0bd70a5ee20a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78e22e99-76e8-4ece-a06e-d458ba71e1eb"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:26.708233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-977525a5-2811-4f30-952a-0bd70a5ee20a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:26.714981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-977525a5-2811-4f30-952a-0bd70a5ee20a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:26.715431 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-977525a5-2811-4f30-952a-0bd70a5ee20a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:26.716258 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-977525a5-2811-4f30-952a-0bd70a5ee20a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:26.716692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-977525a5-2811-4f30-952a-0bd70a5ee20a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:26.990753 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-348621e3-7136-4885-a702-c4ce00f8f919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:26.991690 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-348621e3-7136-4885-a702-c4ce00f8f919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:26.998266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-348621e3-7136-4885-a702-c4ce00f8f919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:26.999007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-348621e3-7136-4885-a702-c4ce00f8f919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:26.999645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-348621e3-7136-4885-a702-c4ce00f8f919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:27.000083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-348621e3-7136-4885-a702-c4ce00f8f919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:27.155401 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-348621e3-7136-4885-a702-c4ce00f8f919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:27.165376 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-348621e3-7136-4885-a702-c4ce00f8f919 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.178506 Jul 25 20:02:27.180070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1554/3257] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:26 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:28.193145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0caceb0d-cde3-4ed5-b87f-7b1240525d03 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:28.195481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0caceb0d-cde3-4ed5-b87f-7b1240525d03 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:28.206238 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0caceb0d-cde3-4ed5-b87f-7b1240525d03 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:28.207007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0caceb0d-cde3-4ed5-b87f-7b1240525d03 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:28.208395 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0caceb0d-cde3-4ed5-b87f-7b1240525d03 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:28.209122 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0caceb0d-cde3-4ed5-b87f-7b1240525d03 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:28.372226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0caceb0d-cde3-4ed5-b87f-7b1240525d03 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:28.380828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0caceb0d-cde3-4ed5-b87f-7b1240525d03 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.194729 Jul 25 20:02:28.381918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1555/3258] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:28 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:29.362694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:29.383744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=6 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:29.402218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b58d78b-e8ae-4a39-a034-6e0661f5838d tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:29.402861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b58d78b-e8ae-4a39-a034-6e0661f5838d tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:29.412390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b58d78b-e8ae-4a39-a034-6e0661f5838d tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:29.412944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b58d78b-e8ae-4a39-a034-6e0661f5838d tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:29.414288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b58d78b-e8ae-4a39-a034-6e0661f5838d tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:29.415010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b58d78b-e8ae-4a39-a034-6e0661f5838d tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:29.524396 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:29.585065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b58d78b-e8ae-4a39-a034-6e0661f5838d tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:29.592828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b58d78b-e8ae-4a39-a034-6e0661f5838d tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.194288 Jul 25 20:02:29.593593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1556/3259] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:29 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:30.615111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8da5b908-50e5-47fd-95e7-0d66273faf68 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:30.616384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8da5b908-50e5-47fd-95e7-0d66273faf68 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:30.622980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8da5b908-50e5-47fd-95e7-0d66273faf68 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:30.623425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8da5b908-50e5-47fd-95e7-0d66273faf68 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:30.625426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8da5b908-50e5-47fd-95e7-0d66273faf68 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:30.625882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8da5b908-50e5-47fd-95e7-0d66273faf68 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:30.803552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8da5b908-50e5-47fd-95e7-0d66273faf68 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:30.820945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8da5b908-50e5-47fd-95e7-0d66273faf68 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.209147 Jul 25 20:02:30.833009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1557/3260] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:30 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:31.847197 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1352df37-8fcd-4bbc-8028-4bd05aaa339f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:31.848095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1352df37-8fcd-4bbc-8028-4bd05aaa339f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:31.854459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1352df37-8fcd-4bbc-8028-4bd05aaa339f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:31.854903 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1352df37-8fcd-4bbc-8028-4bd05aaa339f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:31.855711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1352df37-8fcd-4bbc-8028-4bd05aaa339f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:31.856149 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1352df37-8fcd-4bbc-8028-4bd05aaa339f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:32.002029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1352df37-8fcd-4bbc-8028-4bd05aaa339f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:32.009488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1352df37-8fcd-4bbc-8028-4bd05aaa339f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.166714 Jul 25 20:02:32.010056 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1558/3261] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:31 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:32.476089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-977525a5-2811-4f30-952a-0bd70a5ee20a tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "POST /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.774672 Jul 25 20:02:32.476759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1704/3262] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 20:02:26 2022] POST /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments => generated 194 bytes in 5776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:32.944232 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-c4de30b2-5ce4-4089-8349-6db4e608ab45 req-96fee3f3-792b-48d4-b817-65989a8df3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33d904c-2e45-4dca-9a90-844c8c107ed0", "tag": "d9dd5948-41bb-4605-9ed0-2a444ae66885"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:32.959674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-c4de30b2-5ce4-4089-8349-6db4e608ab45 req-96fee3f3-792b-48d4-b817-65989a8df3f7 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:32.960134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-c4de30b2-5ce4-4089-8349-6db4e608ab45 req-96fee3f3-792b-48d4-b817-65989a8df3f7 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:32.977369 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-c4de30b2-5ce4-4089-8349-6db4e608ab45 req-96fee3f3-792b-48d4-b817-65989a8df3f7 service nova] Creating event network-changed:d9dd5948-41bb-4605-9ed0-2a444ae66885 for instance e33d904c-2e45-4dca-9a90-844c8c107ed0 on hv-cinder-85093 Jul 25 20:02:32.985313 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-c4de30b2-5ce4-4089-8349-6db4e608ab45 req-96fee3f3-792b-48d4-b817-65989a8df3f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044566 Jul 25 20:02:32.986148 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1559/3263] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:33.032403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fea2b047-5740-43a1-aaa9-734037211327 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:33.033352 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fea2b047-5740-43a1-aaa9-734037211327 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:33.043243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fea2b047-5740-43a1-aaa9-734037211327 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:33.043735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fea2b047-5740-43a1-aaa9-734037211327 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:33.044527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fea2b047-5740-43a1-aaa9-734037211327 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:33.044968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fea2b047-5740-43a1-aaa9-734037211327 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:33.799569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fea2b047-5740-43a1-aaa9-734037211327 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:33.815476 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fea2b047-5740-43a1-aaa9-734037211327 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.787560 Jul 25 20:02:33.832788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1705/3264] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:33 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:34.860163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e680726f-b2c8-4a04-a03f-397f469758b1 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:34.861021 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e680726f-b2c8-4a04-a03f-397f469758b1 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:34.868099 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e680726f-b2c8-4a04-a03f-397f469758b1 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:34.868534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e680726f-b2c8-4a04-a03f-397f469758b1 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:34.869302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e680726f-b2c8-4a04-a03f-397f469758b1 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:34.869728 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e680726f-b2c8-4a04-a03f-397f469758b1 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:35.012847 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e680726f-b2c8-4a04-a03f-397f469758b1 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:35.021673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e680726f-b2c8-4a04-a03f-397f469758b1 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.167001 Jul 25 20:02:35.022228 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1560/3265] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:34 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:36.043440 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fadaae6b-92a9-4d5b-8da9-dd9c12289e99 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:36.044089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-fadaae6b-92a9-4d5b-8da9-dd9c12289e99 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:36.057913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fadaae6b-92a9-4d5b-8da9-dd9c12289e99 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:36.058359 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fadaae6b-92a9-4d5b-8da9-dd9c12289e99 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:36.059144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fadaae6b-92a9-4d5b-8da9-dd9c12289e99 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:36.059612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-fadaae6b-92a9-4d5b-8da9-dd9c12289e99 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:36.204031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-fadaae6b-92a9-4d5b-8da9-dd9c12289e99 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:36.211572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fadaae6b-92a9-4d5b-8da9-dd9c12289e99 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.171953 Jul 25 20:02:36.212146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1706/3266] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:36 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:37.234205 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6306fadc-c2dd-4a00-801d-ca13957fa31f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:37.234820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6306fadc-c2dd-4a00-801d-ca13957fa31f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:37.242075 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6306fadc-c2dd-4a00-801d-ca13957fa31f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:37.242522 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6306fadc-c2dd-4a00-801d-ca13957fa31f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:37.243290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6306fadc-c2dd-4a00-801d-ca13957fa31f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:37.243754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6306fadc-c2dd-4a00-801d-ca13957fa31f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:37.406748 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6306fadc-c2dd-4a00-801d-ca13957fa31f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:37.415006 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6306fadc-c2dd-4a00-801d-ca13957fa31f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.185088 Jul 25 20:02:37.415783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1561/3267] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:37 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:38.437308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-db69a1e3-95df-4432-81c9-04ed8579e31b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:38.437951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-db69a1e3-95df-4432-81c9-04ed8579e31b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:38.444780 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db69a1e3-95df-4432-81c9-04ed8579e31b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:38.445230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db69a1e3-95df-4432-81c9-04ed8579e31b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:38.446011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db69a1e3-95df-4432-81c9-04ed8579e31b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:38.446447 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-db69a1e3-95df-4432-81c9-04ed8579e31b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:38.604794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-db69a1e3-95df-4432-81c9-04ed8579e31b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:38.613163 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-db69a1e3-95df-4432-81c9-04ed8579e31b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.180085 Jul 25 20:02:38.613743 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1707/3268] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:38 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:39.225541 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-273edf1a-4217-4f51-85ab-0eca1e296655 req-508e5f02-f8b6-4332-9b0c-a62c5b5bdc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d904c-2e45-4dca-9a90-844c8c107ed0", "name": "network-vif-plugged", "status": "completed", "tag": "d9dd5948-41bb-4605-9ed0-2a444ae66885"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:39.235824 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-273edf1a-4217-4f51-85ab-0eca1e296655 req-508e5f02-f8b6-4332-9b0c-a62c5b5bdc36 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:39.236226 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-273edf1a-4217-4f51-85ab-0eca1e296655 req-508e5f02-f8b6-4332-9b0c-a62c5b5bdc36 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:39.248540 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-273edf1a-4217-4f51-85ab-0eca1e296655 req-508e5f02-f8b6-4332-9b0c-a62c5b5bdc36 service nova] Creating event network-vif-plugged:d9dd5948-41bb-4605-9ed0-2a444ae66885 for instance e33d904c-2e45-4dca-9a90-844c8c107ed0 on hv-cinder-85093 Jul 25 20:02:39.253576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-273edf1a-4217-4f51-85ab-0eca1e296655 req-508e5f02-f8b6-4332-9b0c-a62c5b5bdc36 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197231 Jul 25 20:02:39.254193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1562/3269] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:02:39.635443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-efb7948d-e223-4f9a-b03b-be99284a570b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:39.636089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-efb7948d-e223-4f9a-b03b-be99284a570b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:39.644700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-efb7948d-e223-4f9a-b03b-be99284a570b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:39.645520 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-efb7948d-e223-4f9a-b03b-be99284a570b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:39.646331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-efb7948d-e223-4f9a-b03b-be99284a570b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:39.646813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-efb7948d-e223-4f9a-b03b-be99284a570b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:39.833378 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-efb7948d-e223-4f9a-b03b-be99284a570b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:39.841063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-efb7948d-e223-4f9a-b03b-be99284a570b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.209477 Jul 25 20:02:39.841636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1708/3270] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:39 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:40.189042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6d3626a0-f267-41ee-8ada-7d111f9b5ea3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:40.191373 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d3626a0-f267-41ee-8ada-7d111f9b5ea3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:40.197962 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d3626a0-f267-41ee-8ada-7d111f9b5ea3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:40.198413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d3626a0-f267-41ee-8ada-7d111f9b5ea3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:40.199185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d3626a0-f267-41ee-8ada-7d111f9b5ea3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:40.199662 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d3626a0-f267-41ee-8ada-7d111f9b5ea3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:40.230113 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6d3626a0-f267-41ee-8ada-7d111f9b5ea3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Jul 25 20:02:40.230841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1563/3271] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 20:02:40 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:40.242542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-954355b4-535e-4e28-b69e-5c0867731955 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:40.242910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-954355b4-535e-4e28-b69e-5c0867731955 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:40.249298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-954355b4-535e-4e28-b69e-5c0867731955 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:40.250548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-954355b4-535e-4e28-b69e-5c0867731955 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:40.251539 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-954355b4-535e-4e28-b69e-5c0867731955 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:40.251987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-954355b4-535e-4e28-b69e-5c0867731955 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:40.283267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-954355b4-535e-4e28-b69e-5c0867731955 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments/78e22e99-76e8-4ece-a06e-d458ba71e1eb" status: 200 len: 194 microversion: 2.1 time: 0.045019 Jul 25 20:02:40.283918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1709/3272] 10.222.0.18 () {58 vars in 1413 bytes} [Mon Jul 25 20:02:40 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments/78e22e99-76e8-4ece-a06e-d458ba71e1eb => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:02:40.864485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b964dbbe-e7da-4b57-9900-c576376049de tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:40.865010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b964dbbe-e7da-4b57-9900-c576376049de tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:40.871463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b964dbbe-e7da-4b57-9900-c576376049de tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:40.871961 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b964dbbe-e7da-4b57-9900-c576376049de tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:40.872731 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b964dbbe-e7da-4b57-9900-c576376049de tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:40.873171 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b964dbbe-e7da-4b57-9900-c576376049de tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:41.010263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b964dbbe-e7da-4b57-9900-c576376049de tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:41.019602 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b964dbbe-e7da-4b57-9900-c576376049de tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1359 microversion: 2.1 time: 0.159081 Jul 25 20:02:41.020188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1564/3273] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:40 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:41.649133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-465e3baf-2f93-42b0-b6a5-b2e0196f60ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9ecb047-d0da-4d1c-8db8-7cb7a2177dca"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:41.651654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-465e3baf-2f93-42b0-b6a5-b2e0196f60ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:41.659287 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-465e3baf-2f93-42b0-b6a5-b2e0196f60ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:41.659773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-465e3baf-2f93-42b0-b6a5-b2e0196f60ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:41.660558 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-465e3baf-2f93-42b0-b6a5-b2e0196f60ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:41.661000 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-465e3baf-2f93-42b0-b6a5-b2e0196f60ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:42.041489 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-710b2714-9dcc-452d-81e1-4200d6b586d2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:42.042775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-710b2714-9dcc-452d-81e1-4200d6b586d2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:42.050355 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-710b2714-9dcc-452d-81e1-4200d6b586d2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:42.050965 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-710b2714-9dcc-452d-81e1-4200d6b586d2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:42.051730 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-710b2714-9dcc-452d-81e1-4200d6b586d2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:42.052147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-710b2714-9dcc-452d-81e1-4200d6b586d2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:42.107467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-465e3baf-2f93-42b0-b6a5-b2e0196f60ac tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "POST /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462060 Jul 25 20:02:42.108935 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1710/3274] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 20:02:41 2022] POST /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments => generated 194 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:42.248451 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-710b2714-9dcc-452d-81e1-4200d6b586d2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:42.264098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-710b2714-9dcc-452d-81e1-4200d6b586d2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1549 microversion: 2.1 time: 0.226272 Jul 25 20:02:42.265119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1565/3275] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:42 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1549 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:42.290399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-66a9596d-37ac-4ecd-a2bd-f17ac2351155 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:42.291757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-66a9596d-37ac-4ecd-a2bd-f17ac2351155 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:42.302301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66a9596d-37ac-4ecd-a2bd-f17ac2351155 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:42.302684 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66a9596d-37ac-4ecd-a2bd-f17ac2351155 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:42.303825 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66a9596d-37ac-4ecd-a2bd-f17ac2351155 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:42.304285 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-66a9596d-37ac-4ecd-a2bd-f17ac2351155 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:42.463819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-66a9596d-37ac-4ecd-a2bd-f17ac2351155 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:42.473044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-66a9596d-37ac-4ecd-a2bd-f17ac2351155 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1549 microversion: 2.1 time: 0.190219 Jul 25 20:02:42.473623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1711/3276] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:42 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1549 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:42.493672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de613d55-3297-4344-86db-2cfb2c235da3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:42.498416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de613d55-3297-4344-86db-2cfb2c235da3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:42.499070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de613d55-3297-4344-86db-2cfb2c235da3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Searching by: {'deleted': False, 'project_id': 'e56f16131082413896ec23ec60378226'} {{(pid=117951) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:02:42.506727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de613d55-3297-4344-86db-2cfb2c235da3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:42.507165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de613d55-3297-4344-86db-2cfb2c235da3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:42.507984 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de613d55-3297-4344-86db-2cfb2c235da3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:42.508408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de613d55-3297-4344-86db-2cfb2c235da3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:42.603990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.multi_cell_list [None req-de613d55-3297-4344-86db-2cfb2c235da3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117951) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:02:42.701555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de613d55-3297-4344-86db-2cfb2c235da3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211713 Jul 25 20:02:42.702034 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1566/3277] 10.222.0.18 () {58 vars in 1125 bytes} [Mon Jul 25 20:02:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:42.715802 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0253aac3-96f3-4a83-af5f-d04a72605102 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:42.716453 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0253aac3-96f3-4a83-af5f-d04a72605102 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:42.727130 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0253aac3-96f3-4a83-af5f-d04a72605102 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:42.727596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0253aac3-96f3-4a83-af5f-d04a72605102 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:42.729379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0253aac3-96f3-4a83-af5f-d04a72605102 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:42.729379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0253aac3-96f3-4a83-af5f-d04a72605102 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:42.865379 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0253aac3-96f3-4a83-af5f-d04a72605102 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:42.873270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0253aac3-96f3-4a83-af5f-d04a72605102 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1549 microversion: 2.1 time: 0.161385 Jul 25 20:02:42.873842 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1712/3278] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:42 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:44.528141 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-907ab432-d623-43b5-b11b-a8d1eb0e2bea tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02aab3d8-f6ac-457b-9102-7d6da3d523e1"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:44.530462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-907ab432-d623-43b5-b11b-a8d1eb0e2bea tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:44.538083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-907ab432-d623-43b5-b11b-a8d1eb0e2bea tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:44.538544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-907ab432-d623-43b5-b11b-a8d1eb0e2bea tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:44.539315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-907ab432-d623-43b5-b11b-a8d1eb0e2bea tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:44.539777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-907ab432-d623-43b5-b11b-a8d1eb0e2bea tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:44.833301 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:44.859973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-907ab432-d623-43b5-b11b-a8d1eb0e2bea tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "POST /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334775 Jul 25 20:02:44.860745 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1567/3279] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Jul 25 20:02:44 2022] POST /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:49.702099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-14b2ad36-ea29-4aad-b411-b058a25ff7ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:49.704433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-14b2ad36-ea29-4aad-b411-b058a25ff7ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:49.707074 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:49.713075 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14b2ad36-ea29-4aad-b411-b058a25ff7ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:49.713750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14b2ad36-ea29-4aad-b411-b058a25ff7ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:49.714053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14b2ad36-ea29-4aad-b411-b058a25ff7ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:49.714514 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14b2ad36-ea29-4aad-b411-b058a25ff7ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:49.717873 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:49.748827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-14b2ad36-ea29-4aad-b411-b058a25ff7ea tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050522 Jul 25 20:02:49.755298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1713/3280] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 20:02:49 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:49.868203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f39e0e4c-d520-4113-b958-5bf5a3a50fc1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:49.868800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f39e0e4c-d520-4113-b958-5bf5a3a50fc1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:49.871240 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:49.878007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f39e0e4c-d520-4113-b958-5bf5a3a50fc1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:49.878477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f39e0e4c-d520-4113-b958-5bf5a3a50fc1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:49.879217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f39e0e4c-d520-4113-b958-5bf5a3a50fc1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:49.879690 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f39e0e4c-d520-4113-b958-5bf5a3a50fc1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:49.915231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f39e0e4c-d520-4113-b958-5bf5a3a50fc1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments/78e22e99-76e8-4ece-a06e-d458ba71e1eb" status: 200 len: 194 microversion: 2.1 time: 0.051555 Jul 25 20:02:49.915862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1568/3281] 10.222.0.18 () {58 vars in 1413 bytes} [Mon Jul 25 20:02:49 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments/78e22e99-76e8-4ece-a06e-d458ba71e1eb => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:49.927088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-4542da38-a31e-4f64-a163-d8f76f9f7a3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:49.927645 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-4542da38-a31e-4f64-a163-d8f76f9f7a3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:49.933966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4542da38-a31e-4f64-a163-d8f76f9f7a3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:49.934427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4542da38-a31e-4f64-a163-d8f76f9f7a3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:49.935205 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4542da38-a31e-4f64-a163-d8f76f9f7a3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:49.935677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-4542da38-a31e-4f64-a163-d8f76f9f7a3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:50.024120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-4542da38-a31e-4f64-a163-d8f76f9f7a3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lazy-loading 'services' on Instance uuid 2ebc6aab-df38-4a7b-a10a-5c283a8843ee {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:02:50.101170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-4542da38-a31e-4f64-a163-d8f76f9f7a3b tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments/78e22e99-76e8-4ece-a06e-d458ba71e1eb" status: 202 len: 0 microversion: 2.1 time: 0.177810 Jul 25 20:02:50.101762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1714/3282] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 20:02:49 2022] DELETE /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments/78e22e99-76e8-4ece-a06e-d458ba71e1eb => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:56.733697 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-676f72c1-7df6-4683-8a85-b51c125879f8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:56.734337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-676f72c1-7df6-4683-8a85-b51c125879f8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:56.737595 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:56.743255 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-676f72c1-7df6-4683-8a85-b51c125879f8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:56.743742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-676f72c1-7df6-4683-8a85-b51c125879f8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:56.744506 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-676f72c1-7df6-4683-8a85-b51c125879f8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:56.744943 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-676f72c1-7df6-4683-8a85-b51c125879f8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:56.880163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-676f72c1-7df6-4683-8a85-b51c125879f8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:56.889114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-676f72c1-7df6-4683-8a85-b51c125879f8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1595 microversion: 2.1 time: 0.159115 Jul 25 20:02:56.889689 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1569/3283] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:56 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:58.651267 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9690acd5-da44-45ca-8128-1b10ca5746a3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:58.651953 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9690acd5-da44-45ca-8128-1b10ca5746a3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:58.660384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9690acd5-da44-45ca-8128-1b10ca5746a3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:58.660965 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9690acd5-da44-45ca-8128-1b10ca5746a3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:58.662316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9690acd5-da44-45ca-8128-1b10ca5746a3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:58.663056 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9690acd5-da44-45ca-8128-1b10ca5746a3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:58.697170 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9690acd5-da44-45ca-8128-1b10ca5746a3 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments/d9ecb047-d0da-4d1c-8db8-7cb7a2177dca" status: 200 len: 194 microversion: 2.1 time: 0.050123 Jul 25 20:02:58.699692 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1715/3284] 10.222.0.18 () {58 vars in 1413 bytes} [Mon Jul 25 20:02:58 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments/d9ecb047-d0da-4d1c-8db8-7cb7a2177dca => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:58.712017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a58c0592-c33e-495e-bed5-6a07e135d1af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:58.712660 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a58c0592-c33e-495e-bed5-6a07e135d1af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:58.720000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a58c0592-c33e-495e-bed5-6a07e135d1af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:58.721145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a58c0592-c33e-495e-bed5-6a07e135d1af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:58.721607 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a58c0592-c33e-495e-bed5-6a07e135d1af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:58.722587 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a58c0592-c33e-495e-bed5-6a07e135d1af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:58.842241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-a58c0592-c33e-495e-bed5-6a07e135d1af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lazy-loading 'services' on Instance uuid 2ebc6aab-df38-4a7b-a10a-5c283a8843ee {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:02:58.932432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a58c0592-c33e-495e-bed5-6a07e135d1af tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments/d9ecb047-d0da-4d1c-8db8-7cb7a2177dca" status: 202 len: 0 microversion: 2.1 time: 0.227452 Jul 25 20:02:58.933305 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1570/3285] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 20:02:58 2022] DELETE /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments/d9ecb047-d0da-4d1c-8db8-7cb7a2177dca => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:59.119090 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-ab58c8bc-3f70-4e09-9375-e92de21a9080 req-ebaf107e-4efa-4791-ba12-05dd87ad1e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33d904c-2e45-4dca-9a90-844c8c107ed0", "tag": "d9dd5948-41bb-4605-9ed0-2a444ae66885"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:59.130649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-ab58c8bc-3f70-4e09-9375-e92de21a9080 req-ebaf107e-4efa-4791-ba12-05dd87ad1e3e service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:59.131355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-ab58c8bc-3f70-4e09-9375-e92de21a9080 req-ebaf107e-4efa-4791-ba12-05dd87ad1e3e service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:59.145286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-ab58c8bc-3f70-4e09-9375-e92de21a9080 req-ebaf107e-4efa-4791-ba12-05dd87ad1e3e service nova] Creating event network-changed:d9dd5948-41bb-4605-9ed0-2a444ae66885 for instance e33d904c-2e45-4dca-9a90-844c8c107ed0 on hv-cinder-85093 Jul 25 20:02:59.150972 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-ab58c8bc-3f70-4e09-9375-e92de21a9080 req-ebaf107e-4efa-4791-ba12-05dd87ad1e3e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172443 Jul 25 20:02:59.152199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1716/3286] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:00.149908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7907dde8-cf73-45e8-a6f0-7ef4cbf75c4f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-570283147"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:00.152141 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7907dde8-cf73-45e8-a6f0-7ef4cbf75c4f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:00.166382 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7907dde8-cf73-45e8-a6f0-7ef4cbf75c4f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:00.167692 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7907dde8-cf73-45e8-a6f0-7ef4cbf75c4f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:00.169229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7907dde8-cf73-45e8-a6f0-7ef4cbf75c4f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:00.171483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7907dde8-cf73-45e8-a6f0-7ef4cbf75c4f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:00.395491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.network.security_group_api [None req-7907dde8-cf73-45e8-a6f0-7ef4cbf75c4f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Adding security group 217d90e6-5542-4dea-961d-564f94101751 to port d9dd5948-41bb-4605-9ed0-2a444ae66885 Jul 25 20:03:00.789036 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7907dde8-cf73-45e8-a6f0-7ef4cbf75c4f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "POST /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/action" status: 202 len: 0 microversion: 2.1 time: 0.649206 Jul 25 20:03:00.793949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1571/3287] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 20:03:00 2022] POST /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:03:00.801070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ed35cd9e-27d4-4c19-89f9-713369020400 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:00.801771 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ed35cd9e-27d4-4c19-89f9-713369020400 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:00.802167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-40aa6115-f814-4f2a-b322-51f4e3206aac req-4c179726-45ba-49ca-ab04-98f3e5a948ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33d904c-2e45-4dca-9a90-844c8c107ed0", "tag": "d9dd5948-41bb-4605-9ed0-2a444ae66885"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:00.815397 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed35cd9e-27d4-4c19-89f9-713369020400 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:00.816331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed35cd9e-27d4-4c19-89f9-713369020400 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:00.817629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed35cd9e-27d4-4c19-89f9-713369020400 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:00.818276 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ed35cd9e-27d4-4c19-89f9-713369020400 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:00.822742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-40aa6115-f814-4f2a-b322-51f4e3206aac req-4c179726-45ba-49ca-ab04-98f3e5a948ff service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:00.830467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-40aa6115-f814-4f2a-b322-51f4e3206aac req-4c179726-45ba-49ca-ab04-98f3e5a948ff service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:00.847715 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-40aa6115-f814-4f2a-b322-51f4e3206aac req-4c179726-45ba-49ca-ab04-98f3e5a948ff service nova] Creating event network-changed:d9dd5948-41bb-4605-9ed0-2a444ae66885 for instance e33d904c-2e45-4dca-9a90-844c8c107ed0 on hv-cinder-85093 Jul 25 20:03:00.857907 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-40aa6115-f814-4f2a-b322-51f4e3206aac req-4c179726-45ba-49ca-ab04-98f3e5a948ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059536 Jul 25 20:03:00.861830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1572/3288] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:01.121612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ed35cd9e-27d4-4c19-89f9-713369020400 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:01.131851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ed35cd9e-27d4-4c19-89f9-713369020400 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1760 microversion: 2.1 time: 0.337534 Jul 25 20:03:01.133031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1717/3289] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:00 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1760 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:01.281764 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2e525527-469a-4d96-8147-fe82aa2f69a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:01.285073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2e525527-469a-4d96-8147-fe82aa2f69a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:01.292390 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e525527-469a-4d96-8147-fe82aa2f69a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:01.293073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e525527-469a-4d96-8147-fe82aa2f69a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.294231 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e525527-469a-4d96-8147-fe82aa2f69a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:01.294770 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e525527-469a-4d96-8147-fe82aa2f69a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.328127 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2e525527-469a-4d96-8147-fe82aa2f69a8 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050434 Jul 25 20:03:01.328720 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1573/3290] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 20:03:01 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:03:01.497924 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e4f778cb-395d-4831-b6e4-688dbd7086df tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:01.500920 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e4f778cb-395d-4831-b6e4-688dbd7086df tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:01.508931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4f778cb-395d-4831-b6e4-688dbd7086df tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:01.509612 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4f778cb-395d-4831-b6e4-688dbd7086df tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.510391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4f778cb-395d-4831-b6e4-688dbd7086df tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:01.511141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e4f778cb-395d-4831-b6e4-688dbd7086df tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.544948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e4f778cb-395d-4831-b6e4-688dbd7086df tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051597 Jul 25 20:03:01.545832 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1718/3291] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 20:03:01 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:03:01.612040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-92fa46e3-d872-403b-8d73-5c5d2d4a9dfd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:01.612539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-92fa46e3-d872-403b-8d73-5c5d2d4a9dfd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:01.618901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92fa46e3-d872-403b-8d73-5c5d2d4a9dfd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:01.619348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92fa46e3-d872-403b-8d73-5c5d2d4a9dfd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.620315 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92fa46e3-d872-403b-8d73-5c5d2d4a9dfd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:01.620922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92fa46e3-d872-403b-8d73-5c5d2d4a9dfd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.649918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-92fa46e3-d872-403b-8d73-5c5d2d4a9dfd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:03:01.729676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-92fa46e3-d872-403b-8d73-5c5d2d4a9dfd tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 204 len: 0 microversion: 2.1 time: 0.121760 Jul 25 20:03:01.730507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1574/3292] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:03:01 2022] DELETE /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:03:01.740181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-250ab3a1-4065-4db1-a98b-5c881128f2db tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:01.740795 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-250ab3a1-4065-4db1-a98b-5c881128f2db tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:01.747308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-250ab3a1-4065-4db1-a98b-5c881128f2db tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:01.747778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-250ab3a1-4065-4db1-a98b-5c881128f2db tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.748563 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-250ab3a1-4065-4db1-a98b-5c881128f2db tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:01.749006 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-250ab3a1-4065-4db1-a98b-5c881128f2db tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.886947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-250ab3a1-4065-4db1-a98b-5c881128f2db tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:01.895761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-250ab3a1-4065-4db1-a98b-5c881128f2db tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1674 microversion: 2.1 time: 0.159586 Jul 25 20:03:01.896377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1719/3293] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:01 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:02.919057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b0da5d5-778b-465c-95da-15c2f4fb58f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:02.919704 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b0da5d5-778b-465c-95da-15c2f4fb58f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:02.927888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b0da5d5-778b-465c-95da-15c2f4fb58f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:02.928337 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b0da5d5-778b-465c-95da-15c2f4fb58f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:02.929112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b0da5d5-778b-465c-95da-15c2f4fb58f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:02.929552 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b0da5d5-778b-465c-95da-15c2f4fb58f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:03.151670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b0da5d5-778b-465c-95da-15c2f4fb58f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:03.161222 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b0da5d5-778b-465c-95da-15c2f4fb58f1 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1674 microversion: 2.1 time: 0.246419 Jul 25 20:03:03.161889 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1575/3294] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:02 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1674 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:04.184422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0a27e130-a84b-4f7d-97e1-1d11009b7a67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:04.185180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0a27e130-a84b-4f7d-97e1-1d11009b7a67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:04.192375 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a27e130-a84b-4f7d-97e1-1d11009b7a67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:04.192822 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a27e130-a84b-4f7d-97e1-1d11009b7a67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:04.193595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a27e130-a84b-4f7d-97e1-1d11009b7a67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:04.194035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0a27e130-a84b-4f7d-97e1-1d11009b7a67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:04.340765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0a27e130-a84b-4f7d-97e1-1d11009b7a67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:04.349591 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0a27e130-a84b-4f7d-97e1-1d11009b7a67 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1674 microversion: 2.1 time: 0.168911 Jul 25 20:03:04.350160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1720/3295] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:04 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:05.372010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a8246a3-424e-4469-be11-d24a48e43529 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:05.372665 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a8246a3-424e-4469-be11-d24a48e43529 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:05.379719 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a8246a3-424e-4469-be11-d24a48e43529 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:05.380167 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a8246a3-424e-4469-be11-d24a48e43529 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:05.380940 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a8246a3-424e-4469-be11-d24a48e43529 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:05.381368 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a8246a3-424e-4469-be11-d24a48e43529 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:05.650184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a8246a3-424e-4469-be11-d24a48e43529 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581ae6d40d34447da6651f3b2c21bdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9a533f6f6f49e2bd73771fc99919c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:05.658310 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a8246a3-424e-4469-be11-d24a48e43529 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 200 len: 1674 microversion: 2.1 time: 0.290345 Jul 25 20:03:05.671539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1576/3296] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:05 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 1674 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:05.904180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-6a913f82-0733-4b7c-bd14-b567785f00b1 req-73a8c7ad-e96b-4d04-9f0b-a989e2f4ffe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebc6aab-df38-4a7b-a10a-5c283a8843ee", "name": "network-vif-deleted", "tag": "e19cb456-2276-48ce-9c45-b121d994a82f"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:05.918306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-6a913f82-0733-4b7c-bd14-b567785f00b1 req-73a8c7ad-e96b-4d04-9f0b-a989e2f4ffe9 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:05.918806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-6a913f82-0733-4b7c-bd14-b567785f00b1 req-73a8c7ad-e96b-4d04-9f0b-a989e2f4ffe9 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:05.931816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-6a913f82-0733-4b7c-bd14-b567785f00b1 req-73a8c7ad-e96b-4d04-9f0b-a989e2f4ffe9 service nova] Creating event network-vif-deleted:e19cb456-2276-48ce-9c45-b121d994a82f for instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee on hv-cinder-85093 Jul 25 20:03:05.937674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-6a913f82-0733-4b7c-bd14-b567785f00b1 req-73a8c7ad-e96b-4d04-9f0b-a989e2f4ffe9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037861 Jul 25 20:03:05.939424 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1721/3297] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:06.684090 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-99da3b1e-f04f-442d-aaef-384e401a16fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:06.684926 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-99da3b1e-f04f-442d-aaef-384e401a16fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:06.698139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99da3b1e-f04f-442d-aaef-384e401a16fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:06.699300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99da3b1e-f04f-442d-aaef-384e401a16fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:06.701057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99da3b1e-f04f-442d-aaef-384e401a16fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:06.702146 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99da3b1e-f04f-442d-aaef-384e401a16fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:06.733060 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-99da3b1e-f04f-442d-aaef-384e401a16fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] HTTP exception thrown: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-99da3b1e-f04f-442d-aaef-384e401a16fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Request method failure captured: Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee HTTP/1.1 Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u6VVUYSQHIFG-L_lu1e7YcRk8eV3szLxOlsgNguJe0NgzH51ENH5GUwS7heM4UePn22C8zgQywzGDDa5aZrsEN_vha-ETr2N912yVLwwXtt1JMJhFHjkEYS1-86Xu3zvGj0F-hKtueeQiB0XZ_dq7nCtSS6W3eb5GFSilgh1C10ELY Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:03:06.737546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac9a533f6f6f49e2bd73771fc99919c0", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 581ae6d40d34447da6651f3b2c21bdf0 Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:06.739553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '2ebc6aab-df38-4a7b-a10a-5c283a8843ee'} Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:06.740636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:06.742725 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:06.744192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-99da3b1e-f04f-442d-aaef-384e401a16fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Returning 404 to user: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:06.744192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-99da3b1e-f04f-442d-aaef-384e401a16fc tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 404 len: 111 microversion: 2.1 time: 0.061669 Jul 25 20:03:06.744192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1577/3298] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:06 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:06.757498 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-06b0f3bd-f195-463c-98e3-03ef69674df5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '.version_select at 0x7feb0c4a11f0>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:06.789642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-06b0f3bd-f195-463c-98e3-03ef69674df5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-886499556" status: 202 len: 0 microversion: 2.1 time: 0.039923 Jul 25 20:03:06.790876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1722/3299] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Jul 25 20:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-886499556 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:03:10.019433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc935e6b-b0ac-4395-96a8-0e032b10d993 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:10.020124 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cc935e6b-b0ac-4395-96a8-0e032b10d993 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:10.036004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc935e6b-b0ac-4395-96a8-0e032b10d993 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:10.036586 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc935e6b-b0ac-4395-96a8-0e032b10d993 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:10.037475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc935e6b-b0ac-4395-96a8-0e032b10d993 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:10.038007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc935e6b-b0ac-4395-96a8-0e032b10d993 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:10.062561 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-cc935e6b-b0ac-4395-96a8-0e032b10d993 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] HTTP exception thrown: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc935e6b-b0ac-4395-96a8-0e032b10d993 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Request method failure captured: Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee HTTP/1.1 Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u6VVUYSQHIFG-L_lu1e7YcRk8eV3szLxOlsgNguJe0NgzH51ENH5GUwS7heM4UePn22C8zgQywzGDDa5aZrsEN_vha-ETr2N912yVLwwXtt1JMJhFHjkEYS1-86Xu3zvGj0F-hKtueeQiB0XZ_dq7nCtSS6W3eb5GFSilgh1C10ELY Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:03:10.065814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac9a533f6f6f49e2bd73771fc99919c0", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 581ae6d40d34447da6651f3b2c21bdf0 Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:10.068739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '2ebc6aab-df38-4a7b-a10a-5c283a8843ee'} Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:10.070495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:10.073600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:10.075991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc935e6b-b0ac-4395-96a8-0e032b10d993 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Returning 404 to user: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:10.075991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cc935e6b-b0ac-4395-96a8-0e032b10d993 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 404 len: 111 microversion: 2.1 time: 0.053017 Jul 25 20:03:10.075991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1578/3300] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:03:10 2022] DELETE /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:10.084035 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-390e39ae-88c1-4fb5-9342-c2be40f2adf5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:10.085316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-390e39ae-88c1-4fb5-9342-c2be40f2adf5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 2ebc6aab-df38-4a7b-a10a-5c283a8843ee] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:10.097910 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-390e39ae-88c1-4fb5-9342-c2be40f2adf5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:10.098703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-390e39ae-88c1-4fb5-9342-c2be40f2adf5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:10.100157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-390e39ae-88c1-4fb5-9342-c2be40f2adf5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:10.100962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-390e39ae-88c1-4fb5-9342-c2be40f2adf5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:10.129136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-390e39ae-88c1-4fb5-9342-c2be40f2adf5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] HTTP exception thrown: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-390e39ae-88c1-4fb5-9342-c2be40f2adf5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Request method failure captured: Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee HTTP/1.1 Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u6VVUYSQHIFG-L_lu1e7YcRk8eV3szLxOlsgNguJe0NgzH51ENH5GUwS7heM4UePn22C8zgQywzGDDa5aZrsEN_vha-ETr2N912yVLwwXtt1JMJhFHjkEYS1-86Xu3zvGj0F-hKtueeQiB0XZ_dq7nCtSS6W3eb5GFSilgh1C10ELY Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:03:10.132410 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac9a533f6f6f49e2bd73771fc99919c0", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 581ae6d40d34447da6651f3b2c21bdf0 Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:10.134243 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '2ebc6aab-df38-4a7b-a10a-5c283a8843ee'} Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:10.135257 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. Jul 25 20:03:10.136933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:03:10.138531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-390e39ae-88c1-4fb5-9342-c2be40f2adf5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Returning 404 to user: Instance 2ebc6aab-df38-4a7b-a10a-5c283a8843ee could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:10.138531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-390e39ae-88c1-4fb5-9342-c2be40f2adf5 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee" status: 404 len: 111 microversion: 2.1 time: 0.058699 Jul 25 20:03:10.138531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1723/3301] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:10 2022] GET /compute/v2.1/servers/2ebc6aab-df38-4a7b-a10a-5c283a8843ee => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:11.308722 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c074e3d9-534a-4394-ab66-9e2d1813861c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:11.309724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c074e3d9-534a-4394-ab66-9e2d1813861c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:11.321306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c074e3d9-534a-4394-ab66-9e2d1813861c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.322129 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c074e3d9-534a-4394-ab66-9e2d1813861c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:11.323601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c074e3d9-534a-4394-ab66-9e2d1813861c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.324496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c074e3d9-534a-4394-ab66-9e2d1813861c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:11.342576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-c074e3d9-534a-4394-ab66-9e2d1813861c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] HTTP exception thrown: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c074e3d9-534a-4394-ab66-9e2d1813861c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Request method failure captured: Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 HTTP/1.1 Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u6VVUYSQHIFG-L_lu1e7YcRk8eV3szLxOlsgNguJe0NgzH51ENH5GUwS7heM4UePn22C8zgQywzGDDa5aZrsEN_vha-ETr2N912yVLwwXtt1JMJhFHjkEYS1-86Xu3zvGj0F-hKtueeQiB0XZ_dq7nCtSS6W3eb5GFSilgh1C10ELY Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:03:11.345833 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac9a533f6f6f49e2bd73771fc99919c0", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 581ae6d40d34447da6651f3b2c21bdf0 Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:03:11.348635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '7f20ea26-3cf4-4cfd-820d-dc05ed15b079'} Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:11.350266 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:03:11.352871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:03:11.355942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c074e3d9-534a-4394-ab66-9e2d1813861c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Returning 404 to user: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:11.355942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c074e3d9-534a-4394-ab66-9e2d1813861c tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 404 len: 111 microversion: 2.1 time: 0.042804 Jul 25 20:03:11.355942 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1579/3302] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:03:11 2022] DELETE /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:11.360441 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3850472f-43c5-4cb4-ad37-a0fcdbf8d0e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:11.361434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3850472f-43c5-4cb4-ad37-a0fcdbf8d0e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] [instance: 7f20ea26-3cf4-4cfd-820d-dc05ed15b079] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:11.370239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3850472f-43c5-4cb4-ad37-a0fcdbf8d0e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.370742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3850472f-43c5-4cb4-ad37-a0fcdbf8d0e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:11.371742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3850472f-43c5-4cb4-ad37-a0fcdbf8d0e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.372292 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3850472f-43c5-4cb4-ad37-a0fcdbf8d0e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:11.396531 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-3850472f-43c5-4cb4-ad37-a0fcdbf8d0e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] HTTP exception thrown: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3850472f-43c5-4cb4-ad37-a0fcdbf8d0e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Request method failure captured: Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 HTTP/1.1 Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u6VVUYSQHIFG-L_lu1e7YcRk8eV3szLxOlsgNguJe0NgzH51ENH5GUwS7heM4UePn22C8zgQywzGDDa5aZrsEN_vha-ETr2N912yVLwwXtt1JMJhFHjkEYS1-86Xu3zvGj0F-hKtueeQiB0XZ_dq7nCtSS6W3eb5GFSilgh1C10ELY Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:03:11.399334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac9a533f6f6f49e2bd73771fc99919c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac9a533f6f6f49e2bd73771fc99919c0", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: ac9a533f6f6f49e2bd73771fc99919c0 Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1388721905 Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 581ae6d40d34447da6651f3b2c21bdf0 Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeTestJSON-1388721905-project Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:03:11.401337 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '7f20ea26-3cf4-4cfd-820d-dc05ed15b079'} Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:11.402240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. Jul 25 20:03:11.403955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:03:11.405303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3850472f-43c5-4cb4-ad37-a0fcdbf8d0e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] Returning 404 to user: Instance 7f20ea26-3cf4-4cfd-820d-dc05ed15b079 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:11.405303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3850472f-43c5-4cb4-ad37-a0fcdbf8d0e6 tempest-AttachVolumeTestJSON-1388721905 tempest-AttachVolumeTestJSON-1388721905-project] 10.222.0.18 "GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079" status: 404 len: 111 microversion: 2.1 time: 0.047142 Jul 25 20:03:11.405303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1724/3303] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:11 2022] GET /compute/v2.1/servers/7f20ea26-3cf4-4cfd-820d-dc05ed15b079 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:33.538667 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b99f8746-8e30-4ab0-8800-5c3548b55b48 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:33.542517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b99f8746-8e30-4ab0-8800-5c3548b55b48 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:33.546349 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:33.548154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=67,nova_cell1:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:33.559338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b99f8746-8e30-4ab0-8800-5c3548b55b48 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.560154 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b99f8746-8e30-4ab0-8800-5c3548b55b48 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.561483 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b99f8746-8e30-4ab0-8800-5c3548b55b48 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.562299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b99f8746-8e30-4ab0-8800-5c3548b55b48 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.699922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b99f8746-8e30-4ab0-8800-5c3548b55b48 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "POST /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/action" status: 202 len: 0 microversion: 2.1 time: 0.169500 Jul 25 20:03:33.700574 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1580/3304] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 20:03:33 2022] POST /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:03:33.727550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-51cb3c1a-11d5-42e5-978a-0b2c66235729 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:33.727550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-51cb3c1a-11d5-42e5-978a-0b2c66235729 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:33.727550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:33.727550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:33.731339 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-51cb3c1a-11d5-42e5-978a-0b2c66235729 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.732174 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-51cb3c1a-11d5-42e5-978a-0b2c66235729 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.733659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-51cb3c1a-11d5-42e5-978a-0b2c66235729 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.735123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-51cb3c1a-11d5-42e5-978a-0b2c66235729 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:34.034396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-51cb3c1a-11d5-42e5-978a-0b2c66235729 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:34.045842 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-51cb3c1a-11d5-42e5-978a-0b2c66235729 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1752 microversion: 2.1 time: 0.338676 Jul 25 20:03:34.046585 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1725/3305] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:33 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1752 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:35.084260 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-40a75d92-99ae-4a4b-829c-24f4b8adea44 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:35.085343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-40a75d92-99ae-4a4b-829c-24f4b8adea44 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:35.096321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40a75d92-99ae-4a4b-829c-24f4b8adea44 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:35.096969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40a75d92-99ae-4a4b-829c-24f4b8adea44 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:35.098316 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40a75d92-99ae-4a4b-829c-24f4b8adea44 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:35.099032 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40a75d92-99ae-4a4b-829c-24f4b8adea44 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:35.308481 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-40a75d92-99ae-4a4b-829c-24f4b8adea44 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:35.318153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-40a75d92-99ae-4a4b-829c-24f4b8adea44 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1757 microversion: 2.1 time: 0.242642 Jul 25 20:03:35.319737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1581/3306] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:35 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1757 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:36.350226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-89b33479-7811-42d6-99c1-a8707675f662 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:36.351417 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-89b33479-7811-42d6-99c1-a8707675f662 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:36.363167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89b33479-7811-42d6-99c1-a8707675f662 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:36.364021 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89b33479-7811-42d6-99c1-a8707675f662 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:36.365723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89b33479-7811-42d6-99c1-a8707675f662 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:36.366362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89b33479-7811-42d6-99c1-a8707675f662 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:36.626162 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-89b33479-7811-42d6-99c1-a8707675f662 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:36.637747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-89b33479-7811-42d6-99c1-a8707675f662 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1757 microversion: 2.1 time: 0.296856 Jul 25 20:03:36.655590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1726/3307] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:36 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1757 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:37.676445 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-918edf4d-7805-4f37-b4d9-d350d7681a76 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:37.677835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-918edf4d-7805-4f37-b4d9-d350d7681a76 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:37.689219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-918edf4d-7805-4f37-b4d9-d350d7681a76 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:37.689630 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-918edf4d-7805-4f37-b4d9-d350d7681a76 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:37.690433 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-918edf4d-7805-4f37-b4d9-d350d7681a76 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:37.690885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-918edf4d-7805-4f37-b4d9-d350d7681a76 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:37.915500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-918edf4d-7805-4f37-b4d9-d350d7681a76 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:37.926219 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-918edf4d-7805-4f37-b4d9-d350d7681a76 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1757 microversion: 2.1 time: 0.256725 Jul 25 20:03:37.926918 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1582/3308] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:37 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1757 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:38.957624 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-152c7a6d-0cb9-4dc8-a73a-68d3fe40b6b8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:38.958610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-152c7a6d-0cb9-4dc8-a73a-68d3fe40b6b8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:38.965833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-152c7a6d-0cb9-4dc8-a73a-68d3fe40b6b8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:38.966827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-152c7a6d-0cb9-4dc8-a73a-68d3fe40b6b8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:38.967659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-152c7a6d-0cb9-4dc8-a73a-68d3fe40b6b8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:38.968099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-152c7a6d-0cb9-4dc8-a73a-68d3fe40b6b8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:39.188244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-152c7a6d-0cb9-4dc8-a73a-68d3fe40b6b8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:39.200712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-152c7a6d-0cb9-4dc8-a73a-68d3fe40b6b8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1757 microversion: 2.1 time: 0.248311 Jul 25 20:03:39.201639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1727/3309] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:38 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:40.236742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74601f04-1eac-4ce3-ad75-11af38fa9ee9 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:40.237543 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-74601f04-1eac-4ce3-ad75-11af38fa9ee9 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:40.245158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74601f04-1eac-4ce3-ad75-11af38fa9ee9 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:40.245600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74601f04-1eac-4ce3-ad75-11af38fa9ee9 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:40.246633 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74601f04-1eac-4ce3-ad75-11af38fa9ee9 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:40.247142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74601f04-1eac-4ce3-ad75-11af38fa9ee9 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:40.419389 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-74601f04-1eac-4ce3-ad75-11af38fa9ee9 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:40.429115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74601f04-1eac-4ce3-ad75-11af38fa9ee9 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1757 microversion: 2.1 time: 0.196351 Jul 25 20:03:40.429703 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1583/3310] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:40 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:41.456061 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f0d94f11-364d-4dd6-aaa9-6588aa76ed81 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:41.457123 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f0d94f11-364d-4dd6-aaa9-6588aa76ed81 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:41.464941 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0d94f11-364d-4dd6-aaa9-6588aa76ed81 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:41.465532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0d94f11-364d-4dd6-aaa9-6588aa76ed81 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:41.466416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0d94f11-364d-4dd6-aaa9-6588aa76ed81 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:41.466947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f0d94f11-364d-4dd6-aaa9-6588aa76ed81 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:41.674610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f0d94f11-364d-4dd6-aaa9-6588aa76ed81 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:41.683540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f0d94f11-364d-4dd6-aaa9-6588aa76ed81 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1757 microversion: 2.1 time: 0.233988 Jul 25 20:03:41.700475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1728/3311] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:41 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1757 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:42.708991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc41937c-b3b2-4637-8e38-e4a90cb9a126 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:42.709668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc41937c-b3b2-4637-8e38-e4a90cb9a126 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:42.717291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc41937c-b3b2-4637-8e38-e4a90cb9a126 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:42.717749 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc41937c-b3b2-4637-8e38-e4a90cb9a126 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:42.718531 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc41937c-b3b2-4637-8e38-e4a90cb9a126 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:42.718973 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc41937c-b3b2-4637-8e38-e4a90cb9a126 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:42.942402 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc41937c-b3b2-4637-8e38-e4a90cb9a126 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:42.954165 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc41937c-b3b2-4637-8e38-e4a90cb9a126 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1757 microversion: 2.1 time: 0.248548 Jul 25 20:03:42.954875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1584/3312] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:42 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:43.992733 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-61597e56-659d-4b70-8208-fd4ef3ffa8c4 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:43.993630 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-61597e56-659d-4b70-8208-fd4ef3ffa8c4 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:44.002599 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-61597e56-659d-4b70-8208-fd4ef3ffa8c4 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:44.003134 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-61597e56-659d-4b70-8208-fd4ef3ffa8c4 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:44.004039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-61597e56-659d-4b70-8208-fd4ef3ffa8c4 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:44.004554 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-61597e56-659d-4b70-8208-fd4ef3ffa8c4 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:44.282293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-61597e56-659d-4b70-8208-fd4ef3ffa8c4 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:44.310734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-61597e56-659d-4b70-8208-fd4ef3ffa8c4 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1757 microversion: 2.1 time: 0.323903 Jul 25 20:03:44.311659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1729/3313] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:43 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1757 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:45.338829 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cab0cb4e-225c-46c2-bfda-fe560e36229e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:45.339501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cab0cb4e-225c-46c2-bfda-fe560e36229e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:45.347461 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cab0cb4e-225c-46c2-bfda-fe560e36229e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:45.348263 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cab0cb4e-225c-46c2-bfda-fe560e36229e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:45.349083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cab0cb4e-225c-46c2-bfda-fe560e36229e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:45.349521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cab0cb4e-225c-46c2-bfda-fe560e36229e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:45.714091 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cab0cb4e-225c-46c2-bfda-fe560e36229e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:45.723218 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cab0cb4e-225c-46c2-bfda-fe560e36229e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1757 microversion: 2.1 time: 0.392303 Jul 25 20:03:45.723939 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1585/3314] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:45 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1757 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:46.747224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ceb01037-79d4-48dd-8bab-9a6314554d4e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:46.748749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ceb01037-79d4-48dd-8bab-9a6314554d4e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:46.757933 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ceb01037-79d4-48dd-8bab-9a6314554d4e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:46.758777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ceb01037-79d4-48dd-8bab-9a6314554d4e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:46.759851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ceb01037-79d4-48dd-8bab-9a6314554d4e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:46.760303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ceb01037-79d4-48dd-8bab-9a6314554d4e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:47.024801 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ceb01037-79d4-48dd-8bab-9a6314554d4e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:47.045002 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ceb01037-79d4-48dd-8bab-9a6314554d4e tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1760 microversion: 2.1 time: 0.302262 Jul 25 20:03:47.045934 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1730/3315] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:46 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1760 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:22.962467 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:04:22.963418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 20:04:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:04:51.013475 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=12 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:51.014366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:51.019521 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-21289471-3602-491c-8dc7-acc8c9aeff32 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-570283147"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:51.020067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-21289471-3602-491c-8dc7-acc8c9aeff32 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:51.027470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21289471-3602-491c-8dc7-acc8c9aeff32 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:51.027951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21289471-3602-491c-8dc7-acc8c9aeff32 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:51.028712 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21289471-3602-491c-8dc7-acc8c9aeff32 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:51.029158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-21289471-3602-491c-8dc7-acc8c9aeff32 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:51.171391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.network.security_group_api [None req-21289471-3602-491c-8dc7-acc8c9aeff32 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Removing security group 217d90e6-5542-4dea-961d-564f94101751 from port d9dd5948-41bb-4605-9ed0-2a444ae66885 Jul 25 20:04:51.556668 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-21289471-3602-491c-8dc7-acc8c9aeff32 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "POST /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/action" status: 202 len: 0 microversion: 2.1 time: 0.544751 Jul 25 20:04:51.557453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1586/3316] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Jul 25 20:04:51 2022] POST /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:04:51.575639 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-9dcc8227-74d4-4ec0-a8f7-98cd8748d8fb req-0d4ed0c6-857a-4bd6-b3ac-060fa79ca471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33d904c-2e45-4dca-9a90-844c8c107ed0", "tag": "d9dd5948-41bb-4605-9ed0-2a444ae66885"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:51.582191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=12 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:51.583216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=36 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:51.605853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-9dcc8227-74d4-4ec0-a8f7-98cd8748d8fb req-0d4ed0c6-857a-4bd6-b3ac-060fa79ca471 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:51.606306 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-9dcc8227-74d4-4ec0-a8f7-98cd8748d8fb req-0d4ed0c6-857a-4bd6-b3ac-060fa79ca471 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:51.621548 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-9dcc8227-74d4-4ec0-a8f7-98cd8748d8fb req-0d4ed0c6-857a-4bd6-b3ac-060fa79ca471 service nova] Creating event network-changed:d9dd5948-41bb-4605-9ed0-2a444ae66885 for instance e33d904c-2e45-4dca-9a90-844c8c107ed0 on hv-cinder-85093 Jul 25 20:04:51.628618 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-9dcc8227-74d4-4ec0-a8f7-98cd8748d8fb req-0d4ed0c6-857a-4bd6-b3ac-060fa79ca471 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064659 Jul 25 20:04:51.634024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1731/3317] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:53.295892 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-be6db118-ce57-4023-be8e-d0cf989b0fb3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:53.296482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-be6db118-ce57-4023-be8e-d0cf989b0fb3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:53.302968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be6db118-ce57-4023-be8e-d0cf989b0fb3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:53.303416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be6db118-ce57-4023-be8e-d0cf989b0fb3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:53.304211 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be6db118-ce57-4023-be8e-d0cf989b0fb3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:53.304640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be6db118-ce57-4023-be8e-d0cf989b0fb3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:53.408708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-be6db118-ce57-4023-be8e-d0cf989b0fb3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lazy-loading 'services' on Instance uuid e33d904c-2e45-4dca-9a90-844c8c107ed0 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:53.495462 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-be6db118-ce57-4023-be8e-d0cf989b0fb3 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments/02aab3d8-f6ac-457b-9102-7d6da3d523e1" status: 202 len: 0 microversion: 2.1 time: 0.203882 Jul 25 20:04:53.496245 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1587/3318] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 20:04:53 2022] DELETE /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments/02aab3d8-f6ac-457b-9102-7d6da3d523e1 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:04:53.506104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bbfa5199-7e86-4012-95f6-c15049dc8a6f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:53.508502 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bbfa5199-7e86-4012-95f6-c15049dc8a6f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:53.515617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bbfa5199-7e86-4012-95f6-c15049dc8a6f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:53.517297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bbfa5199-7e86-4012-95f6-c15049dc8a6f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:53.518215 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bbfa5199-7e86-4012-95f6-c15049dc8a6f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:53.519083 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bbfa5199-7e86-4012-95f6-c15049dc8a6f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:53.551281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bbfa5199-7e86-4012-95f6-c15049dc8a6f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050578 Jul 25 20:04:53.552213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1732/3319] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 20:04:53 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:53.646299 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-ed7e89fa-40fd-4f05-95d6-465f9a101494 req-5aff9da5-6135-4359-ae90-82fb3ee1e2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33d904c-2e45-4dca-9a90-844c8c107ed0", "tag": "d9dd5948-41bb-4605-9ed0-2a444ae66885"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:53.657716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ed7e89fa-40fd-4f05-95d6-465f9a101494 req-5aff9da5-6135-4359-ae90-82fb3ee1e2b8 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:53.658496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ed7e89fa-40fd-4f05-95d6-465f9a101494 req-5aff9da5-6135-4359-ae90-82fb3ee1e2b8 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:53.671563 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-ed7e89fa-40fd-4f05-95d6-465f9a101494 req-5aff9da5-6135-4359-ae90-82fb3ee1e2b8 service nova] Creating event network-changed:d9dd5948-41bb-4605-9ed0-2a444ae66885 for instance e33d904c-2e45-4dca-9a90-844c8c107ed0 on hv-cinder-85093 Jul 25 20:04:53.678409 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-ed7e89fa-40fd-4f05-95d6-465f9a101494 req-5aff9da5-6135-4359-ae90-82fb3ee1e2b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036896 Jul 25 20:04:53.678990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1588/3320] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:54.566389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0e9759a1-3ede-4b1e-b930-a1d17e4ab26b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:54.568607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0e9759a1-3ede-4b1e-b930-a1d17e4ab26b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:54.575053 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e9759a1-3ede-4b1e-b930-a1d17e4ab26b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:54.575534 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e9759a1-3ede-4b1e-b930-a1d17e4ab26b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:54.576315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e9759a1-3ede-4b1e-b930-a1d17e4ab26b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:54.576750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0e9759a1-3ede-4b1e-b930-a1d17e4ab26b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:54.610448 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0e9759a1-3ede-4b1e-b930-a1d17e4ab26b tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048928 Jul 25 20:04:54.611025 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1733/3321] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 20:04:54 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:55.624413 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d6a6f00-b287-4c02-a84f-d65646ccbde7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:55.626991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d6a6f00-b287-4c02-a84f-d65646ccbde7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:55.633513 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d6a6f00-b287-4c02-a84f-d65646ccbde7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:55.633969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d6a6f00-b287-4c02-a84f-d65646ccbde7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:55.634751 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d6a6f00-b287-4c02-a84f-d65646ccbde7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:55.635184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d6a6f00-b287-4c02-a84f-d65646ccbde7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:55.669834 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d6a6f00-b287-4c02-a84f-d65646ccbde7 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050328 Jul 25 20:04:55.670379 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1589/3322] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Jul 25 20:04:55 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:04:55.683077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-11d12bf2-6f76-4a7c-ba48-4ff9ef06f6fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:55.683077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-11d12bf2-6f76-4a7c-ba48-4ff9ef06f6fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:55.689925 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11d12bf2-6f76-4a7c-ba48-4ff9ef06f6fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:55.690879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11d12bf2-6f76-4a7c-ba48-4ff9ef06f6fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:55.691701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11d12bf2-6f76-4a7c-ba48-4ff9ef06f6fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:55.692141 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-11d12bf2-6f76-4a7c-ba48-4ff9ef06f6fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:55.772792 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-11d12bf2-6f76-4a7c-ba48-4ff9ef06f6fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] HTTP exception thrown: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 is not attached to volume 02aab3d8-f6ac-457b-9102-7d6da3d523e1 Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-11d12bf2-6f76-4a7c-ba48-4ff9ef06f6fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Request method failure captured: Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: DELETE /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments/02aab3d8-f6ac-457b-9102-7d6da3d523e1 HTTP/1.1 Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3va7muU5e1Mn5T1tI_8Tn2y-IKc5DZRXKpo9kBIltJWg4S8jNlOu5QPuGcjoLXqh5x01QMGapskmYW3QwI6lkiaDb62uOldKlMoIeg3ZGvl6XSNvjJp0lEV10o2bCXtosXj1gu1baGjXROAhAnx3-iNMj49uVaP5ipWMVWONKXY2L88 Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: e56f16131082413896ec23ec60378226 Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-TestMinimumBasicScenario-573817009 Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:04:55.780179 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e56f16131082413896ec23ec60378226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e56f16131082413896ec23ec60378226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e56f16131082413896ec23ec60378226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e56f16131082413896ec23ec60378226", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-TestMinimumBasicScenario-573817009 Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: e56f16131082413896ec23ec60378226 Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-TestMinimumBasicScenario-573817009 Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-TestMinimumBasicScenario-573817009-project Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: a0fadb91a8b54ece9ece2b5756be399e Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-TestMinimumBasicScenario-573817009-project Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:04:55.782199 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 is not attached to volume 02aab3d8-f6ac-457b-9102-7d6da3d523e1 Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'server_id': 'e33d904c-2e45-4dca-9a90-844c8c107ed0', 'id': '02aab3d8-f6ac-457b-9102-7d6da3d523e1'} Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 02aab3d8-f6ac-457b-9102-7d6da3d523e1. Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:04:55.783120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 is not attached to volume 02aab3d8-f6ac-457b-9102-7d6da3d523e1 Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 is not attached to volume 02aab3d8-f6ac-457b-9102-7d6da3d523e1 Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:04:55.784939 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-11d12bf2-6f76-4a7c-ba48-4ff9ef06f6fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Returning 404 to user: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 is not attached to volume 02aab3d8-f6ac-457b-9102-7d6da3d523e1 {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:04:55.786373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-11d12bf2-6f76-4a7c-ba48-4ff9ef06f6fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments/02aab3d8-f6ac-457b-9102-7d6da3d523e1" status: 404 len: 154 microversion: 2.1 time: 0.104856 Jul 25 20:04:55.786373 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1734/3323] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Jul 25 20:04:55 2022] DELETE /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0/os-volume_attachments/02aab3d8-f6ac-457b-9102-7d6da3d523e1 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:04:56.967070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fa55dfe4-1e87-4866-9e75-0b17c8c4192f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:56.967657 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa55dfe4-1e87-4866-9e75-0b17c8c4192f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:56.974453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa55dfe4-1e87-4866-9e75-0b17c8c4192f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:56.974896 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa55dfe4-1e87-4866-9e75-0b17c8c4192f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:56.975679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa55dfe4-1e87-4866-9e75-0b17c8c4192f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:56.976116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa55dfe4-1e87-4866-9e75-0b17c8c4192f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:57.003909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa55dfe4-1e87-4866-9e75-0b17c8c4192f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:04:57.085805 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fa55dfe4-1e87-4866-9e75-0b17c8c4192f tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 204 len: 0 microversion: 2.1 time: 0.122224 Jul 25 20:04:57.086509 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1590/3324] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:04:56 2022] DELETE /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:04:57.096272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c3885755-783a-4f61-85ec-eacbc63d7bb2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:57.096936 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c3885755-783a-4f61-85ec-eacbc63d7bb2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:57.105107 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c3885755-783a-4f61-85ec-eacbc63d7bb2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:57.105582 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c3885755-783a-4f61-85ec-eacbc63d7bb2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:57.106370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c3885755-783a-4f61-85ec-eacbc63d7bb2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:57.107015 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c3885755-783a-4f61-85ec-eacbc63d7bb2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:57.261275 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c3885755-783a-4f61-85ec-eacbc63d7bb2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:57.270094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c3885755-783a-4f61-85ec-eacbc63d7bb2 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1555 microversion: 2.1 time: 0.179080 Jul 25 20:04:57.270681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1735/3325] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:57 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:58.292357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-141abf1c-dea8-4647-85f9-5b95e2f608df tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:58.293047 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-141abf1c-dea8-4647-85f9-5b95e2f608df tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:58.300472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-141abf1c-dea8-4647-85f9-5b95e2f608df tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:58.300911 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-141abf1c-dea8-4647-85f9-5b95e2f608df tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:58.301675 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-141abf1c-dea8-4647-85f9-5b95e2f608df tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:58.302097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-141abf1c-dea8-4647-85f9-5b95e2f608df tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:58.446161 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-141abf1c-dea8-4647-85f9-5b95e2f608df tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:58.454397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-141abf1c-dea8-4647-85f9-5b95e2f608df tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1555 microversion: 2.1 time: 0.165470 Jul 25 20:04:58.455083 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1591/3326] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:58 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:59.476066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9a538edd-5ebf-4914-8f6b-9a628688c727 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:59.476957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9a538edd-5ebf-4914-8f6b-9a628688c727 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:59.483992 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a538edd-5ebf-4914-8f6b-9a628688c727 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:59.484434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a538edd-5ebf-4914-8f6b-9a628688c727 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:59.485622 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a538edd-5ebf-4914-8f6b-9a628688c727 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:59.486064 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9a538edd-5ebf-4914-8f6b-9a628688c727 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:59.642813 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9a538edd-5ebf-4914-8f6b-9a628688c727 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:59.650355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9a538edd-5ebf-4914-8f6b-9a628688c727 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1555 microversion: 2.1 time: 0.178561 Jul 25 20:04:59.650923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1736/3327] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:59 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:00.318388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-f4d73a7f-e923-40c0-bced-e4e8b818d32c req-e81056f1-0457-432a-b596-9af5fd1ce2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d904c-2e45-4dca-9a90-844c8c107ed0", "name": "network-vif-deleted", "tag": "d9dd5948-41bb-4605-9ed0-2a444ae66885"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:00.330686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-f4d73a7f-e923-40c0-bced-e4e8b818d32c req-e81056f1-0457-432a-b596-9af5fd1ce2b2 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:00.331142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-f4d73a7f-e923-40c0-bced-e4e8b818d32c req-e81056f1-0457-432a-b596-9af5fd1ce2b2 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:00.344933 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-f4d73a7f-e923-40c0-bced-e4e8b818d32c req-e81056f1-0457-432a-b596-9af5fd1ce2b2 service nova] Creating event network-vif-deleted:d9dd5948-41bb-4605-9ed0-2a444ae66885 for instance e33d904c-2e45-4dca-9a90-844c8c107ed0 on hv-cinder-85093 Jul 25 20:05:00.350581 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-f4d73a7f-e923-40c0-bced-e4e8b818d32c req-e81056f1-0457-432a-b596-9af5fd1ce2b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036010 Jul 25 20:05:00.351357 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1592/3328] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:00.672358 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:00.674819 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:00.682366 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:00.682973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:00.683908 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:00.684419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:00.720250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:00.720942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:00.721472 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lazy-loading 'fault' on Instance uuid e33d904c-2e45-4dca-9a90-844c8c107ed0 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:05:00.766533 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fadb91a8b54ece9ece2b5756be399e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56f16131082413896ec23ec60378226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:00.774966 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6e04fdd4-95b1-45e7-ba31-6de67f2768c8 tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 200 len: 1349 microversion: 2.1 time: 0.106601 Jul 25 20:05:00.775646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1737/3329] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:00 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:01.799793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-76a0cbf7-ed58-491b-88e7-8c80e8dbd29a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:01.800437 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-76a0cbf7-ed58-491b-88e7-8c80e8dbd29a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] [instance: e33d904c-2e45-4dca-9a90-844c8c107ed0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:01.807265 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76a0cbf7-ed58-491b-88e7-8c80e8dbd29a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:01.807747 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76a0cbf7-ed58-491b-88e7-8c80e8dbd29a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:01.808510 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76a0cbf7-ed58-491b-88e7-8c80e8dbd29a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:01.808945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76a0cbf7-ed58-491b-88e7-8c80e8dbd29a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:01.823170 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-76a0cbf7-ed58-491b-88e7-8c80e8dbd29a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] HTTP exception thrown: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 could not be found. Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-76a0cbf7-ed58-491b-88e7-8c80e8dbd29a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Request method failure captured: Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 HTTP/1.1 Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3va7muU5e1Mn5T1tI_8Tn2y-IKc5DZRXKpo9kBIltJWg4S8jNlOu5QPuGcjoLXqh5x01QMGapskmYW3QwI6lkiaDb62uOldKlMoIeg3ZGvl6XSNvjJp0lEV10o2bCXtosXj1gu1baGjXROAhAnx3-iNMj49uVaP5ipWMVWONKXY2L88 Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: e56f16131082413896ec23ec60378226 Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestMinimumBasicScenario-573817009 Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:05:01.824862 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e56f16131082413896ec23ec60378226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e56f16131082413896ec23ec60378226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e56f16131082413896ec23ec60378226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e56f16131082413896ec23ec60378226", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestMinimumBasicScenario-573817009 Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: e56f16131082413896ec23ec60378226 Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestMinimumBasicScenario-573817009 Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-TestMinimumBasicScenario-573817009-project Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: a0fadb91a8b54ece9ece2b5756be399e Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestMinimumBasicScenario-573817009-project Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 could not be found. Jul 25 20:05:01.826640 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'e33d904c-2e45-4dca-9a90-844c8c107ed0'} Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 could not be found. Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:05:01.827781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 could not be found. Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 could not be found. Jul 25 20:05:01.830311 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:05:01.832017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-76a0cbf7-ed58-491b-88e7-8c80e8dbd29a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Returning 404 to user: Instance e33d904c-2e45-4dca-9a90-844c8c107ed0 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:05:01.832017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-76a0cbf7-ed58-491b-88e7-8c80e8dbd29a tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0" status: 404 len: 111 microversion: 2.1 time: 0.030935 Jul 25 20:05:01.832017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1593/3330] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:01 2022] GET /compute/v2.1/servers/e33d904c-2e45-4dca-9a90-844c8c107ed0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:05:01.836228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-906b2a63-64d3-4541-b5b0-cf7d50b705fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] Calling method '.version_select at 0x7feafbfd6ee0>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:01.857085 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-906b2a63-64d3-4541-b5b0-cf7d50b705fb tempest-TestMinimumBasicScenario-573817009 tempest-TestMinimumBasicScenario-573817009-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1030959817" status: 202 len: 0 microversion: 2.1 time: 0.024815 Jul 25 20:05:01.857662 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1738/3331] 10.222.0.18 () {58 vars in 1272 bytes} [Mon Jul 25 20:05:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1030959817 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:05:19.065750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:05:19.066598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 20:05:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:06:16.220366 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:16.221331 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:16.226020 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d8c161dc-243d-4d03-b231-05e040a6eea5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:16.226507 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d8c161dc-243d-4d03-b231-05e040a6eea5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:16.234944 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8c161dc-243d-4d03-b231-05e040a6eea5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:16.235391 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8c161dc-243d-4d03-b231-05e040a6eea5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:16.236929 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8c161dc-243d-4d03-b231-05e040a6eea5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:16.237440 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8c161dc-243d-4d03-b231-05e040a6eea5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:16.255059 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-d8c161dc-243d-4d03-b231-05e040a6eea5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] HTTP exception thrown: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d8c161dc-243d-4d03-b231-05e040a6eea5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Request method failure captured: Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 HTTP/1.1 Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u389jrmBnFdq0d4Fb_QneBmvFS3U6iO7d6ZbyfNOsvEyFIEO5HLyG9aj20qJwgM9KwwqJWQTvRdI0DCncJdkA33gS33QZo48b7hNXnnUfQt90mh5iuRuc7DvEakocyEqZmtgfH4oZ8XKMFTF0iGtFOvlyTBwn7OfjF3H_xkAEBbgus Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 5ef063ca1eb846d78ff8901d2a3fc0a3 Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:06:16.256650 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ef063ca1eb846d78ff8901d2a3fc0a3", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 5ef063ca1eb846d78ff8901d2a3fc0a3 Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeShelveTestJSON-1599472047-project Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: ac2e584f88cd46f280b7fe04aa1382fd Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599472047-project Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 20:06:16.258164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '2df24471-2352-4e79-be15-e395eabf66e8'} Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:16.259024 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 20:06:16.260444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:06:16.261897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d8c161dc-243d-4d03-b231-05e040a6eea5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Returning 404 to user: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:16.261897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d8c161dc-243d-4d03-b231-05e040a6eea5 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 404 len: 111 microversion: 2.20 time: 0.039668 Jul 25 20:06:16.261897 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1594/3332] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Jul 25 20:06:16 2022] DELETE /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:06:16.267098 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=40 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:16.268439 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:16.272641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-84444f6b-ff77-4c97-ad91-9f6215ccca9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:16.273251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-84444f6b-ff77-4c97-ad91-9f6215ccca9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 2df24471-2352-4e79-be15-e395eabf66e8] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:16.281909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84444f6b-ff77-4c97-ad91-9f6215ccca9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:16.282344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84444f6b-ff77-4c97-ad91-9f6215ccca9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:16.283251 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84444f6b-ff77-4c97-ad91-9f6215ccca9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:16.283712 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-84444f6b-ff77-4c97-ad91-9f6215ccca9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:16.297164 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-84444f6b-ff77-4c97-ad91-9f6215ccca9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] HTTP exception thrown: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-84444f6b-ff77-4c97-ad91-9f6215ccca9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Request method failure captured: Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 HTTP/1.1 Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u389jrmBnFdq0d4Fb_QneBmvFS3U6iO7d6ZbyfNOsvEyFIEO5HLyG9aj20qJwgM9KwwqJWQTvRdI0DCncJdkA33gS33QZo48b7hNXnnUfQt90mh5iuRuc7DvEakocyEqZmtgfH4oZ8XKMFTF0iGtFOvlyTBwn7OfjF3H_xkAEBbgus Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 5ef063ca1eb846d78ff8901d2a3fc0a3 Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:06:16.299226 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ef063ca1eb846d78ff8901d2a3fc0a3", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 5ef063ca1eb846d78ff8901d2a3fc0a3 Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeShelveTestJSON-1599472047-project Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: ac2e584f88cd46f280b7fe04aa1382fd Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599472047-project Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 20:06:16.300569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '2df24471-2352-4e79-be15-e395eabf66e8'} Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:16.301245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. Jul 25 20:06:16.302260 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:06:16.303089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-84444f6b-ff77-4c97-ad91-9f6215ccca9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Returning 404 to user: Instance 2df24471-2352-4e79-be15-e395eabf66e8 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:16.303089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-84444f6b-ff77-4c97-ad91-9f6215ccca9d tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8" status: 404 len: 111 microversion: 2.20 time: 0.037088 Jul 25 20:06:16.303089 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1739/3333] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 20:06:16 2022] GET /compute/v2.1/servers/2df24471-2352-4e79-be15-e395eabf66e8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:06:17.449755 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5442fda1-f817-473e-8ef7-a5c72f70afdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:17.450328 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5442fda1-f817-473e-8ef7-a5c72f70afdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:17.458017 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5442fda1-f817-473e-8ef7-a5c72f70afdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:17.458453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5442fda1-f817-473e-8ef7-a5c72f70afdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:17.459210 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5442fda1-f817-473e-8ef7-a5c72f70afdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:17.459672 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5442fda1-f817-473e-8ef7-a5c72f70afdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:17.473627 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-5442fda1-f817-473e-8ef7-a5c72f70afdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] HTTP exception thrown: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5442fda1-f817-473e-8ef7-a5c72f70afdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Request method failure captured: Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 HTTP/1.1 Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3u389jrmBnFdq0d4Fb_QneBmvFS3U6iO7d6ZbyfNOsvEyFIEO5HLyG9aj20qJwgM9KwwqJWQTvRdI0DCncJdkA33gS33QZo48b7hNXnnUfQt90mh5iuRuc7DvEakocyEqZmtgfH4oZ8XKMFTF0iGtFOvlyTBwn7OfjF3H_xkAEBbgus Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 5ef063ca1eb846d78ff8901d2a3fc0a3 Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:06:17.475224 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ef063ca1eb846d78ff8901d2a3fc0a3", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 5ef063ca1eb846d78ff8901d2a3fc0a3 Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeShelveTestJSON-1599472047-project Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: ac2e584f88cd46f280b7fe04aa1382fd Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599472047-project Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. Jul 25 20:06:17.476676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '1007369a-dd3c-4837-95f4-e8326d600031'} Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:17.477485 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. Jul 25 20:06:17.478744 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:06:17.480028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5442fda1-f817-473e-8ef7-a5c72f70afdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Returning 404 to user: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:17.480028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5442fda1-f817-473e-8ef7-a5c72f70afdf tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 404 len: 111 microversion: 2.20 time: 0.030725 Jul 25 20:06:17.480028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1595/3334] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Jul 25 20:06:17 2022] DELETE /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:06:17.485508 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b12125da-794f-48ad-819c-188886a550d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:17.486283 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b12125da-794f-48ad-819c-188886a550d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] [instance: 1007369a-dd3c-4837-95f4-e8326d600031] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:17.493004 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b12125da-794f-48ad-819c-188886a550d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:17.493527 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b12125da-794f-48ad-819c-188886a550d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:17.494295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b12125da-794f-48ad-819c-188886a550d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:17.494731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b12125da-794f-48ad-819c-188886a550d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:17.511400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-b12125da-794f-48ad-819c-188886a550d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] HTTP exception thrown: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b12125da-794f-48ad-819c-188886a550d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Request method failure captured: Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 HTTP/1.1 Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u389jrmBnFdq0d4Fb_QneBmvFS3U6iO7d6ZbyfNOsvEyFIEO5HLyG9aj20qJwgM9KwwqJWQTvRdI0DCncJdkA33gS33QZo48b7hNXnnUfQt90mh5iuRuc7DvEakocyEqZmtgfH4oZ8XKMFTF0iGtFOvlyTBwn7OfjF3H_xkAEBbgus Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 5ef063ca1eb846d78ff8901d2a3fc0a3 Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:06:17.513128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ef063ca1eb846d78ff8901d2a3fc0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ef063ca1eb846d78ff8901d2a3fc0a3", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 5ef063ca1eb846d78ff8901d2a3fc0a3 Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1599472047 Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeShelveTestJSON-1599472047-project Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: ac2e584f88cd46f280b7fe04aa1382fd Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1599472047-project Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. Jul 25 20:06:17.514416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '1007369a-dd3c-4837-95f4-e8326d600031'} Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:17.515252 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. Jul 25 20:06:17.516412 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:06:17.517478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b12125da-794f-48ad-819c-188886a550d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] Returning 404 to user: Instance 1007369a-dd3c-4837-95f4-e8326d600031 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:17.517478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b12125da-794f-48ad-819c-188886a550d9 tempest-AttachVolumeShelveTestJSON-1599472047 tempest-AttachVolumeShelveTestJSON-1599472047-project] 10.222.0.18 "GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031" status: 404 len: 111 microversion: 2.20 time: 0.033223 Jul 25 20:06:17.517478 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1740/3335] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Jul 25 20:06:17 2022] GET /compute/v2.1/servers/1007369a-dd3c-4837-95f4-e8326d600031 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:06:38.976107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:06:38.976710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 20:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:07:37.635015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:37.637418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:37.782160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:37.782903 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:37.787384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-05f8aacf-b261-42ba-ab33-0544c2bca399 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:37.787995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-05f8aacf-b261-42ba-ab33-0544c2bca399 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:37.799886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05f8aacf-b261-42ba-ab33-0544c2bca399 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.800334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05f8aacf-b261-42ba-ab33-0544c2bca399 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.801104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05f8aacf-b261-42ba-ab33-0544c2bca399 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.801573 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-05f8aacf-b261-42ba-ab33-0544c2bca399 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.816646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-05f8aacf-b261-42ba-ab33-0544c2bca399 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-05f8aacf-b261-42ba-ab33-0544c2bca399 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: DELETE /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 HTTP/1.1 Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:07:37.818470 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. Jul 25 20:07:37.820392 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '4bcfc471-41be-4079-81d3-0cf334d03888'} Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:37.821058 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. Jul 25 20:07:37.822102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.823147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-05f8aacf-b261-42ba-ab33-0544c2bca399 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:37.823147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-05f8aacf-b261-42ba-ab33-0544c2bca399 tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 404 len: 111 microversion: 2.1 time: 0.039394 Jul 25 20:07:37.823147 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1741/3336] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:07:37 2022] DELETE /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:07:37.828986 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-44f6a4ba-f246-4790-b521-7039304ac9fe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:37.829759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-44f6a4ba-f246-4790-b521-7039304ac9fe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] [instance: 4bcfc471-41be-4079-81d3-0cf334d03888] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:37.836957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44f6a4ba-f246-4790-b521-7039304ac9fe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.837748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44f6a4ba-f246-4790-b521-7039304ac9fe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.838634 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44f6a4ba-f246-4790-b521-7039304ac9fe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.839153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-44f6a4ba-f246-4790-b521-7039304ac9fe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.856239 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-44f6a4ba-f246-4790-b521-7039304ac9fe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] HTTP exception thrown: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-44f6a4ba-f246-4790-b521-7039304ac9fe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Request method failure captured: Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 HTTP/1.1 Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3u4Mv4T_ajJrtT7JSYRGMC4lNAqUkDmpuJlizrnm40lIxAkBJ5wLLYyaplQ00dgajwMIyNMQS35BoILEke_obaVj-iokw1-fKD7Mpi2BTwugNlxFbOawPwBEbBajwHnTPcOjP03_SWut9132tLCBKaTzLKaPy3g_Mr4GVh6RxUnaKCE Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:07:37.858293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8185baa0f3e3465f813c0e2dc29ad847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8185baa0f3e3465f813c0e2dc29ad847", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 8185baa0f3e3465f813c0e2dc29ad847 Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2015125409 Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 6ecf34ceee294b53b5be7c1723b42950 Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-AttachVolumeNegativeTest-2015125409-project Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. Jul 25 20:07:37.859553 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '4bcfc471-41be-4079-81d3-0cf334d03888'} Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:37.860281 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. Jul 25 20:07:37.861347 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.863207 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-44f6a4ba-f246-4790-b521-7039304ac9fe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] Returning 404 to user: Instance 4bcfc471-41be-4079-81d3-0cf334d03888 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:37.864329 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-44f6a4ba-f246-4790-b521-7039304ac9fe tempest-AttachVolumeNegativeTest-2015125409 tempest-AttachVolumeNegativeTest-2015125409-project] 10.222.0.18 "GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888" status: 404 len: 111 microversion: 2.1 time: 0.039170 Jul 25 20:07:37.865158 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1742/3337] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:37 2022] GET /compute/v2.1/servers/4bcfc471-41be-4079-81d3-0cf334d03888 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:07:37.887164 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b53a5245-fe4c-41ea-8471-80fd59b5883f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Action: 'create', calling method: .version_select at 0x7feb0839fee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-546487680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC57+N5ucLkcIhz6WLjMD0RIWMrfpPbjECVN/EqCPW9PaYyNmyCHwSfpv2BADPimhThnppYGjpjOk8kHLxM9ZGo/w7FCEzu726c4+/JMlag5Sqe1YmiP6HlkLu4Wq5LBQ=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:37.904708 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-b53a5245-fe4c-41ea-8471-80fd59b5883f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Getting quotas for project b6986405c7974cc8bdf5d0c470926c1f. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:07:37.909199 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-b53a5245-fe4c-41ea-8471-80fd59b5883f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Getting quotas for user 8143c33eabd74b1b9edc84e8ff155903 and project b6986405c7974cc8bdf5d0c470926c1f. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:07:37.922432 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b53a5245-fe4c-41ea-8471-80fd59b5883f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [328b3fa1-ce51-4d0e-961e-f9b376db3494] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 20:07:38.932579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [None req-b53a5245-fe4c-41ea-8471-80fd59b5883f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [328b3fa1-ce51-4d0e-961e-f9b376db3494] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 46926. Jul 25 20:07:38.950470 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b53a5245-fe4c-41ea-8471-80fd59b5883f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.318043 Jul 25 20:07:38.951081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1596/3338] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Jul 25 20:07:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:43.812009 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-6104d8c9-8d9b-4d05-b0c9-50808d5f505b tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Action: 'create', calling method: .version_select at 0x7feafb57b3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2083847128"}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:44.262297 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-6104d8c9-8d9b-4d05-b0c9-50808d5f505b tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.595388 Jul 25 20:07:44.263235 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1743/3339] 10.222.0.18 () {60 vars in 1155 bytes} [Mon Jul 25 20:07:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 597 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 25 20:07:44.285169 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b6cd6339-64b8-42ac-b668-2511f277736a tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c413f70>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:44.396045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b6cd6339-64b8-42ac-b668-2511f277736a tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb" status: 200 len: 345 microversion: 2.1 time: 0.124858 Jul 25 20:07:44.396613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1597/3340] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 20:07:44 2022] GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:45.410744 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-acebd08d-c266-41ac-871b-2f9f0ea3b34c tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feafb616940>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:45.460767 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-acebd08d-c266-41ac-871b-2f9f0ea3b34c tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb" status: 200 len: 346 microversion: 2.1 time: 0.054130 Jul 25 20:07:45.461574 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1744/3341] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 20:07:45 2022] GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:45.475215 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e5f931be-0963-438c-9a99-776f31e8e763 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Action: 'create', calling method: .version_select at 0x7feb0c40f1f0>, body: {"snapshot": {"volume_id": "6495f373-0cc3-4b59-99a6-68999f62adfb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-512091668"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:45.644724 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e5f931be-0963-438c-9a99-776f31e8e763 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.174616 Jul 25 20:07:45.648925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1598/3342] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Jul 25 20:07:45 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:07:45.660505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-adf13324-cab5-4865-b8b2-7752b8f34826 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c4a1280>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:45.692651 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-adf13324-cab5-4865-b8b2-7752b8f34826 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 200 len: 286 microversion: 2.1 time: 0.035965 Jul 25 20:07:45.693324 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1745/3343] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:45 2022] GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:45.704966 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8cd5fef2-febb-4fe7-a241-6ce2ab66bcf8 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c2810d0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:45.735987 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8cd5fef2-febb-4fe7-a241-6ce2ab66bcf8 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034888 Jul 25 20:07:45.736546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1599/3344] 10.222.0.18 () {58 vars in 1140 bytes} [Mon Jul 25 20:07:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:07:45.748127 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-23687504-84b4-4c22-9440-5b98467a8765 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feafb57b0d0>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:45.779973 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-23687504-84b4-4c22-9440-5b98467a8765 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 200 len: 286 microversion: 2.1 time: 0.035414 Jul 25 20:07:45.780589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1746/3345] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:45 2022] GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:46.795798 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-28a0c88a-9321-4af0-8746-0daca07e88ab tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c413700>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:46.828583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-28a0c88a-9321-4af0-8746-0daca07e88ab tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 200 len: 286 microversion: 2.1 time: 0.037202 Jul 25 20:07:46.829178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1600/3346] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:46 2022] GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:47.840979 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:47.844923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-fcd5a083-d6af-42b5-b0a5-65ef9979b3cf tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c4c8af0>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:47.855590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=4 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:47.876810 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-fcd5a083-d6af-42b5-b0a5-65ef9979b3cf tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 200 len: 286 microversion: 2.1 time: 0.037049 Jul 25 20:07:47.877382 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1747/3347] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:47 2022] GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:48.886158 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:48.891298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-72855906-b8cb-4802-bda9-85eb1795f7d9 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb08532790>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:48.921566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-72855906-b8cb-4802-bda9-85eb1795f7d9 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 200 len: 286 microversion: 2.1 time: 0.036567 Jul 25 20:07:48.922130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1601/3348] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:48 2022] GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:49.934569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e1741de7-5928-4c9c-a5fe-fe921e30f5f5 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feafb57b940>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:49.966874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e1741de7-5928-4c9c-a5fe-fe921e30f5f5 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 200 len: 286 microversion: 2.1 time: 0.036602 Jul 25 20:07:49.967485 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1748/3349] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:49 2022] GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:50.984803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e8d5655-c311-44ac-b5fb-9e18f9c00d45 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c413b80>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:50.991033 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:51.018518 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e8d5655-c311-44ac-b5fb-9e18f9c00d45 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 200 len: 286 microversion: 2.1 time: 0.040594 Jul 25 20:07:51.019095 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1602/3350] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:50 2022] GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:07:52.032840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-86905b4c-7ae5-48b5-b22e-8a1a3f8a683b tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c46b670>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:52.062138 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-86905b4c-7ae5-48b5-b22e-8a1a3f8a683b tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 200 len: 287 microversion: 2.1 time: 0.033646 Jul 25 20:07:52.062721 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1749/3351] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:52 2022] GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:07:52.074803 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-215dbf38-223c-409e-8504-46f88d0c2011 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c281160>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:52.139950 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-215dbf38-223c-409e-8504-46f88d0c2011 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 202 len: 0 microversion: 2.1 time: 0.069669 Jul 25 20:07:52.144133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1603/3352] 10.222.0.18 () {58 vars in 1254 bytes} [Mon Jul 25 20:07:52 2022] DELETE /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:07:52.151292 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e62ea6ca-d760-439b-a385-5f41ae184c00 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feafb378790>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:52.188027 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e62ea6ca-d760-439b-a385-5f41ae184c00 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 200 len: 286 microversion: 2.1 time: 0.041580 Jul 25 20:07:52.188598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1750/3353] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:52 2022] GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:53.202710 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-65d60dd1-225c-47a2-abbb-db7057b52cd1 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c40fd30>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:53.228141 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-65d60dd1-225c-47a2-abbb-db7057b52cd1 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] HTTP exception thrown: Snapshot 7d200066-f89a-4ac7-8db8-89b22182c322 could not be found. Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-65d60dd1-225c-47a2-abbb-db7057b52cd1 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Request method failure captured: Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 HTTP/1.1 Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3vgPX6PfwbKK2C07akD_k_Noq4ytXBSBK9AvUz5YOOwSxMuLVpgFBlOwGSPAc5Njoc90LSsBpLgHkuAcsCOHzOWuDYIhkXaVd8SVVnimqqfyTm5svQDi7omF82I_GlGOk53gBbWGlrp5E-cFAz6qwvjE55_lnCrENLJaewi30AFt7Xk Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: d5748d52c41f4de1b9913d3cb1ffd134 Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:07:53.230320 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d5748d52c41f4de1b9913d3cb1ffd134", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: d5748d52c41f4de1b9913d3cb1ffd134 Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesSnapshotsTestJSON-541137030-project Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 38f31b382dea44dc9ae5041e70255082 Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesSnapshotsTestJSON-541137030-project Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Snapshot 7d200066-f89a-4ac7-8db8-89b22182c322 could not be found. Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '7d200066-f89a-4ac7-8db8-89b22182c322'} Jul 25 20:07:53.231679 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7d200066-f89a-4ac7-8db8-89b22182c322 could not be found. (HTTP 404) (Request-ID: req-2f9b7f95-f9a5-471c-98e8-d79f45a7e5a6) Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:53.232427 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:07:53.233476 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7d200066-f89a-4ac7-8db8-89b22182c322 could not be found. Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 20:07:53.234908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7d200066-f89a-4ac7-8db8-89b22182c322 could not be found. Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7d200066-f89a-4ac7-8db8-89b22182c322 could not be found. Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-65d60dd1-225c-47a2-abbb-db7057b52cd1 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Returning 404 to user: Snapshot 7d200066-f89a-4ac7-8db8-89b22182c322 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:53.236479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-65d60dd1-225c-47a2-abbb-db7057b52cd1 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322" status: 404 len: 111 microversion: 2.1 time: 0.034073 Jul 25 20:07:53.237288 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1604/3354] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:53 2022] GET /compute/v2.1/os-snapshots/7d200066-f89a-4ac7-8db8-89b22182c322 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:07:53.240931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b2d23750-bbf3-4da1-94f5-309e3defdadc tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feafb53ed30>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:53.310019 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b2d23750-bbf3-4da1-94f5-309e3defdadc tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb" status: 202 len: 0 microversion: 2.1 time: 0.073194 Jul 25 20:07:53.310596 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1751/3355] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Jul 25 20:07:53 2022] DELETE /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:07:53.320119 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-834ee92f-d632-48fd-859d-a9eb7b1db133 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c266b80>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:53.375449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-834ee92f-d632-48fd-859d-a9eb7b1db133 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb" status: 200 len: 345 microversion: 2.1 time: 0.059186 Jul 25 20:07:53.376046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1605/3356] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 20:07:53 2022] GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:54.391023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-437afb11-a77c-4d59-8955-34f431fd6b05 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c4c8430>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:54.419396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-437afb11-a77c-4d59-8955-34f431fd6b05 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] HTTP exception thrown: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-437afb11-a77c-4d59-8955-34f431fd6b05 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Request method failure captured: Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb HTTP/1.1 Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3vgPX6PfwbKK2C07akD_k_Noq4ytXBSBK9AvUz5YOOwSxMuLVpgFBlOwGSPAc5Njoc90LSsBpLgHkuAcsCOHzOWuDYIhkXaVd8SVVnimqqfyTm5svQDi7omF82I_GlGOk53gBbWGlrp5E-cFAz6qwvjE55_lnCrENLJaewi30AFt7Xk Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: d5748d52c41f4de1b9913d3cb1ffd134 Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:07:54.421402 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d5748d52c41f4de1b9913d3cb1ffd134", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: d5748d52c41f4de1b9913d3cb1ffd134 Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-VolumesSnapshotsTestJSON-541137030-project Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 38f31b382dea44dc9ae5041e70255082 Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-VolumesSnapshotsTestJSON-541137030-project Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '6495f373-0cc3-4b59-99a6-68999f62adfb'} Jul 25 20:07:54.422649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. (HTTP 404) (Request-ID: req-b10e5aa6-62ab-48c8-8f5e-31def7192f57) Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:54.423318 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:07:54.424587 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 20:07:54.425522 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-437afb11-a77c-4d59-8955-34f431fd6b05 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Returning 404 to user: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-437afb11-a77c-4d59-8955-34f431fd6b05 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb" status: 404 len: 109 microversion: 2.1 time: 0.036171 Jul 25 20:07:54.426458 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1752/3357] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 20:07:54 2022] GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:07:54.439458 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0841a29c-07a9-4291-ab5f-8f3aaaf15234 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c2813a0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:54.471004 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-0841a29c-07a9-4291-ab5f-8f3aaaf15234 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] HTTP exception thrown: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0841a29c-07a9-4291-ab5f-8f3aaaf15234 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Request method failure captured: Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb HTTP/1.1 Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3vgPX6PfwbKK2C07akD_k_Noq4ytXBSBK9AvUz5YOOwSxMuLVpgFBlOwGSPAc5Njoc90LSsBpLgHkuAcsCOHzOWuDYIhkXaVd8SVVnimqqfyTm5svQDi7omF82I_GlGOk53gBbWGlrp5E-cFAz6qwvjE55_lnCrENLJaewi30AFt7Xk Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: d5748d52c41f4de1b9913d3cb1ffd134 Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:07:54.472970 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d5748d52c41f4de1b9913d3cb1ffd134", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: d5748d52c41f4de1b9913d3cb1ffd134 Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesSnapshotsTestJSON-541137030-project Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 38f31b382dea44dc9ae5041e70255082 Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesSnapshotsTestJSON-541137030-project Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '6495f373-0cc3-4b59-99a6-68999f62adfb'} Jul 25 20:07:54.474588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. (HTTP 404) (Request-ID: req-93a7c963-7685-4e6f-a0f9-57fc8e499eb7) Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:54.475624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 20:07:54.476917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 20:07:54.479100 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0841a29c-07a9-4291-ab5f-8f3aaaf15234 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Returning 404 to user: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0841a29c-07a9-4291-ab5f-8f3aaaf15234 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb" status: 404 len: 109 microversion: 2.1 time: 0.040671 Jul 25 20:07:54.480570 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1606/3358] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Jul 25 20:07:54 2022] DELETE /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:07:54.486336 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d087ebaf-b38a-4b40-898a-766a0681d8a9 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Calling method '.version_select at 0x7feb0c4c8d30>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:54.518407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-d087ebaf-b38a-4b40-898a-766a0681d8a9 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] HTTP exception thrown: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d087ebaf-b38a-4b40-898a-766a0681d8a9 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Request method failure captured: Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb HTTP/1.1 Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3vgPX6PfwbKK2C07akD_k_Noq4ytXBSBK9AvUz5YOOwSxMuLVpgFBlOwGSPAc5Njoc90LSsBpLgHkuAcsCOHzOWuDYIhkXaVd8SVVnimqqfyTm5svQDi7omF82I_GlGOk53gBbWGlrp5E-cFAz6qwvjE55_lnCrENLJaewi30AFt7Xk Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: d5748d52c41f4de1b9913d3cb1ffd134 Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:07:54.520391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d5748d52c41f4de1b9913d3cb1ffd134"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d5748d52c41f4de1b9913d3cb1ffd134", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: d5748d52c41f4de1b9913d3cb1ffd134 Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-541137030 Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-VolumesSnapshotsTestJSON-541137030-project Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 38f31b382dea44dc9ae5041e70255082 Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-VolumesSnapshotsTestJSON-541137030-project Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '6495f373-0cc3-4b59-99a6-68999f62adfb'} Jul 25 20:07:54.521718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. (HTTP 404) (Request-ID: req-0f4ab3b9-44ac-4704-bf58-a797c4fd70a1) Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:54.522547 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:07:54.523726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 20:07:54.525590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d087ebaf-b38a-4b40-898a-766a0681d8a9 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] Returning 404 to user: Volume 6495f373-0cc3-4b59-99a6-68999f62adfb could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d087ebaf-b38a-4b40-898a-766a0681d8a9 tempest-VolumesSnapshotsTestJSON-541137030 tempest-VolumesSnapshotsTestJSON-541137030-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb" status: 404 len: 109 microversion: 2.1 time: 0.042075 Jul 25 20:07:54.526807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1753/3359] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Jul 25 20:07:54 2022] GET /compute/v2.1/os-volumes/6495f373-0cc3-4b59-99a6-68999f62adfb => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:08:00.612463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-305656418", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-546487680", "security_groups": [{"name": "tempest-secgroup-smoke-510731765"}], "block_device_mapping_v2": [{"uuid": "76bd381e-7d4a-4a9a-a08b-d87ebbc5c3a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4eb3ae9-2585-4fd6-b637-ba4a75a64672"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:00.737234 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] validate_networks() for [('a4eb3ae9-2585-4fd6-b637-ba4a75a64672', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:08:01.253500 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:08:01.253925 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:08:01.254457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:08:01.254885 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:08:01.255270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:08:01.265742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:01.266192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:01.266979 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:01.267436 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:01.285137 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Getting quotas for project b6986405c7974cc8bdf5d0c470926c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:01.289439 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Getting quotas for user 8143c33eabd74b1b9edc84e8ff155903 and project b6986405c7974cc8bdf5d0c470926c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:01.351762 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:08:01.354139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76bd381e-7d4a-4a9a-a08b-d87ebbc5c3a9',volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:08:01.499828 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15868c1a-241b-48e3-b94b-d32914210fca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.891765 Jul 25 20:08:01.500490 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1607/3360] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 20:08:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:08:01.513550 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c6eb648f-35f6-4758-bafb-750368aa19ae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:01.514157 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c6eb648f-35f6-4758-bafb-750368aa19ae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:01.594030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c6eb648f-35f6-4758-bafb-750368aa19ae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:01.602765 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c6eb648f-35f6-4758-bafb-750368aa19ae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1093 microversion: 2.1 time: 0.092829 Jul 25 20:08:01.604206 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1754/3361] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:01 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1093 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:02.626267 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-226a806c-a36d-476e-8f48-2862baa8656a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:02.626877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-226a806c-a36d-476e-8f48-2862baa8656a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:02.633182 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-226a806c-a36d-476e-8f48-2862baa8656a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:02.633628 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-226a806c-a36d-476e-8f48-2862baa8656a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:02.634765 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-226a806c-a36d-476e-8f48-2862baa8656a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:02.635237 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-226a806c-a36d-476e-8f48-2862baa8656a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:02.707015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-226a806c-a36d-476e-8f48-2862baa8656a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:02.715972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-226a806c-a36d-476e-8f48-2862baa8656a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1191 microversion: 2.1 time: 0.093929 Jul 25 20:08:02.723871 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1608/3362] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:02 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1191 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:03.738341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8f3c4d64-491b-413d-8a80-e680015d9a9f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:03.738961 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8f3c4d64-491b-413d-8a80-e680015d9a9f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:03.750230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f3c4d64-491b-413d-8a80-e680015d9a9f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:03.751377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f3c4d64-491b-413d-8a80-e680015d9a9f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:03.752391 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f3c4d64-491b-413d-8a80-e680015d9a9f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:03.752984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8f3c4d64-491b-413d-8a80-e680015d9a9f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:03.985772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8f3c4d64-491b-413d-8a80-e680015d9a9f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:04.001788 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8f3c4d64-491b-413d-8a80-e680015d9a9f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1276 microversion: 2.1 time: 0.268233 Jul 25 20:08:04.003250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1755/3363] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:03 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:04.855877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-2b5bb391-9051-476d-bb7d-e454c96d3ee8 req-e30e2605-936e-4866-9104-10b7f7ccc02f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "386cc182-5e6f-4f83-9789-9365b06c5ed7", "tag": "acfa2d23-b033-490c-afce-cdb1fcfac7d5"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:04.866741 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-2b5bb391-9051-476d-bb7d-e454c96d3ee8 req-e30e2605-936e-4866-9104-10b7f7ccc02f service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:04.867192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-2b5bb391-9051-476d-bb7d-e454c96d3ee8 req-e30e2605-936e-4866-9104-10b7f7ccc02f service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:04.888061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-2b5bb391-9051-476d-bb7d-e454c96d3ee8 req-e30e2605-936e-4866-9104-10b7f7ccc02f service nova] Creating event network-changed:acfa2d23-b033-490c-afce-cdb1fcfac7d5 for instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 on hv-cinder-85093 Jul 25 20:08:04.899107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-2b5bb391-9051-476d-bb7d-e454c96d3ee8 req-e30e2605-936e-4866-9104-10b7f7ccc02f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207860 Jul 25 20:08:04.899107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1609/3364] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:05.026568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0dfa655d-712e-4c6d-a24a-9925972642ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:05.027182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0dfa655d-712e-4c6d-a24a-9925972642ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:05.033885 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dfa655d-712e-4c6d-a24a-9925972642ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:05.034323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dfa655d-712e-4c6d-a24a-9925972642ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:05.035094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dfa655d-712e-4c6d-a24a-9925972642ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:05.035577 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0dfa655d-712e-4c6d-a24a-9925972642ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:05.269067 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0dfa655d-712e-4c6d-a24a-9925972642ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:05.283014 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0dfa655d-712e-4c6d-a24a-9925972642ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.258269 Jul 25 20:08:05.283755 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1756/3365] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:05 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:05.674535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:08:05.674856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 20:08:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:08:06.307666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2e6d9e72-8407-4e2e-8efc-b2a236ab8b4a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:06.308372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2e6d9e72-8407-4e2e-8efc-b2a236ab8b4a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:06.315111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e6d9e72-8407-4e2e-8efc-b2a236ab8b4a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.315488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e6d9e72-8407-4e2e-8efc-b2a236ab8b4a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.316282 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e6d9e72-8407-4e2e-8efc-b2a236ab8b4a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.316726 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e6d9e72-8407-4e2e-8efc-b2a236ab8b4a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.465830 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2e6d9e72-8407-4e2e-8efc-b2a236ab8b4a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:06.473922 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2e6d9e72-8407-4e2e-8efc-b2a236ab8b4a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.172170 Jul 25 20:08:06.474517 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1610/3366] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:06 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:07.498270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-7de6b94c-3475-455d-9aed-9e475e8c8cbc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:07.498877 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-7de6b94c-3475-455d-9aed-9e475e8c8cbc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:07.505638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7de6b94c-3475-455d-9aed-9e475e8c8cbc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:07.506073 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7de6b94c-3475-455d-9aed-9e475e8c8cbc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:07.506838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7de6b94c-3475-455d-9aed-9e475e8c8cbc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:07.507272 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-7de6b94c-3475-455d-9aed-9e475e8c8cbc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:07.671748 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-7de6b94c-3475-455d-9aed-9e475e8c8cbc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:07.679401 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-7de6b94c-3475-455d-9aed-9e475e8c8cbc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.185516 Jul 25 20:08:07.680028 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1757/3367] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:07 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:08.701622 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3622c235-9e1c-4d08-8b14-a0acbc89a440 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:08.702233 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3622c235-9e1c-4d08-8b14-a0acbc89a440 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:08.708956 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3622c235-9e1c-4d08-8b14-a0acbc89a440 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:08.709494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3622c235-9e1c-4d08-8b14-a0acbc89a440 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:08.710280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3622c235-9e1c-4d08-8b14-a0acbc89a440 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:08.710721 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3622c235-9e1c-4d08-8b14-a0acbc89a440 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:08.870410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3622c235-9e1c-4d08-8b14-a0acbc89a440 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:08.878025 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3622c235-9e1c-4d08-8b14-a0acbc89a440 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.180305 Jul 25 20:08:08.878597 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1611/3368] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:08 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:09.900807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5a3abe9c-4072-45f2-8465-22df0ae7e0d1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:09.901467 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5a3abe9c-4072-45f2-8465-22df0ae7e0d1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:09.908136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a3abe9c-4072-45f2-8465-22df0ae7e0d1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:09.908590 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a3abe9c-4072-45f2-8465-22df0ae7e0d1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:09.909376 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a3abe9c-4072-45f2-8465-22df0ae7e0d1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:09.909820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5a3abe9c-4072-45f2-8465-22df0ae7e0d1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:10.058449 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5a3abe9c-4072-45f2-8465-22df0ae7e0d1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:10.066471 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5a3abe9c-4072-45f2-8465-22df0ae7e0d1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.170410 Jul 25 20:08:10.066975 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1758/3369] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:09 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:11.088282 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d9d6da3c-5965-4814-9d28-6229f52f8840 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:11.088873 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d9d6da3c-5965-4814-9d28-6229f52f8840 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:11.095431 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d6da3c-5965-4814-9d28-6229f52f8840 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:11.095908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d6da3c-5965-4814-9d28-6229f52f8840 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:11.096705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d6da3c-5965-4814-9d28-6229f52f8840 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:11.097140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d6da3c-5965-4814-9d28-6229f52f8840 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:11.243361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d9d6da3c-5965-4814-9d28-6229f52f8840 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:11.253086 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d9d6da3c-5965-4814-9d28-6229f52f8840 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.169010 Jul 25 20:08:11.254012 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1612/3370] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:11 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:12.278516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b40029e9-54ab-439e-bf7e-8ba35e5d56bc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:12.279120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b40029e9-54ab-439e-bf7e-8ba35e5d56bc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:12.281691 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:12.287427 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b40029e9-54ab-439e-bf7e-8ba35e5d56bc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:12.287904 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b40029e9-54ab-439e-bf7e-8ba35e5d56bc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:12.288690 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b40029e9-54ab-439e-bf7e-8ba35e5d56bc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:12.289117 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b40029e9-54ab-439e-bf7e-8ba35e5d56bc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:12.441646 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b40029e9-54ab-439e-bf7e-8ba35e5d56bc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:12.449445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b40029e9-54ab-439e-bf7e-8ba35e5d56bc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.178418 Jul 25 20:08:12.450030 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1759/3371] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:12 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:13.470831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a3b10084-63fa-4ec5-a7ef-6e5052a71cb9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:13.471410 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a3b10084-63fa-4ec5-a7ef-6e5052a71cb9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:13.473397 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:13.474272 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:13.481198 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3b10084-63fa-4ec5-a7ef-6e5052a71cb9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:13.481646 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3b10084-63fa-4ec5-a7ef-6e5052a71cb9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:13.482417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3b10084-63fa-4ec5-a7ef-6e5052a71cb9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:13.482875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3b10084-63fa-4ec5-a7ef-6e5052a71cb9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:13.645556 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a3b10084-63fa-4ec5-a7ef-6e5052a71cb9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:13.654477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a3b10084-63fa-4ec5-a7ef-6e5052a71cb9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.187562 Jul 25 20:08:13.655055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1613/3372] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:13 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:14.674906 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df1ec004-f2ed-4862-9f17-c277f980c1b5 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:14.675538 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df1ec004-f2ed-4862-9f17-c277f980c1b5 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:14.682617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df1ec004-f2ed-4862-9f17-c277f980c1b5 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:14.683070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df1ec004-f2ed-4862-9f17-c277f980c1b5 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:14.683884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df1ec004-f2ed-4862-9f17-c277f980c1b5 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:14.684349 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df1ec004-f2ed-4862-9f17-c277f980c1b5 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:14.820340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df1ec004-f2ed-4862-9f17-c277f980c1b5 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:14.828687 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df1ec004-f2ed-4862-9f17-c277f980c1b5 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.157625 Jul 25 20:08:14.829286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1760/3373] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:14 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:15.849134 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9194f757-1045-4faf-8faa-8b266ff8a82b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:15.849767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9194f757-1045-4faf-8faa-8b266ff8a82b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:15.857387 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9194f757-1045-4faf-8faa-8b266ff8a82b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:15.857872 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9194f757-1045-4faf-8faa-8b266ff8a82b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:15.858671 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9194f757-1045-4faf-8faa-8b266ff8a82b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:15.859206 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9194f757-1045-4faf-8faa-8b266ff8a82b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:16.005857 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9194f757-1045-4faf-8faa-8b266ff8a82b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:16.013666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9194f757-1045-4faf-8faa-8b266ff8a82b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.168329 Jul 25 20:08:16.014235 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1614/3374] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:15 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:16.692270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-af4c6bef-dea2-4291-a640-fc672cd5592e req-20bf73ef-5c44-4966-80ff-874ab14b0647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386cc182-5e6f-4f83-9789-9365b06c5ed7", "name": "network-vif-plugged", "status": "completed", "tag": "acfa2d23-b033-490c-afce-cdb1fcfac7d5"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:16.702605 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-af4c6bef-dea2-4291-a640-fc672cd5592e req-20bf73ef-5c44-4966-80ff-874ab14b0647 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:16.703142 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-af4c6bef-dea2-4291-a640-fc672cd5592e req-20bf73ef-5c44-4966-80ff-874ab14b0647 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:16.714545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-af4c6bef-dea2-4291-a640-fc672cd5592e req-20bf73ef-5c44-4966-80ff-874ab14b0647 service nova] Creating event network-vif-plugged:acfa2d23-b033-490c-afce-cdb1fcfac7d5 for instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 on hv-cinder-85093 Jul 25 20:08:16.719830 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-af4c6bef-dea2-4291-a640-fc672cd5592e req-20bf73ef-5c44-4966-80ff-874ab14b0647 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096430 Jul 25 20:08:16.720418 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1761/3375] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:17.034343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fa5408ec-4138-4cb7-bcbb-8b3bb3101cb1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:17.035040 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa5408ec-4138-4cb7-bcbb-8b3bb3101cb1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:17.042816 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa5408ec-4138-4cb7-bcbb-8b3bb3101cb1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:17.043178 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa5408ec-4138-4cb7-bcbb-8b3bb3101cb1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:17.043971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa5408ec-4138-4cb7-bcbb-8b3bb3101cb1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:17.044399 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa5408ec-4138-4cb7-bcbb-8b3bb3101cb1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:17.208599 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa5408ec-4138-4cb7-bcbb-8b3bb3101cb1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:17.216403 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fa5408ec-4138-4cb7-bcbb-8b3bb3101cb1 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.186036 Jul 25 20:08:17.216977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1615/3376] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:17 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:18.237987 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-cf707cdb-daee-4e59-a5e4-9977f20c7442 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:18.238676 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-cf707cdb-daee-4e59-a5e4-9977f20c7442 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:18.245702 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf707cdb-daee-4e59-a5e4-9977f20c7442 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:18.246151 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf707cdb-daee-4e59-a5e4-9977f20c7442 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:18.246923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf707cdb-daee-4e59-a5e4-9977f20c7442 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:18.247362 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-cf707cdb-daee-4e59-a5e4-9977f20c7442 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:18.393858 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-cf707cdb-daee-4e59-a5e4-9977f20c7442 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:18.403217 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-cf707cdb-daee-4e59-a5e4-9977f20c7442 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1264 microversion: 2.1 time: 0.169831 Jul 25 20:08:18.403839 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1762/3377] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:18 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:19.425217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f34b41ed-2cb1-407e-81b0-e31a4cfa9af6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:19.425739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f34b41ed-2cb1-407e-81b0-e31a4cfa9af6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:19.433740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f34b41ed-2cb1-407e-81b0-e31a4cfa9af6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:19.434188 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f34b41ed-2cb1-407e-81b0-e31a4cfa9af6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:19.434981 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f34b41ed-2cb1-407e-81b0-e31a4cfa9af6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:19.435453 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f34b41ed-2cb1-407e-81b0-e31a4cfa9af6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:19.571115 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f34b41ed-2cb1-407e-81b0-e31a4cfa9af6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:19.578902 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f34b41ed-2cb1-407e-81b0-e31a4cfa9af6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1450 microversion: 2.1 time: 0.157858 Jul 25 20:08:19.579600 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1616/3378] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:19 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:19.600299 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5d83dfed-5d91-4e04-b24a-94b1a0e38718 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:19.600912 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5d83dfed-5d91-4e04-b24a-94b1a0e38718 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:19.608183 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d83dfed-5d91-4e04-b24a-94b1a0e38718 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:19.608629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d83dfed-5d91-4e04-b24a-94b1a0e38718 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:19.609404 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d83dfed-5d91-4e04-b24a-94b1a0e38718 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:19.609840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5d83dfed-5d91-4e04-b24a-94b1a0e38718 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:19.751261 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5d83dfed-5d91-4e04-b24a-94b1a0e38718 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:19.759503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5d83dfed-5d91-4e04-b24a-94b1a0e38718 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1450 microversion: 2.1 time: 0.163040 Jul 25 20:08:19.760108 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1763/3379] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:19 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:21.830177 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-93c66cd4-33fd-445c-9725-409938a6c98d req-9e94cd62-0947-4083-ac24-16a2277fff4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "386cc182-5e6f-4f83-9789-9365b06c5ed7", "tag": "acfa2d23-b033-490c-afce-cdb1fcfac7d5"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:21.835061 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:21.842818 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-93c66cd4-33fd-445c-9725-409938a6c98d req-9e94cd62-0947-4083-ac24-16a2277fff4f service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:21.843262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-93c66cd4-33fd-445c-9725-409938a6c98d req-9e94cd62-0947-4083-ac24-16a2277fff4f service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:21.856545 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-93c66cd4-33fd-445c-9725-409938a6c98d req-9e94cd62-0947-4083-ac24-16a2277fff4f service nova] Creating event network-changed:acfa2d23-b033-490c-afce-cdb1fcfac7d5 for instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 on hv-cinder-85093 Jul 25 20:08:21.861927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-93c66cd4-33fd-445c-9725-409938a6c98d req-9e94cd62-0947-4083-ac24-16a2277fff4f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094639 Jul 25 20:08:21.862538 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1617/3380] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:36.413876 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-760630840", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "networks": [{"uuid": "4faede6a-68c7-431b-90ec-5d2c5511db7b"}]}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:36.423293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=22 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:36.423840 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=50 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:36.483270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] validate_networks() for [('4faede6a-68c7-431b-90ec-5d2c5511db7b', None, None, None, None, None)] {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:08:36.892335 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:08:36.892762 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:08:36.893237 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:08:36.893653 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:08:36.894093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:08:36.903062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:36.903503 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:36.904334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:36.904777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:36.924907 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Getting quotas for project 6ca50c708922486a910456429af51e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:36.928991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Getting quotas for user 64c8111203d34490a0db95a739f73e0b and project 6ca50c708922486a910456429af51e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:36.942751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:08:36.945043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:08:36.993968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR oslo.messaging._drivers.impl_rabbit [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [58a9b0c3-51ec-4ea8-a707-b5d877cced8f] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 20:08:38.002300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [58a9b0c3-51ec-4ea8-a707-b5d877cced8f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 47716. Jul 25 20:08:38.006670 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-be7ed38f-43a7-4322-a6b2-330b26d9797d tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596783 Jul 25 20:08:38.007617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1764/3381] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 20:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:08:38.019333 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0a19b2e-75f6-4a03-b7d7-7db6e3ecf845 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:38.020259 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d0a19b2e-75f6-4a03-b7d7-7db6e3ecf845 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:38.023139 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d35c92ce-7a84-44f2-85ce-cd5b7bb5d873] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 20:08:38.024629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=54 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:38.079207 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d0a19b2e-75f6-4a03-b7d7-7db6e3ecf845 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:38.087596 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d0a19b2e-75f6-4a03-b7d7-7db6e3ecf845 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1213 microversion: 2.1 time: 0.071206 Jul 25 20:08:38.088283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1618/3382] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:38 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:39.109673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c9464116-50c1-4d57-9ae6-3adc245a1b91 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:39.110411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c9464116-50c1-4d57-9ae6-3adc245a1b91 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:39.117395 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9464116-50c1-4d57-9ae6-3adc245a1b91 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:39.118348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9464116-50c1-4d57-9ae6-3adc245a1b91 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:39.119954 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9464116-50c1-4d57-9ae6-3adc245a1b91 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:39.120396 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c9464116-50c1-4d57-9ae6-3adc245a1b91 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:39.193820 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c9464116-50c1-4d57-9ae6-3adc245a1b91 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:39.201636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c9464116-50c1-4d57-9ae6-3adc245a1b91 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1265 microversion: 2.1 time: 0.096502 Jul 25 20:08:39.203055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1765/3383] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:39 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:40.224067 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c3f391bb-53d8-49ee-9a8b-ce178841a201 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:40.224800 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c3f391bb-53d8-49ee-9a8b-ce178841a201 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:40.235307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3f391bb-53d8-49ee-9a8b-ce178841a201 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:40.236166 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3f391bb-53d8-49ee-9a8b-ce178841a201 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:40.237495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3f391bb-53d8-49ee-9a8b-ce178841a201 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:40.238585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3f391bb-53d8-49ee-9a8b-ce178841a201 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:40.269408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] [d35c92ce-7a84-44f2-85ce-cd5b7bb5d873] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 47736. Jul 25 20:08:40.478801 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c3f391bb-53d8-49ee-9a8b-ce178841a201 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:40.486306 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c3f391bb-53d8-49ee-9a8b-ce178841a201 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1313 microversion: 2.1 time: 0.266423 Jul 25 20:08:40.486878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1619/3384] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:40 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:40.709745 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-3d2a6800-ac0a-47e5-9102-9258652aa1b5 req-98dec958-7ece-4bd0-99f2-428cfd29662d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98be93b1-5d8d-4ab6-9bf7-d942f4a71b29", "tag": "0a1e4e00-899f-4b62-bee2-e442a9fc3776"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:40.723446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-3d2a6800-ac0a-47e5-9102-9258652aa1b5 req-98dec958-7ece-4bd0-99f2-428cfd29662d service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:40.723916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-3d2a6800-ac0a-47e5-9102-9258652aa1b5 req-98dec958-7ece-4bd0-99f2-428cfd29662d service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:40.736501 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-3d2a6800-ac0a-47e5-9102-9258652aa1b5 req-98dec958-7ece-4bd0-99f2-428cfd29662d service nova] Creating event network-changed:0a1e4e00-899f-4b62-bee2-e442a9fc3776 for instance 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 on hv-cinder-85093 Jul 25 20:08:40.741874 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-3d2a6800-ac0a-47e5-9102-9258652aa1b5 req-98dec958-7ece-4bd0-99f2-428cfd29662d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037108 Jul 25 20:08:40.743413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1766/3385] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:41.508863 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-86779b93-1216-4279-a939-327c64b45ce1 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:41.509477 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-86779b93-1216-4279-a939-327c64b45ce1 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:41.516011 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86779b93-1216-4279-a939-327c64b45ce1 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:41.516456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86779b93-1216-4279-a939-327c64b45ce1 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:41.517208 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86779b93-1216-4279-a939-327c64b45ce1 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:41.517641 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86779b93-1216-4279-a939-327c64b45ce1 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:41.657839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-86779b93-1216-4279-a939-327c64b45ce1 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:41.665336 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-86779b93-1216-4279-a939-327c64b45ce1 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1313 microversion: 2.1 time: 0.160941 Jul 25 20:08:41.665909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1620/3386] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:41 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:42.687039 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8e51ca27-41f4-4638-aab3-4c5dc7208f5a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:42.687773 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8e51ca27-41f4-4638-aab3-4c5dc7208f5a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:42.694947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e51ca27-41f4-4638-aab3-4c5dc7208f5a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:42.695048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e51ca27-41f4-4638-aab3-4c5dc7208f5a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:42.696665 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e51ca27-41f4-4638-aab3-4c5dc7208f5a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:42.697250 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8e51ca27-41f4-4638-aab3-4c5dc7208f5a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:42.882880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8e51ca27-41f4-4638-aab3-4c5dc7208f5a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:42.892182 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8e51ca27-41f4-4638-aab3-4c5dc7208f5a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1313 microversion: 2.1 time: 0.209430 Jul 25 20:08:42.892720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1767/3387] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:42 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:43.912666 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-561a5469-d145-4ce5-8382-ffa70b5e286e tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:43.913293 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-561a5469-d145-4ce5-8382-ffa70b5e286e tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:43.920524 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-561a5469-d145-4ce5-8382-ffa70b5e286e tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:43.920978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-561a5469-d145-4ce5-8382-ffa70b5e286e tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:43.921750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-561a5469-d145-4ce5-8382-ffa70b5e286e tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:43.922184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-561a5469-d145-4ce5-8382-ffa70b5e286e tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:44.064691 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-561a5469-d145-4ce5-8382-ffa70b5e286e tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:44.074651 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-561a5469-d145-4ce5-8382-ffa70b5e286e tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1313 microversion: 2.1 time: 0.165802 Jul 25 20:08:44.075242 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1621/3388] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:43 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:45.097598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0b8edde8-fa49-4332-bdfe-749e6920f990 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:45.098204 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0b8edde8-fa49-4332-bdfe-749e6920f990 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:45.105568 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b8edde8-fa49-4332-bdfe-749e6920f990 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:45.106013 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b8edde8-fa49-4332-bdfe-749e6920f990 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.106790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b8edde8-fa49-4332-bdfe-749e6920f990 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:45.107229 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0b8edde8-fa49-4332-bdfe-749e6920f990 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.253741 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0b8edde8-fa49-4332-bdfe-749e6920f990 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:45.262244 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0b8edde8-fa49-4332-bdfe-749e6920f990 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1313 microversion: 2.1 time: 0.168386 Jul 25 20:08:45.263327 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1768/3389] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:45 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:46.284442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ca3a092d-f817-4d01-9514-51cdff056236 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:46.285042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ca3a092d-f817-4d01-9514-51cdff056236 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:46.292604 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca3a092d-f817-4d01-9514-51cdff056236 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:46.293046 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca3a092d-f817-4d01-9514-51cdff056236 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:46.293849 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca3a092d-f817-4d01-9514-51cdff056236 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:46.294282 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca3a092d-f817-4d01-9514-51cdff056236 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:46.444000 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ca3a092d-f817-4d01-9514-51cdff056236 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:46.455463 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ca3a092d-f817-4d01-9514-51cdff056236 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1313 microversion: 2.1 time: 0.174443 Jul 25 20:08:46.456088 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1622/3390] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:46 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:46.837190 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-fd86f642-52e2-448f-8cbf-d2189d7674d3 req-a905b443-96de-417b-a4fc-5b9752b934e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98be93b1-5d8d-4ab6-9bf7-d942f4a71b29", "name": "network-vif-plugged", "status": "completed", "tag": "0a1e4e00-899f-4b62-bee2-e442a9fc3776"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:46.848600 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-fd86f642-52e2-448f-8cbf-d2189d7674d3 req-a905b443-96de-417b-a4fc-5b9752b934e5 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:46.849077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-fd86f642-52e2-448f-8cbf-d2189d7674d3 req-a905b443-96de-417b-a4fc-5b9752b934e5 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:46.863315 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-fd86f642-52e2-448f-8cbf-d2189d7674d3 req-a905b443-96de-417b-a4fc-5b9752b934e5 service nova] Creating event network-vif-plugged:0a1e4e00-899f-4b62-bee2-e442a9fc3776 for instance 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 on hv-cinder-85093 Jul 25 20:08:46.869720 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-fd86f642-52e2-448f-8cbf-d2189d7674d3 req-a905b443-96de-417b-a4fc-5b9752b934e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036812 Jul 25 20:08:46.870356 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1769/3391] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:08:47.478815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8519f097-9850-49d1-acd3-70554856519b tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:47.479634 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8519f097-9850-49d1-acd3-70554856519b tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:47.486579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8519f097-9850-49d1-acd3-70554856519b tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:47.487018 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8519f097-9850-49d1-acd3-70554856519b tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:47.487826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8519f097-9850-49d1-acd3-70554856519b tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:47.488261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8519f097-9850-49d1-acd3-70554856519b tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:47.647573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8519f097-9850-49d1-acd3-70554856519b tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:47.655494 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8519f097-9850-49d1-acd3-70554856519b tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1313 microversion: 2.1 time: 0.181751 Jul 25 20:08:47.656125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1623/3392] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:47 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:48.673370 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:48.674512 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=6 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:48.680203 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3b5faf12-e75b-4d96-aa9a-afea3a89a5c7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:48.680997 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3b5faf12-e75b-4d96-aa9a-afea3a89a5c7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:48.688149 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b5faf12-e75b-4d96-aa9a-afea3a89a5c7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:48.688589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b5faf12-e75b-4d96-aa9a-afea3a89a5c7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:48.689355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b5faf12-e75b-4d96-aa9a-afea3a89a5c7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:48.689785 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3b5faf12-e75b-4d96-aa9a-afea3a89a5c7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:48.833617 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-3b5faf12-e75b-4d96-aa9a-afea3a89a5c7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:48.842124 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3b5faf12-e75b-4d96-aa9a-afea3a89a5c7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1496 microversion: 2.1 time: 0.169932 Jul 25 20:08:48.842699 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1770/3393] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:48 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1496 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:49.500737 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aff16246-ff71-4240-96c4-1b681baf55ff tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:49.501384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aff16246-ff71-4240-96c4-1b681baf55ff tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:49.503142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:49.509081 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aff16246-ff71-4240-96c4-1b681baf55ff tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:49.509532 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aff16246-ff71-4240-96c4-1b681baf55ff tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:49.510304 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aff16246-ff71-4240-96c4-1b681baf55ff tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:49.510742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aff16246-ff71-4240-96c4-1b681baf55ff tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:49.536802 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aff16246-ff71-4240-96c4-1b681baf55ff tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:08:49.615348 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aff16246-ff71-4240-96c4-1b681baf55ff tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "DELETE /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 204 len: 0 microversion: 2.1 time: 0.118191 Jul 25 20:08:49.615963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1624/3394] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:08:49 2022] DELETE /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:08:49.625344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e23e636b-b03a-4db8-88b9-5f857e0dd87a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:49.626120 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e23e636b-b03a-4db8-88b9-5f857e0dd87a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:49.632629 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e23e636b-b03a-4db8-88b9-5f857e0dd87a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:49.633279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e23e636b-b03a-4db8-88b9-5f857e0dd87a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:49.634578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e23e636b-b03a-4db8-88b9-5f857e0dd87a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:49.635317 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e23e636b-b03a-4db8-88b9-5f857e0dd87a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:49.780892 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e23e636b-b03a-4db8-88b9-5f857e0dd87a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:49.788616 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e23e636b-b03a-4db8-88b9-5f857e0dd87a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1502 microversion: 2.1 time: 0.167215 Jul 25 20:08:49.789233 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1771/3395] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:49 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:50.811842 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f8250c6-0dcc-4c7c-bd69-9e0915c7b35a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:50.812661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8f8250c6-0dcc-4c7c-bd69-9e0915c7b35a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:50.819841 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8250c6-0dcc-4c7c-bd69-9e0915c7b35a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:50.820899 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8250c6-0dcc-4c7c-bd69-9e0915c7b35a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:50.822133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8250c6-0dcc-4c7c-bd69-9e0915c7b35a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:50.822580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8250c6-0dcc-4c7c-bd69-9e0915c7b35a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:50.972822 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f8250c6-0dcc-4c7c-bd69-9e0915c7b35a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:50.981593 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8f8250c6-0dcc-4c7c-bd69-9e0915c7b35a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1502 microversion: 2.1 time: 0.174294 Jul 25 20:08:50.982192 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1625/3396] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:50 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:52.003241 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e763dffa-e5d2-41cf-9baf-f07b42724df2 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:52.003856 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e763dffa-e5d2-41cf-9baf-f07b42724df2 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:52.011208 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e763dffa-e5d2-41cf-9baf-f07b42724df2 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:52.011703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e763dffa-e5d2-41cf-9baf-f07b42724df2 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:52.012494 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e763dffa-e5d2-41cf-9baf-f07b42724df2 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:52.013042 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e763dffa-e5d2-41cf-9baf-f07b42724df2 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:52.185319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e763dffa-e5d2-41cf-9baf-f07b42724df2 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:52.192868 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e763dffa-e5d2-41cf-9baf-f07b42724df2 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1502 microversion: 2.1 time: 0.193550 Jul 25 20:08:52.193444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1772/3397] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:51 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:52.669713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-43487c5a-a1df-4f30-a91c-ccd8a45cdb04 req-4b837b31-88e0-4d7b-9b14-801872104220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98be93b1-5d8d-4ab6-9bf7-d942f4a71b29", "name": "network-vif-deleted", "tag": "0a1e4e00-899f-4b62-bee2-e442a9fc3776"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:52.680562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-43487c5a-a1df-4f30-a91c-ccd8a45cdb04 req-4b837b31-88e0-4d7b-9b14-801872104220 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:52.681010 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-43487c5a-a1df-4f30-a91c-ccd8a45cdb04 req-4b837b31-88e0-4d7b-9b14-801872104220 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:52.692329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-43487c5a-a1df-4f30-a91c-ccd8a45cdb04 req-4b837b31-88e0-4d7b-9b14-801872104220 service nova] Creating event network-vif-deleted:0a1e4e00-899f-4b62-bee2-e442a9fc3776 for instance 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 on hv-cinder-85093 Jul 25 20:08:52.697335 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-43487c5a-a1df-4f30-a91c-ccd8a45cdb04 req-4b837b31-88e0-4d7b-9b14-801872104220 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031235 Jul 25 20:08:52.697946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1626/3398] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:53.215746 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:53.216330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:53.222949 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:53.223443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:53.224435 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:53.224870 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:53.259070 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:53.259549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:53.259991 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lazy-loading 'fault' on Instance uuid 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:08:53.303103 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:53.311277 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-36eba745-8942-45eb-b474-9136f181dfc6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 200 len: 1303 microversion: 2.1 time: 0.100078 Jul 25 20:08:53.311879 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1773/3399] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:53 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:54.333901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0950f5c7-5979-476e-89f6-fefc99b1505a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:54.334512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0950f5c7-5979-476e-89f6-fefc99b1505a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:54.341644 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0950f5c7-5979-476e-89f6-fefc99b1505a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:54.342096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0950f5c7-5979-476e-89f6-fefc99b1505a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:54.342906 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0950f5c7-5979-476e-89f6-fefc99b1505a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:54.343350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0950f5c7-5979-476e-89f6-fefc99b1505a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:54.357147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-0950f5c7-5979-476e-89f6-fefc99b1505a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] HTTP exception thrown: Instance 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 could not be found. Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0950f5c7-5979-476e-89f6-fefc99b1505a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Request method failure captured: Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 HTTP/1.1 Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3vhCAP731g1IQgcjchr9fpA8gvDkNG58zpGnlSuW_7Lm4UpPdEPF-MjmtovF4d9xHuZE6vkEMuQVFj89vGIeRQ37wupFe5dI6_c8NNU8w41aks-t9Rw7Vp9su-pzC1P5RoyexebB2T2TGOTcdz7hSAGQDpERrK8FJT5zY5SLjEDtPBU Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 6ca50c708922486a910456429af51e2e Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesActionsTest-2058395115 Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:08:54.358767 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ca50c708922486a910456429af51e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6ca50c708922486a910456429af51e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ca50c708922486a910456429af51e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6ca50c708922486a910456429af51e2e", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesActionsTest-2058395115 Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 6ca50c708922486a910456429af51e2e Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesActionsTest-2058395115 Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesActionsTest-2058395115-project Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 64c8111203d34490a0db95a739f73e0b Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesActionsTest-2058395115-project Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 could not be found. Jul 25 20:08:54.360343 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '98be93b1-5d8d-4ab6-9bf7-d942f4a71b29'} Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 could not be found. Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:08:54.361217 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 could not be found. Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 could not be found. Jul 25 20:08:54.362394 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:08:54.363353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0950f5c7-5979-476e-89f6-fefc99b1505a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Returning 404 to user: Instance 98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:08:54.363353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0950f5c7-5979-476e-89f6-fefc99b1505a tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29" status: 404 len: 111 microversion: 2.1 time: 0.031034 Jul 25 20:08:54.363353 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1627/3400] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:54 2022] GET /compute/v2.1/servers/98be93b1-5d8d-4ab6-9bf7-d942f4a71b29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:08:54.412167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1037168233", "imageRef": "912c2bde-be78-4e31-bcc8-11427c9fc29e", "flavorRef": "452", "networks": [{"uuid": "4faede6a-68c7-431b-90ec-5d2c5511db7b"}]}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:54.465176 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] validate_networks() for [('4faede6a-68c7-431b-90ec-5d2c5511db7b', None, None, None, None, None)] {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:08:54.822560 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:08:54.822978 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:08:54.823454 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:08:54.823880 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:08:54.824286 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:08:54.832886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:54.833330 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:54.834116 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:54.834546 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:54.851145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Getting quotas for project 6ca50c708922486a910456429af51e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:54.855667 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Getting quotas for user 64c8111203d34490a0db95a739f73e0b and project 6ca50c708922486a910456429af51e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:54.866564 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:08:54.870245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='912c2bde-be78-4e31-bcc8-11427c9fc29e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:08:54.914673 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b9b107cb-f816-49ec-a6d3-a263a78a2443 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505754 Jul 25 20:08:54.915321 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1774/3401] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 20:08:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:08:54.925835 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a73445f-13c7-42bb-9db5-5284bd448150 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:54.926444 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a73445f-13c7-42bb-9db5-5284bd448150 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:54.983105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a73445f-13c7-42bb-9db5-5284bd448150 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:54.989983 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a73445f-13c7-42bb-9db5-5284bd448150 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1214 microversion: 2.1 time: 0.067887 Jul 25 20:08:54.990562 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1628/3402] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:54 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:56.012005 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9ff59ba9-d97e-4d1b-9307-47adc8805e64 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:56.012614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9ff59ba9-d97e-4d1b-9307-47adc8805e64 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:56.018803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ff59ba9-d97e-4d1b-9307-47adc8805e64 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:56.019256 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ff59ba9-d97e-4d1b-9307-47adc8805e64 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:56.020259 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ff59ba9-d97e-4d1b-9307-47adc8805e64 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:56.020696 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9ff59ba9-d97e-4d1b-9307-47adc8805e64 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:56.089245 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9ff59ba9-d97e-4d1b-9307-47adc8805e64 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:56.096963 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9ff59ba9-d97e-4d1b-9307-47adc8805e64 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1266 microversion: 2.1 time: 0.090318 Jul 25 20:08:56.097530 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1775/3403] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:56 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:57.119325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9cc39bfa-dd97-43ed-8966-fd2cdb451f81 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:57.119968 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9cc39bfa-dd97-43ed-8966-fd2cdb451f81 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:57.127927 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cc39bfa-dd97-43ed-8966-fd2cdb451f81 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.128283 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cc39bfa-dd97-43ed-8966-fd2cdb451f81 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.129065 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cc39bfa-dd97-43ed-8966-fd2cdb451f81 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.129498 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cc39bfa-dd97-43ed-8966-fd2cdb451f81 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.477621 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9cc39bfa-dd97-43ed-8966-fd2cdb451f81 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:57.491957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9cc39bfa-dd97-43ed-8966-fd2cdb451f81 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1314 microversion: 2.1 time: 0.370910 Jul 25 20:08:57.492778 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1629/3404] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:57 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:57.856804 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-43fd301b-85e8-401a-b383-04a187aaeee1 req-e5504677-2198-49e0-82d7-4b9d2ebf853b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a27e174b-cd6d-490b-9ae9-3080715ebc1b", "tag": "5472579e-6bf7-43fa-8440-ac390d6c7fb9"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:57.867128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-43fd301b-85e8-401a-b383-04a187aaeee1 req-e5504677-2198-49e0-82d7-4b9d2ebf853b service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.868474 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-43fd301b-85e8-401a-b383-04a187aaeee1 req-e5504677-2198-49e0-82d7-4b9d2ebf853b service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.882129 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-43fd301b-85e8-401a-b383-04a187aaeee1 req-e5504677-2198-49e0-82d7-4b9d2ebf853b service nova] Creating event network-changed:5472579e-6bf7-43fa-8440-ac390d6c7fb9 for instance a27e174b-cd6d-490b-9ae9-3080715ebc1b on hv-cinder-85093 Jul 25 20:08:57.887444 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-43fd301b-85e8-401a-b383-04a187aaeee1 req-e5504677-2198-49e0-82d7-4b9d2ebf853b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034558 Jul 25 20:08:57.888076 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1776/3405] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:58.514055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df67b5c6-a51e-4108-819c-86aec70453be tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:58.514605 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-df67b5c6-a51e-4108-819c-86aec70453be tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:58.520977 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df67b5c6-a51e-4108-819c-86aec70453be tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:58.521417 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df67b5c6-a51e-4108-819c-86aec70453be tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.522157 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df67b5c6-a51e-4108-819c-86aec70453be tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:58.522585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df67b5c6-a51e-4108-819c-86aec70453be tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.654754 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df67b5c6-a51e-4108-819c-86aec70453be tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:58.662179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df67b5c6-a51e-4108-819c-86aec70453be tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1314 microversion: 2.1 time: 0.151996 Jul 25 20:08:58.662739 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1630/3406] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:58 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:59.683680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-1261de74-fd8d-47e2-8166-492e5eb054bf tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:59.684390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-1261de74-fd8d-47e2-8166-492e5eb054bf tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:59.691389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1261de74-fd8d-47e2-8166-492e5eb054bf tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:59.691867 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1261de74-fd8d-47e2-8166-492e5eb054bf tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:59.692818 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1261de74-fd8d-47e2-8166-492e5eb054bf tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:59.693407 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-1261de74-fd8d-47e2-8166-492e5eb054bf tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:59.931703 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-1261de74-fd8d-47e2-8166-492e5eb054bf tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:59.939983 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-1261de74-fd8d-47e2-8166-492e5eb054bf tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1314 microversion: 2.1 time: 0.261269 Jul 25 20:08:59.940674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1777/3407] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:59 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:00.963264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-94d53115-124b-4fb9-add9-6c5b9ff1986c tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:00.964090 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-94d53115-124b-4fb9-add9-6c5b9ff1986c tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:00.973184 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94d53115-124b-4fb9-add9-6c5b9ff1986c tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:00.973635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94d53115-124b-4fb9-add9-6c5b9ff1986c tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:00.974566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94d53115-124b-4fb9-add9-6c5b9ff1986c tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:00.975015 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94d53115-124b-4fb9-add9-6c5b9ff1986c tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:01.109856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-94d53115-124b-4fb9-add9-6c5b9ff1986c tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:01.118555 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-94d53115-124b-4fb9-add9-6c5b9ff1986c tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1314 microversion: 2.1 time: 0.159099 Jul 25 20:09:01.119420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1631/3408] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:00 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:02.140066 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-e98e1a9b-741f-4717-a9be-3f04423d1c83 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:02.140674 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-e98e1a9b-741f-4717-a9be-3f04423d1c83 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:02.147428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e98e1a9b-741f-4717-a9be-3f04423d1c83 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:02.148048 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e98e1a9b-741f-4717-a9be-3f04423d1c83 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:02.148896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e98e1a9b-741f-4717-a9be-3f04423d1c83 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:02.149350 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-e98e1a9b-741f-4717-a9be-3f04423d1c83 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:02.283896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-e98e1a9b-741f-4717-a9be-3f04423d1c83 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:02.292211 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-e98e1a9b-741f-4717-a9be-3f04423d1c83 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1314 microversion: 2.1 time: 0.156005 Jul 25 20:09:02.292774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1778/3409] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:02 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:09:02.890125 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-e7ba485d-4b54-470f-bac9-77dd3cb14114 req-f5a0de5e-2e4c-454f-a3f6-5ff84009c636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27e174b-cd6d-490b-9ae9-3080715ebc1b", "name": "network-vif-plugged", "status": "completed", "tag": "5472579e-6bf7-43fa-8440-ac390d6c7fb9"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:02.901262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e7ba485d-4b54-470f-bac9-77dd3cb14114 req-f5a0de5e-2e4c-454f-a3f6-5ff84009c636 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:02.901713 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e7ba485d-4b54-470f-bac9-77dd3cb14114 req-f5a0de5e-2e4c-454f-a3f6-5ff84009c636 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:02.913080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-e7ba485d-4b54-470f-bac9-77dd3cb14114 req-f5a0de5e-2e4c-454f-a3f6-5ff84009c636 service nova] Creating event network-vif-plugged:5472579e-6bf7-43fa-8440-ac390d6c7fb9 for instance a27e174b-cd6d-490b-9ae9-3080715ebc1b on hv-cinder-85093 Jul 25 20:09:02.918991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-e7ba485d-4b54-470f-bac9-77dd3cb14114 req-f5a0de5e-2e4c-454f-a3f6-5ff84009c636 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032426 Jul 25 20:09:02.919705 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1632/3410] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:03.312776 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a8d46fb4-ef60-4e3f-9b5a-0c0a769ba202 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:03.313384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a8d46fb4-ef60-4e3f-9b5a-0c0a769ba202 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:03.319982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8d46fb4-ef60-4e3f-9b5a-0c0a769ba202 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:03.320422 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8d46fb4-ef60-4e3f-9b5a-0c0a769ba202 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:03.321797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8d46fb4-ef60-4e3f-9b5a-0c0a769ba202 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:03.322227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a8d46fb4-ef60-4e3f-9b5a-0c0a769ba202 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:03.460654 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a8d46fb4-ef60-4e3f-9b5a-0c0a769ba202 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:03.468584 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a8d46fb4-ef60-4e3f-9b5a-0c0a769ba202 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1314 microversion: 2.1 time: 0.159670 Jul 25 20:09:03.469143 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1779/3411] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:03 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:09:04.491107 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-599dc19a-25c9-469a-affb-832a0b18c336 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:04.491784 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-599dc19a-25c9-469a-affb-832a0b18c336 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:04.498695 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-599dc19a-25c9-469a-affb-832a0b18c336 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:04.499179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-599dc19a-25c9-469a-affb-832a0b18c336 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:04.500038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-599dc19a-25c9-469a-affb-832a0b18c336 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:04.500524 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-599dc19a-25c9-469a-affb-832a0b18c336 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:04.637460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-599dc19a-25c9-469a-affb-832a0b18c336 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:04.644975 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-599dc19a-25c9-469a-affb-832a0b18c336 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1314 microversion: 2.1 time: 0.158707 Jul 25 20:09:04.645535 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1633/3412] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:04 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:05.668016 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-34b3c8e7-a16e-4931-8604-a6fa33f547e6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:05.668625 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-34b3c8e7-a16e-4931-8604-a6fa33f547e6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:05.671050 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:05.671726 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=6 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:05.678172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34b3c8e7-a16e-4931-8604-a6fa33f547e6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:05.678623 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34b3c8e7-a16e-4931-8604-a6fa33f547e6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:05.679400 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34b3c8e7-a16e-4931-8604-a6fa33f547e6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:05.679869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-34b3c8e7-a16e-4931-8604-a6fa33f547e6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:05.815750 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-34b3c8e7-a16e-4931-8604-a6fa33f547e6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:05.823751 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-34b3c8e7-a16e-4931-8604-a6fa33f547e6 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1498 microversion: 2.1 time: 0.160555 Jul 25 20:09:05.824386 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1780/3413] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:05 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:06.455162 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-93785614-f4b3-48a5-8ca9-0b52fd8c9bb0 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:06.455688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93785614-f4b3-48a5-8ca9-0b52fd8c9bb0 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:06.457676 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:06.464163 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93785614-f4b3-48a5-8ca9-0b52fd8c9bb0 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:06.464936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93785614-f4b3-48a5-8ca9-0b52fd8c9bb0 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:06.465699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93785614-f4b3-48a5-8ca9-0b52fd8c9bb0 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:06.466132 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93785614-f4b3-48a5-8ca9-0b52fd8c9bb0 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:06.492248 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93785614-f4b3-48a5-8ca9-0b52fd8c9bb0 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:09:06.569559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-93785614-f4b3-48a5-8ca9-0b52fd8c9bb0 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 204 len: 0 microversion: 2.1 time: 0.117954 Jul 25 20:09:06.570193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1634/3414] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:09:06 2022] DELETE /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:09:06.579838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-836928fc-9495-4403-ab9f-e42e589df5ac tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:06.580442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-836928fc-9495-4403-ab9f-e42e589df5ac tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:06.582271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:06.587658 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-836928fc-9495-4403-ab9f-e42e589df5ac tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:06.588104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-836928fc-9495-4403-ab9f-e42e589df5ac tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:06.588891 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-836928fc-9495-4403-ab9f-e42e589df5ac tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:06.589340 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-836928fc-9495-4403-ab9f-e42e589df5ac tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:06.594054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=85 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:06.724900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-836928fc-9495-4403-ab9f-e42e589df5ac tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:06.735242 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-836928fc-9495-4403-ab9f-e42e589df5ac tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1504 microversion: 2.1 time: 0.159458 Jul 25 20:09:06.735869 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1781/3415] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:06 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:07.758991 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3c461d10-f302-4644-b72a-480ec4aee0b7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:07.759794 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3c461d10-f302-4644-b72a-480ec4aee0b7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:07.767583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c461d10-f302-4644-b72a-480ec4aee0b7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:07.768026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c461d10-f302-4644-b72a-480ec4aee0b7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:07.768775 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c461d10-f302-4644-b72a-480ec4aee0b7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:07.769204 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c461d10-f302-4644-b72a-480ec4aee0b7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:07.773250 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:07.908296 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3c461d10-f302-4644-b72a-480ec4aee0b7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:07.915916 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3c461d10-f302-4644-b72a-480ec4aee0b7 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1504 microversion: 2.1 time: 0.161009 Jul 25 20:09:07.917114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1635/3416] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:07 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:08.938213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-825952e1-ff8d-4002-8d2d-1af48a14a926 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:08.938827 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-825952e1-ff8d-4002-8d2d-1af48a14a926 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:08.945323 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-825952e1-ff8d-4002-8d2d-1af48a14a926 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:08.945774 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-825952e1-ff8d-4002-8d2d-1af48a14a926 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:08.946545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-825952e1-ff8d-4002-8d2d-1af48a14a926 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:08.946984 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-825952e1-ff8d-4002-8d2d-1af48a14a926 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:09.187196 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-825952e1-ff8d-4002-8d2d-1af48a14a926 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c8111203d34490a0db95a739f73e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca50c708922486a910456429af51e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:09.195169 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-825952e1-ff8d-4002-8d2d-1af48a14a926 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 200 len: 1504 microversion: 2.1 time: 0.260721 Jul 25 20:09:09.196270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1782/3417] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:08 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:09.484084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-bd4a8c59-6290-4c42-8d04-ad04d6e85ad2 req-57561828-e436-4e1f-ab5b-4052190405ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27e174b-cd6d-490b-9ae9-3080715ebc1b", "name": "network-vif-deleted", "tag": "5472579e-6bf7-43fa-8440-ac390d6c7fb9"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:09.491882 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:09.497673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-bd4a8c59-6290-4c42-8d04-ad04d6e85ad2 req-57561828-e436-4e1f-ab5b-4052190405ac service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:09.498109 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-bd4a8c59-6290-4c42-8d04-ad04d6e85ad2 req-57561828-e436-4e1f-ab5b-4052190405ac service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:09.511291 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-bd4a8c59-6290-4c42-8d04-ad04d6e85ad2 req-57561828-e436-4e1f-ab5b-4052190405ac service nova] Creating event network-vif-deleted:5472579e-6bf7-43fa-8440-ac390d6c7fb9 for instance a27e174b-cd6d-490b-9ae9-3080715ebc1b on hv-cinder-85093 Jul 25 20:09:09.516023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-bd4a8c59-6290-4c42-8d04-ad04d6e85ad2 req-57561828-e436-4e1f-ab5b-4052190405ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036921 Jul 25 20:09:09.516636 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1636/3418] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:10.217104 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-306a3845-c1e1-40cb-904a-8c5eba0cb428 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:10.217710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-306a3845-c1e1-40cb-904a-8c5eba0cb428 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] [instance: a27e174b-cd6d-490b-9ae9-3080715ebc1b] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:10.224298 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-306a3845-c1e1-40cb-904a-8c5eba0cb428 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:10.224759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-306a3845-c1e1-40cb-904a-8c5eba0cb428 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:10.225610 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-306a3845-c1e1-40cb-904a-8c5eba0cb428 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:10.226132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-306a3845-c1e1-40cb-904a-8c5eba0cb428 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:10.240772 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-306a3845-c1e1-40cb-904a-8c5eba0cb428 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] HTTP exception thrown: Instance a27e174b-cd6d-490b-9ae9-3080715ebc1b could not be found. Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-306a3845-c1e1-40cb-904a-8c5eba0cb428 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Request method failure captured: Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b HTTP/1.1 Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3vhCAP731g1IQgcjchr9fpA8gvDkNG58zpGnlSuW_7Lm4UpPdEPF-MjmtovF4d9xHuZE6vkEMuQVFj89vGIeRQ37wupFe5dI6_c8NNU8w41aks-t9Rw7Vp9su-pzC1P5RoyexebB2T2TGOTcdz7hSAGQDpERrK8FJT5zY5SLjEDtPBU Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: 6ca50c708922486a910456429af51e2e Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-VolumesActionsTest-2058395115 Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:09:10.242469 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ca50c708922486a910456429af51e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6ca50c708922486a910456429af51e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ca50c708922486a910456429af51e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6ca50c708922486a910456429af51e2e", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-VolumesActionsTest-2058395115 Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: 6ca50c708922486a910456429af51e2e Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-VolumesActionsTest-2058395115 Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-VolumesActionsTest-2058395115-project Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 64c8111203d34490a0db95a739f73e0b Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-VolumesActionsTest-2058395115-project Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance a27e174b-cd6d-490b-9ae9-3080715ebc1b could not be found. Jul 25 20:09:10.244191 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': 'a27e174b-cd6d-490b-9ae9-3080715ebc1b'} Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a27e174b-cd6d-490b-9ae9-3080715ebc1b could not be found. Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:09:10.245505 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a27e174b-cd6d-490b-9ae9-3080715ebc1b could not be found. Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a27e174b-cd6d-490b-9ae9-3080715ebc1b could not be found. Jul 25 20:09:10.247224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:09:10.251072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-306a3845-c1e1-40cb-904a-8c5eba0cb428 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] Returning 404 to user: Instance a27e174b-cd6d-490b-9ae9-3080715ebc1b could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:09:10.251072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-306a3845-c1e1-40cb-904a-8c5eba0cb428 tempest-VolumesActionsTest-2058395115 tempest-VolumesActionsTest-2058395115-project] 10.222.0.18 "GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b" status: 404 len: 111 microversion: 2.1 time: 0.031115 Jul 25 20:09:10.251072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1783/3419] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:10 2022] GET /compute/v2.1/servers/a27e174b-cd6d-490b-9ae9-3080715ebc1b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:10:32.442101 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:32.442756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:32.447181 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd803bb1-e51b-4422-8af1-d75f77e83e60 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:32.447813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd803bb1-e51b-4422-8af1-d75f77e83e60 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:32.455449 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd803bb1-e51b-4422-8af1-d75f77e83e60 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:32.455920 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd803bb1-e51b-4422-8af1-d75f77e83e60 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:32.456711 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd803bb1-e51b-4422-8af1-d75f77e83e60 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:32.457145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd803bb1-e51b-4422-8af1-d75f77e83e60 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:32.484875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd803bb1-e51b-4422-8af1-d75f77e83e60 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:10:32.717492 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fd803bb1-e51b-4422-8af1-d75f77e83e60 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "DELETE /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 204 len: 0 microversion: 2.1 time: 0.277356 Jul 25 20:10:32.719009 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1637/3420] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:10:32 2022] DELETE /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:10:32.724837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=5 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:32.725637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=13 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:32.729725 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-14a92529-a5f3-4292-b955-da0e21f6239f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:32.730344 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-14a92529-a5f3-4292-b955-da0e21f6239f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:32.738677 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14a92529-a5f3-4292-b955-da0e21f6239f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:32.739172 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14a92529-a5f3-4292-b955-da0e21f6239f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:32.740086 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14a92529-a5f3-4292-b955-da0e21f6239f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:32.740576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-14a92529-a5f3-4292-b955-da0e21f6239f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:32.888077 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-14a92529-a5f3-4292-b955-da0e21f6239f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:32.897811 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-14a92529-a5f3-4292-b955-da0e21f6239f tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1574 microversion: 2.1 time: 0.174760 Jul 25 20:10:32.898399 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1784/3421] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:32 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:33.920126 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfec8361-f959-4043-886f-3752027df914 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:33.920809 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfec8361-f959-4043-886f-3752027df914 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:33.928566 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfec8361-f959-4043-886f-3752027df914 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:33.929007 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfec8361-f959-4043-886f-3752027df914 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:33.929750 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfec8361-f959-4043-886f-3752027df914 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:33.930179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfec8361-f959-4043-886f-3752027df914 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:34.064978 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dfec8361-f959-4043-886f-3752027df914 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:34.072496 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfec8361-f959-4043-886f-3752027df914 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1574 microversion: 2.1 time: 0.156710 Jul 25 20:10:34.073045 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1638/3422] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:33 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:35.094777 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-383c40c6-a9f6-40af-bbf9-468a517db61e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:35.095381 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-383c40c6-a9f6-40af-bbf9-468a517db61e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:35.102783 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-383c40c6-a9f6-40af-bbf9-468a517db61e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:35.103227 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-383c40c6-a9f6-40af-bbf9-468a517db61e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:35.104033 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-383c40c6-a9f6-40af-bbf9-468a517db61e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:35.104466 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-383c40c6-a9f6-40af-bbf9-468a517db61e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:35.284643 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-383c40c6-a9f6-40af-bbf9-468a517db61e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:35.292853 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-383c40c6-a9f6-40af-bbf9-468a517db61e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1574 microversion: 2.1 time: 0.202324 Jul 25 20:10:35.293446 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1785/3423] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:35 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:36.137635 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-90d096d9-5362-4ca9-8b15-a8bde0b165e5 req-8874ff0e-6401-4b47-8da8-0077d9114827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386cc182-5e6f-4f83-9789-9365b06c5ed7", "name": "network-vif-deleted", "tag": "acfa2d23-b033-490c-afce-cdb1fcfac7d5"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:36.150153 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-90d096d9-5362-4ca9-8b15-a8bde0b165e5 req-8874ff0e-6401-4b47-8da8-0077d9114827 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:36.150598 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-90d096d9-5362-4ca9-8b15-a8bde0b165e5 req-8874ff0e-6401-4b47-8da8-0077d9114827 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:36.176105 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-90d096d9-5362-4ca9-8b15-a8bde0b165e5 req-8874ff0e-6401-4b47-8da8-0077d9114827 service nova] Creating event network-vif-deleted:acfa2d23-b033-490c-afce-cdb1fcfac7d5 for instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 on hv-cinder-85093 Jul 25 20:10:36.181797 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-90d096d9-5362-4ca9-8b15-a8bde0b165e5 req-8874ff0e-6401-4b47-8da8-0077d9114827 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048475 Jul 25 20:10:36.182585 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1639/3424] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:10:36.315055 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-8d85fd6d-d06b-44e8-8bc4-81659c2c8039 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:36.316341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-8d85fd6d-d06b-44e8-8bc4-81659c2c8039 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:36.323353 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d85fd6d-d06b-44e8-8bc4-81659c2c8039 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:36.323936 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d85fd6d-d06b-44e8-8bc4-81659c2c8039 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:36.325046 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d85fd6d-d06b-44e8-8bc4-81659c2c8039 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:36.325621 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-8d85fd6d-d06b-44e8-8bc4-81659c2c8039 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:36.394666 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-8d85fd6d-d06b-44e8-8bc4-81659c2c8039 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:36.402989 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-8d85fd6d-d06b-44e8-8bc4-81659c2c8039 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 200 len: 1224 microversion: 2.1 time: 0.092655 Jul 25 20:10:36.403593 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1786/3425] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:36 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:37.425946 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cebd33cb-0934-4702-a289-3ca7ed497d4e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:37.426544 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cebd33cb-0934-4702-a289-3ca7ed497d4e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:37.432910 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cebd33cb-0934-4702-a289-3ca7ed497d4e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:37.433338 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cebd33cb-0934-4702-a289-3ca7ed497d4e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:37.434325 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cebd33cb-0934-4702-a289-3ca7ed497d4e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:37.434772 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cebd33cb-0934-4702-a289-3ca7ed497d4e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:37.450261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-cebd33cb-0934-4702-a289-3ca7ed497d4e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] HTTP exception thrown: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cebd33cb-0934-4702-a289-3ca7ed497d4e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Request method failure captured: Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 HTTP/1.1 Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3vgE4UcQiZqEoYIVeNG6rXdP8594uiMMkStsY8UW0W1aWDaGdLtTOwBR75SamLVO3yWVuVCR9dPsXCaUqieMVKRlxWROwyuJWLV1-vGpVWuhWh_61TX1E6tR4EtNhYF1AxaZYDKsGXLVrw4JZA9UYBXp7EnxWdFKU0ZR07faOpoDVhE Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: b6986405c7974cc8bdf5d0c470926c1f Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestVolumeBootPattern-714955116 Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:10:37.451936 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b6986405c7974cc8bdf5d0c470926c1f", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestVolumeBootPattern-714955116 Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: b6986405c7974cc8bdf5d0c470926c1f Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestVolumeBootPattern-714955116 Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-TestVolumeBootPattern-714955116-project Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 8143c33eabd74b1b9edc84e8ff155903 Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestVolumeBootPattern-714955116-project Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:10:37.454307 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '386cc182-5e6f-4f83-9789-9365b06c5ed7'} Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:10:37.455142 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:10:37.456572 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:10:37.457752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cebd33cb-0934-4702-a289-3ca7ed497d4e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Returning 404 to user: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:10:37.457752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cebd33cb-0934-4702-a289-3ca7ed497d4e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 404 len: 111 microversion: 2.1 time: 0.033159 Jul 25 20:10:37.457752 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1640/3426] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:37 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:10:37.590946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-757983220", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-546487680", "security_groups": [{"name": "tempest-secgroup-smoke-510731765"}], "block_device_mapping_v2": [{"uuid": "76bd381e-7d4a-4a9a-a08b-d87ebbc5c3a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4eb3ae9-2585-4fd6-b637-ba4a75a64672"}]}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:37.723614 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] validate_networks() for [('a4eb3ae9-2585-4fd6-b637-ba4a75a64672', None, None, None, None, None)] {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:10:38.162660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:10:38.163088 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:10:38.163604 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:10:38.164024 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:10:38.164442 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:10:38.175734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:38.176262 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:38.177216 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:38.177738 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:38.197300 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Getting quotas for project b6986405c7974cc8bdf5d0c470926c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:38.202911 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Getting quotas for user 8143c33eabd74b1b9edc84e8ff155903 and project b6986405c7974cc8bdf5d0c470926c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:38.288555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:10:38.291355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76bd381e-7d4a-4a9a-a08b-d87ebbc5c3a9',volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:10:38.447607 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-bcfc23dd-4465-4509-9cbf-805ffd9b910b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.860539 Jul 25 20:10:38.448270 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1787/3427] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 20:10:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:10:38.461098 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2caa7dee-d7a2-4cbd-8054-c1becbdfb569 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:38.463029 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2caa7dee-d7a2-4cbd-8054-c1becbdfb569 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:38.525624 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2caa7dee-d7a2-4cbd-8054-c1becbdfb569 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:38.533361 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2caa7dee-d7a2-4cbd-8054-c1becbdfb569 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1093 microversion: 2.1 time: 0.076655 Jul 25 20:10:38.533908 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1641/3428] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:38 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:10:39.556572 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-855816ff-0f1d-47e5-8e3d-5b2f5fcf3515 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:39.557369 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-855816ff-0f1d-47e5-8e3d-5b2f5fcf3515 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:39.566555 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-855816ff-0f1d-47e5-8e3d-5b2f5fcf3515 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:39.567144 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-855816ff-0f1d-47e5-8e3d-5b2f5fcf3515 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:39.568105 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-855816ff-0f1d-47e5-8e3d-5b2f5fcf3515 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:39.568681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-855816ff-0f1d-47e5-8e3d-5b2f5fcf3515 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:39.635747 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-855816ff-0f1d-47e5-8e3d-5b2f5fcf3515 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:39.644023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-855816ff-0f1d-47e5-8e3d-5b2f5fcf3515 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1191 microversion: 2.1 time: 0.092000 Jul 25 20:10:39.644947 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1788/3429] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:39 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:40.667686 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c98d4f8b-f6b8-4774-b8bb-57eace515db2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:40.668298 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c98d4f8b-f6b8-4774-b8bb-57eace515db2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:40.674702 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c98d4f8b-f6b8-4774-b8bb-57eace515db2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:40.675204 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c98d4f8b-f6b8-4774-b8bb-57eace515db2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:40.676080 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c98d4f8b-f6b8-4774-b8bb-57eace515db2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:40.676820 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c98d4f8b-f6b8-4774-b8bb-57eace515db2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:41.185495 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c98d4f8b-f6b8-4774-b8bb-57eace515db2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:41.195156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c98d4f8b-f6b8-4774-b8bb-57eace515db2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.532627 Jul 25 20:10:41.195783 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1642/3430] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:40 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:41.566562 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-7bef95b9-42f6-4e0d-8127-2675fdc1a98a req-aad29a0a-e17d-492d-8d13-c685168dbfcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd910d63-b30c-46b8-8ab2-d2a76e2e35d6", "tag": "01d88f12-4c16-4b1d-a7fb-03006cbdf79d"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:41.581801 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-7bef95b9-42f6-4e0d-8127-2675fdc1a98a req-aad29a0a-e17d-492d-8d13-c685168dbfcf service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:41.582647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-7bef95b9-42f6-4e0d-8127-2675fdc1a98a req-aad29a0a-e17d-492d-8d13-c685168dbfcf service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:41.596377 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-7bef95b9-42f6-4e0d-8127-2675fdc1a98a req-aad29a0a-e17d-492d-8d13-c685168dbfcf service nova] Creating event network-changed:01d88f12-4c16-4b1d-a7fb-03006cbdf79d for instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 on hv-cinder-85093 Jul 25 20:10:41.602794 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-7bef95b9-42f6-4e0d-8127-2675fdc1a98a req-aad29a0a-e17d-492d-8d13-c685168dbfcf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040588 Jul 25 20:10:41.604334 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1789/3431] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:42.220172 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d7a31b1-36af-48bc-99a2-9af1424a3ff9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:42.220776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d7a31b1-36af-48bc-99a2-9af1424a3ff9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:42.232688 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d7a31b1-36af-48bc-99a2-9af1424a3ff9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:42.233048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d7a31b1-36af-48bc-99a2-9af1424a3ff9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:42.234781 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d7a31b1-36af-48bc-99a2-9af1424a3ff9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:42.235354 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d7a31b1-36af-48bc-99a2-9af1424a3ff9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:42.400054 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d7a31b1-36af-48bc-99a2-9af1424a3ff9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:42.409262 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d7a31b1-36af-48bc-99a2-9af1424a3ff9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.193374 Jul 25 20:10:42.409839 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1643/3432] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:42 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:43.432150 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-b46c5987-adc9-45b7-b1c2-0f6a5322ebae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:43.432803 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-b46c5987-adc9-45b7-b1c2-0f6a5322ebae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:43.440642 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b46c5987-adc9-45b7-b1c2-0f6a5322ebae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:43.441093 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b46c5987-adc9-45b7-b1c2-0f6a5322ebae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:43.441875 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b46c5987-adc9-45b7-b1c2-0f6a5322ebae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:43.442316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-b46c5987-adc9-45b7-b1c2-0f6a5322ebae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:43.593951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-b46c5987-adc9-45b7-b1c2-0f6a5322ebae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:43.602432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-b46c5987-adc9-45b7-b1c2-0f6a5322ebae tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.175261 Jul 25 20:10:43.603018 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1790/3433] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:43 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:44.624084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c08a76ad-376c-4557-851c-b04603c1eb3d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:44.624949 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c08a76ad-376c-4557-851c-b04603c1eb3d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:44.631826 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c08a76ad-376c-4557-851c-b04603c1eb3d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:44.632274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c08a76ad-376c-4557-851c-b04603c1eb3d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:44.633042 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c08a76ad-376c-4557-851c-b04603c1eb3d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:44.633482 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c08a76ad-376c-4557-851c-b04603c1eb3d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:44.772350 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c08a76ad-376c-4557-851c-b04603c1eb3d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:44.780457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c08a76ad-376c-4557-851c-b04603c1eb3d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.160017 Jul 25 20:10:44.780917 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1644/3434] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:44 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:45.801931 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-881f6b7b-5ce2-4732-bf1c-1630760bbaf7 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:45.802540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-881f6b7b-5ce2-4732-bf1c-1630760bbaf7 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:45.809198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-881f6b7b-5ce2-4732-bf1c-1630760bbaf7 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:45.809647 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-881f6b7b-5ce2-4732-bf1c-1630760bbaf7 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:45.810428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-881f6b7b-5ce2-4732-bf1c-1630760bbaf7 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:45.810883 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-881f6b7b-5ce2-4732-bf1c-1630760bbaf7 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:45.954181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-881f6b7b-5ce2-4732-bf1c-1630760bbaf7 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:45.962011 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-881f6b7b-5ce2-4732-bf1c-1630760bbaf7 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.163945 Jul 25 20:10:45.962595 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1791/3435] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:45 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:46.983813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-37150e31-6d68-485c-893b-e128f8dbc2cb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:46.984473 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-37150e31-6d68-485c-893b-e128f8dbc2cb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:46.991048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37150e31-6d68-485c-893b-e128f8dbc2cb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:46.991501 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37150e31-6d68-485c-893b-e128f8dbc2cb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:46.992300 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37150e31-6d68-485c-893b-e128f8dbc2cb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:46.992742 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37150e31-6d68-485c-893b-e128f8dbc2cb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:47.132261 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37150e31-6d68-485c-893b-e128f8dbc2cb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:47.141326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-37150e31-6d68-485c-893b-e128f8dbc2cb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.160696 Jul 25 20:10:47.141890 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1645/3436] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:46 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:48.161718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-5f3e0bd1-e1f3-43be-9cf8-d3d8617f43ad tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:48.162384 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-5f3e0bd1-e1f3-43be-9cf8-d3d8617f43ad tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:48.169545 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f3e0bd1-e1f3-43be-9cf8-d3d8617f43ad tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:48.170419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f3e0bd1-e1f3-43be-9cf8-d3d8617f43ad tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:48.171081 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f3e0bd1-e1f3-43be-9cf8-d3d8617f43ad tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:48.172316 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-5f3e0bd1-e1f3-43be-9cf8-d3d8617f43ad tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:48.188415 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:48.213062 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=6 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:48.312569 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-5f3e0bd1-e1f3-43be-9cf8-d3d8617f43ad tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:48.320348 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-5f3e0bd1-e1f3-43be-9cf8-d3d8617f43ad tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.162475 Jul 25 20:10:48.320917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1792/3437] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:48 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:49.342179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e2067351-6a77-4c2a-8029-2a71c62e9cbf tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:49.343465 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e2067351-6a77-4c2a-8029-2a71c62e9cbf tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:49.345796 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:49.351223 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2067351-6a77-4c2a-8029-2a71c62e9cbf tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:49.351701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2067351-6a77-4c2a-8029-2a71c62e9cbf tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:49.352459 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2067351-6a77-4c2a-8029-2a71c62e9cbf tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:49.352891 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2067351-6a77-4c2a-8029-2a71c62e9cbf tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:49.504023 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2067351-6a77-4c2a-8029-2a71c62e9cbf tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:49.511629 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e2067351-6a77-4c2a-8029-2a71c62e9cbf tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.173152 Jul 25 20:10:49.512203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1646/3438] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:49 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:50.532567 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-82ea8c37-9ef4-4664-aacd-ef4b911d0f8a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:50.533171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-82ea8c37-9ef4-4664-aacd-ef4b911d0f8a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:50.539620 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82ea8c37-9ef4-4664-aacd-ef4b911d0f8a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:50.540160 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82ea8c37-9ef4-4664-aacd-ef4b911d0f8a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:50.540837 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82ea8c37-9ef4-4664-aacd-ef4b911d0f8a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:50.541265 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-82ea8c37-9ef4-4664-aacd-ef4b911d0f8a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:50.681511 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-82ea8c37-9ef4-4664-aacd-ef4b911d0f8a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:50.690171 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-82ea8c37-9ef4-4664-aacd-ef4b911d0f8a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.161797 Jul 25 20:10:50.690759 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1793/3439] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:50 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:51.710290 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-03093c27-1bde-44bb-bc4a-a39b5431b3ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:51.710957 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-03093c27-1bde-44bb-bc4a-a39b5431b3ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:51.718652 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03093c27-1bde-44bb-bc4a-a39b5431b3ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.719108 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03093c27-1bde-44bb-bc4a-a39b5431b3ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.719969 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03093c27-1bde-44bb-bc4a-a39b5431b3ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.720408 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03093c27-1bde-44bb-bc4a-a39b5431b3ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.766956 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-143996e0-e95b-499f-a62f-70ebaf6e1b71 req-483d0363-2b28-4d6f-8c61-dbb2cceb1f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd910d63-b30c-46b8-8ab2-d2a76e2e35d6", "name": "network-vif-plugged", "status": "completed", "tag": "01d88f12-4c16-4b1d-a7fb-03006cbdf79d"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:51.785475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-143996e0-e95b-499f-a62f-70ebaf6e1b71 req-483d0363-2b28-4d6f-8c61-dbb2cceb1f54 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.786230 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-143996e0-e95b-499f-a62f-70ebaf6e1b71 req-483d0363-2b28-4d6f-8c61-dbb2cceb1f54 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.811976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-143996e0-e95b-499f-a62f-70ebaf6e1b71 req-483d0363-2b28-4d6f-8c61-dbb2cceb1f54 service nova] Creating event network-vif-plugged:01d88f12-4c16-4b1d-a7fb-03006cbdf79d for instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 on hv-cinder-85093 Jul 25 20:10:51.821054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-143996e0-e95b-499f-a62f-70ebaf6e1b71 req-483d0363-2b28-4d6f-8c61-dbb2cceb1f54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060771 Jul 25 20:10:51.822519 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1794/3440] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:10:51.884613 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-03093c27-1bde-44bb-bc4a-a39b5431b3ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:51.893457 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-03093c27-1bde-44bb-bc4a-a39b5431b3ca tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.186929 Jul 25 20:10:51.894035 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1647/3441] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:51 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:52.917897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-c1bbb1d7-1f21-47c3-beff-1595a59adcfb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:52.918597 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-c1bbb1d7-1f21-47c3-beff-1595a59adcfb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:52.929118 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1bbb1d7-1f21-47c3-beff-1595a59adcfb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.929542 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1bbb1d7-1f21-47c3-beff-1595a59adcfb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:52.930304 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1bbb1d7-1f21-47c3-beff-1595a59adcfb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.930735 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-c1bbb1d7-1f21-47c3-beff-1595a59adcfb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:53.077993 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-c1bbb1d7-1f21-47c3-beff-1595a59adcfb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:53.085710 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-c1bbb1d7-1f21-47c3-beff-1595a59adcfb tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1264 microversion: 2.1 time: 0.172374 Jul 25 20:10:53.086288 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1795/3442] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:52 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:54.109114 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f150aaec-c9c3-42be-8577-a5328a4b68b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:54.110370 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f150aaec-c9c3-42be-8577-a5328a4b68b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:54.117375 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f150aaec-c9c3-42be-8577-a5328a4b68b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:54.117832 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f150aaec-c9c3-42be-8577-a5328a4b68b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:54.119420 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f150aaec-c9c3-42be-8577-a5328a4b68b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:54.120150 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f150aaec-c9c3-42be-8577-a5328a4b68b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:54.273121 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f150aaec-c9c3-42be-8577-a5328a4b68b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:54.282048 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f150aaec-c9c3-42be-8577-a5328a4b68b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1451 microversion: 2.1 time: 0.177197 Jul 25 20:10:54.282658 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1648/3443] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:54 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:54.302416 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-a695e97f-246d-4a27-be53-f88ee9fbef6a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:54.303201 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-a695e97f-246d-4a27-be53-f88ee9fbef6a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:54.310295 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a695e97f-246d-4a27-be53-f88ee9fbef6a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:54.310742 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a695e97f-246d-4a27-be53-f88ee9fbef6a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:54.313136 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a695e97f-246d-4a27-be53-f88ee9fbef6a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:54.314043 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-a695e97f-246d-4a27-be53-f88ee9fbef6a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:54.456790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-a695e97f-246d-4a27-be53-f88ee9fbef6a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:54.464331 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-a695e97f-246d-4a27-be53-f88ee9fbef6a tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1451 microversion: 2.1 time: 0.166025 Jul 25 20:10:54.464900 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1796/3444] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:54 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:56.144913 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-d55da192-7b11-49a9-b063-0388b10cdfbe req-06c27f57-6e6b-4435-940a-1c1c18c3c5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd910d63-b30c-46b8-8ab2-d2a76e2e35d6", "tag": "01d88f12-4c16-4b1d-a7fb-03006cbdf79d"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:56.154935 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-d55da192-7b11-49a9-b063-0388b10cdfbe req-06c27f57-6e6b-4435-940a-1c1c18c3c5a6 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:56.156084 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-d55da192-7b11-49a9-b063-0388b10cdfbe req-06c27f57-6e6b-4435-940a-1c1c18c3c5a6 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:56.167195 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-d55da192-7b11-49a9-b063-0388b10cdfbe req-06c27f57-6e6b-4435-940a-1c1c18c3c5a6 service nova] Creating event network-changed:01d88f12-4c16-4b1d-a7fb-03006cbdf79d for instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 on hv-cinder-85093 Jul 25 20:10:56.173853 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-d55da192-7b11-49a9-b063-0388b10cdfbe req-06c27f57-6e6b-4435-940a-1c1c18c3c5a6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032711 Jul 25 20:10:56.174460 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1649/3445] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:25.686626 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:11:25.687644 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 20:11:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:12:42.978173 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:12:42.978808 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 20:12:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:12:54.179826 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:54.180566 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=66 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:54.184468 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1264310054", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-546487680", "security_groups": [{"name": "tempest-secgroup-smoke-510731765"}], "block_device_mapping_v2": [{"uuid": "3d220fa9-0819-4301-912e-91e9de3ce617", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4eb3ae9-2585-4fd6-b637-ba4a75a64672"}]}} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:54.411540 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.network.neutron [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] validate_networks() for [('a4eb3ae9-2585-4fd6-b637-ba4a75a64672', None, None, None, None, None)] {{(pid=117952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:12:54.811812 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Flavor limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:12:54.813128 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Image limits 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:12:54.813761 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Flavor pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:12:54.814181 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Image pref 0:0:0 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:12:54.814598 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.virt.hardware [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:12:54.824228 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:54.824680 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:54.825524 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:54.825962 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:54.845451 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Getting quotas for project b6986405c7974cc8bdf5d0c470926c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:12:54.849443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.quota [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Getting quotas for user 8143c33eabd74b1b9edc84e8ff155903 and project b6986405c7974cc8bdf5d0c470926c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=117952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:12:54.911326 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Going to run 1 instances... {{(pid=117952) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:12:54.913456 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d220fa9-0819-4301-912e-91e9de3ce617',volume_size=None,volume_type=None)] {{(pid=117952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:12:55.043959 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-dce815b3-47f6-4d00-b51d-26e82523392d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.865884 Jul 25 20:12:55.044718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1797/3446] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Jul 25 20:12:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:12:55.053779 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d35c92ce-7a84-44f2-85ce-cd5b7bb5d873] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 20:12:55.054615 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:55.055793 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:55.063972 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-896db360-6fee-4c81-9af3-2ea33d12c242 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:55.065230 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-896db360-6fee-4c81-9af3-2ea33d12c242 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:55.543147 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-896db360-6fee-4c81-9af3-2ea33d12c242 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:55.550865 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-896db360-6fee-4c81-9af3-2ea33d12c242 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1094 microversion: 2.1 time: 0.498936 Jul 25 20:12:55.551533 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1650/3447] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:55 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1094 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:56.572970 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-0707f12b-f0f3-4eac-861e-23f92643595b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:56.573583 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-0707f12b-f0f3-4eac-861e-23f92643595b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:56.580319 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0707f12b-f0f3-4eac-861e-23f92643595b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:56.580769 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0707f12b-f0f3-4eac-861e-23f92643595b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:56.581536 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0707f12b-f0f3-4eac-861e-23f92643595b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:56.581976 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-0707f12b-f0f3-4eac-861e-23f92643595b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:56.646652 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-0707f12b-f0f3-4eac-861e-23f92643595b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:56.654126 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-0707f12b-f0f3-4eac-861e-23f92643595b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1210 microversion: 2.1 time: 0.085625 Jul 25 20:12:56.654683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1798/3448] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:56 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:57.676534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d29b2c15-80c0-4f8c-ae08-fa3d01b4bd5e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:57.677239 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d29b2c15-80c0-4f8c-ae08-fa3d01b4bd5e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:57.701111 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] [d35c92ce-7a84-44f2-85ce-cd5b7bb5d873] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48440. Jul 25 20:12:57.704915 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d29b2c15-80c0-4f8c-ae08-fa3d01b4bd5e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:57.705620 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d29b2c15-80c0-4f8c-ae08-fa3d01b4bd5e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:57.706732 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d29b2c15-80c0-4f8c-ae08-fa3d01b4bd5e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:57.707264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d29b2c15-80c0-4f8c-ae08-fa3d01b4bd5e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:57.946601 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d29b2c15-80c0-4f8c-ae08-fa3d01b4bd5e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:57.953974 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d29b2c15-80c0-4f8c-ae08-fa3d01b4bd5e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1277 microversion: 2.1 time: 0.281976 Jul 25 20:12:57.954619 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1651/3449] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:57 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:58.297236 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-b73e7872-370b-49c5-a7b4-1d3f4f6be159 req-a4938f05-a423-4915-b429-b6215a587629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ee6a46-cc90-475a-9b0e-6f87456c66f4", "tag": "b5e67aa3-0f8d-4e34-aeb3-caf5f9d6fa5e"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:58.308851 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-b73e7872-370b-49c5-a7b4-1d3f4f6be159 req-a4938f05-a423-4915-b429-b6215a587629 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:58.309450 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-b73e7872-370b-49c5-a7b4-1d3f4f6be159 req-a4938f05-a423-4915-b429-b6215a587629 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:58.323884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-b73e7872-370b-49c5-a7b4-1d3f4f6be159 req-a4938f05-a423-4915-b429-b6215a587629 service nova] Creating event network-changed:b5e67aa3-0f8d-4e34-aeb3-caf5f9d6fa5e for instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 on hv-cinder-85093 Jul 25 20:12:58.335636 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-b73e7872-370b-49c5-a7b4-1d3f4f6be159 req-a4938f05-a423-4915-b429-b6215a587629 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042383 Jul 25 20:12:58.336263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1799/3450] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:58.974553 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cf2c9892-606a-4f80-a87d-adabf46784c6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:58.975156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cf2c9892-606a-4f80-a87d-adabf46784c6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:58.981846 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf2c9892-606a-4f80-a87d-adabf46784c6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:58.982297 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf2c9892-606a-4f80-a87d-adabf46784c6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:58.983055 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf2c9892-606a-4f80-a87d-adabf46784c6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:58.983491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf2c9892-606a-4f80-a87d-adabf46784c6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:59.153123 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cf2c9892-606a-4f80-a87d-adabf46784c6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:59.161133 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cf2c9892-606a-4f80-a87d-adabf46784c6 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.190576 Jul 25 20:12:59.161727 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1652/3451] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:58 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:00.183895 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f280ecde-4993-4a37-8bd0-0d6f972cf061 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:00.184641 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f280ecde-4993-4a37-8bd0-0d6f972cf061 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:00.191734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f280ecde-4993-4a37-8bd0-0d6f972cf061 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:00.192180 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f280ecde-4993-4a37-8bd0-0d6f972cf061 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:00.192948 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f280ecde-4993-4a37-8bd0-0d6f972cf061 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:00.193383 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f280ecde-4993-4a37-8bd0-0d6f972cf061 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:00.337263 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f280ecde-4993-4a37-8bd0-0d6f972cf061 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:00.345589 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f280ecde-4993-4a37-8bd0-0d6f972cf061 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.166343 Jul 25 20:13:00.346153 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1800/3452] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:00 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:01.366372 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-835973f5-0b7a-44c7-a444-d5b08d625609 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:01.366971 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-835973f5-0b7a-44c7-a444-d5b08d625609 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:01.373763 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-835973f5-0b7a-44c7-a444-d5b08d625609 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:01.374203 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-835973f5-0b7a-44c7-a444-d5b08d625609 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:01.374952 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-835973f5-0b7a-44c7-a444-d5b08d625609 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:01.375384 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-835973f5-0b7a-44c7-a444-d5b08d625609 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:01.509831 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-835973f5-0b7a-44c7-a444-d5b08d625609 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:01.518116 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-835973f5-0b7a-44c7-a444-d5b08d625609 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.155464 Jul 25 20:13:01.518696 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1653/3453] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:01 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:02.539806 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9d8ebc9f-c63a-4369-ab5a-457637623c02 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:02.540372 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9d8ebc9f-c63a-4369-ab5a-457637623c02 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:02.546807 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d8ebc9f-c63a-4369-ab5a-457637623c02 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:02.547255 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d8ebc9f-c63a-4369-ab5a-457637623c02 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:02.548754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d8ebc9f-c63a-4369-ab5a-457637623c02 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:02.549213 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9d8ebc9f-c63a-4369-ab5a-457637623c02 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:02.688537 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-9d8ebc9f-c63a-4369-ab5a-457637623c02 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:02.696942 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9d8ebc9f-c63a-4369-ab5a-457637623c02 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.161039 Jul 25 20:13:02.697517 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1801/3454] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:02 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:03.717876 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c37768ad-9034-418b-b1eb-6b9251274241 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:03.718514 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c37768ad-9034-418b-b1eb-6b9251274241 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:03.728202 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c37768ad-9034-418b-b1eb-6b9251274241 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:03.728661 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c37768ad-9034-418b-b1eb-6b9251274241 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:03.729441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c37768ad-9034-418b-b1eb-6b9251274241 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:03.729887 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c37768ad-9034-418b-b1eb-6b9251274241 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:03.874954 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c37768ad-9034-418b-b1eb-6b9251274241 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:03.883416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c37768ad-9034-418b-b1eb-6b9251274241 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.169480 Jul 25 20:13:03.884028 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1654/3455] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:03 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:04.905145 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-f7b8228b-e29a-4071-a11d-325de2527836 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:04.905757 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-f7b8228b-e29a-4071-a11d-325de2527836 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:04.908800 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=2 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:04.909443 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell0:SELECT=6 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:04.916094 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7b8228b-e29a-4071-a11d-325de2527836 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:04.916535 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7b8228b-e29a-4071-a11d-325de2527836 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:04.917301 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7b8228b-e29a-4071-a11d-325de2527836 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:04.917734 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-f7b8228b-e29a-4071-a11d-325de2527836 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:05.054253 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-f7b8228b-e29a-4071-a11d-325de2527836 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:05.062167 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-f7b8228b-e29a-4071-a11d-325de2527836 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.160880 Jul 25 20:13:05.062741 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1802/3456] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:04 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:06.084945 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-853e4fb8-8e0a-4624-9dc9-db21c9499f2b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:06.085577 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-853e4fb8-8e0a-4624-9dc9-db21c9499f2b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:06.088418 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:06.094175 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-853e4fb8-8e0a-4624-9dc9-db21c9499f2b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.095247 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-853e4fb8-8e0a-4624-9dc9-db21c9499f2b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.096151 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-853e4fb8-8e0a-4624-9dc9-db21c9499f2b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.096588 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-853e4fb8-8e0a-4624-9dc9-db21c9499f2b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.236674 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-853e4fb8-8e0a-4624-9dc9-db21c9499f2b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:06.244302 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-853e4fb8-8e0a-4624-9dc9-db21c9499f2b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.163430 Jul 25 20:13:06.244877 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1655/3457] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:06 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:07.265549 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-359f71cb-52df-4746-8f1d-0f4a8e9ef7b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:07.266701 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-359f71cb-52df-4746-8f1d-0f4a8e9ef7b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:07.274433 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-359f71cb-52df-4746-8f1d-0f4a8e9ef7b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:07.274909 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-359f71cb-52df-4746-8f1d-0f4a8e9ef7b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:07.275717 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-359f71cb-52df-4746-8f1d-0f4a8e9ef7b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:07.276165 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-359f71cb-52df-4746-8f1d-0f4a8e9ef7b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:07.416291 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-359f71cb-52df-4746-8f1d-0f4a8e9ef7b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:07.425072 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-359f71cb-52df-4746-8f1d-0f4a8e9ef7b9 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.163272 Jul 25 20:13:07.425578 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1803/3458] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:07 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:08.446456 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f191e74-4a10-489e-8999-b44437fba6f2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:08.447193 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f191e74-4a10-489e-8999-b44437fba6f2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:08.454768 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f191e74-4a10-489e-8999-b44437fba6f2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:08.455274 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f191e74-4a10-489e-8999-b44437fba6f2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:08.456212 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f191e74-4a10-489e-8999-b44437fba6f2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:08.456670 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f191e74-4a10-489e-8999-b44437fba6f2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:08.600317 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f191e74-4a10-489e-8999-b44437fba6f2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:08.608003 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f191e74-4a10-489e-8999-b44437fba6f2 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.165562 Jul 25 20:13:08.608583 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1656/3459] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:08 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:09.629576 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-391719ad-01e7-486f-996c-aeb88aaa9194 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:09.630187 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-391719ad-01e7-486f-996c-aeb88aaa9194 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:09.636679 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-391719ad-01e7-486f-996c-aeb88aaa9194 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:09.637122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-391719ad-01e7-486f-996c-aeb88aaa9194 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:09.637878 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-391719ad-01e7-486f-996c-aeb88aaa9194 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:09.638308 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-391719ad-01e7-486f-996c-aeb88aaa9194 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:09.782848 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-391719ad-01e7-486f-996c-aeb88aaa9194 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:09.790551 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-391719ad-01e7-486f-996c-aeb88aaa9194 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.165275 Jul 25 20:13:09.791054 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1804/3460] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:09 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:10.426479 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-afa18132-7cfd-4a5f-a148-a5c1160ceee9 req-ca0d4517-7f5b-4ddb-b900-f16473ea4cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ee6a46-cc90-475a-9b0e-6f87456c66f4", "name": "network-vif-plugged", "status": "completed", "tag": "b5e67aa3-0f8d-4e34-aeb3-caf5f9d6fa5e"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:10.438594 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-afa18132-7cfd-4a5f-a148-a5c1160ceee9 req-ca0d4517-7f5b-4ddb-b900-f16473ea4cc0 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:10.439236 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-afa18132-7cfd-4a5f-a148-a5c1160ceee9 req-ca0d4517-7f5b-4ddb-b900-f16473ea4cc0 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:10.450963 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-afa18132-7cfd-4a5f-a148-a5c1160ceee9 req-ca0d4517-7f5b-4ddb-b900-f16473ea4cc0 service nova] Creating event network-vif-plugged:b5e67aa3-0f8d-4e34-aeb3-caf5f9d6fa5e for instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 on hv-cinder-85093 Jul 25 20:13:10.456861 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-afa18132-7cfd-4a5f-a148-a5c1160ceee9 req-ca0d4517-7f5b-4ddb-b900-f16473ea4cc0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034294 Jul 25 20:13:10.457848 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1657/3461] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:10.811273 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-d5e81d28-762b-428b-b5ef-4f7398fce9ef tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:10.811923 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-d5e81d28-762b-428b-b5ef-4f7398fce9ef tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:10.819781 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5e81d28-762b-428b-b5ef-4f7398fce9ef tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:10.820240 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5e81d28-762b-428b-b5ef-4f7398fce9ef tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:10.821010 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5e81d28-762b-428b-b5ef-4f7398fce9ef tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:10.821445 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-d5e81d28-762b-428b-b5ef-4f7398fce9ef tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:10.961224 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-d5e81d28-762b-428b-b5ef-4f7398fce9ef tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:10.968902 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-d5e81d28-762b-428b-b5ef-4f7398fce9ef tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.161367 Jul 25 20:13:10.969475 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1805/3462] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:10 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:11.991179 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c78a575b-de3e-4499-8633-aaff697ac163 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:11.991888 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c78a575b-de3e-4499-8633-aaff697ac163 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:11.999131 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c78a575b-de3e-4499-8633-aaff697ac163 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:11.999610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c78a575b-de3e-4499-8633-aaff697ac163 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:12.000392 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c78a575b-de3e-4499-8633-aaff697ac163 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:12.000854 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c78a575b-de3e-4499-8633-aaff697ac163 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:12.141176 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c78a575b-de3e-4499-8633-aaff697ac163 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:12.150416 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c78a575b-de3e-4499-8633-aaff697ac163 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1265 microversion: 2.1 time: 0.163526 Jul 25 20:13:12.150990 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1658/3463] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:11 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:13.175031 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-89f6ad66-f1d4-4c2e-b81f-30c3eef6b3fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:13.175718 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-89f6ad66-f1d4-4c2e-b81f-30c3eef6b3fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:13.182365 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89f6ad66-f1d4-4c2e-b81f-30c3eef6b3fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:13.182816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89f6ad66-f1d4-4c2e-b81f-30c3eef6b3fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:13.183659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89f6ad66-f1d4-4c2e-b81f-30c3eef6b3fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:13.184106 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-89f6ad66-f1d4-4c2e-b81f-30c3eef6b3fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:13.336778 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-89f6ad66-f1d4-4c2e-b81f-30c3eef6b3fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:13.344529 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-89f6ad66-f1d4-4c2e-b81f-30c3eef6b3fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1451 microversion: 2.1 time: 0.175172 Jul 25 20:13:13.345132 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1806/3464] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:13 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:13.366756 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3542ae9a-f5e0-4699-8b7a-0aed9364c96e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:13.367364 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3542ae9a-f5e0-4699-8b7a-0aed9364c96e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:13.374371 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3542ae9a-f5e0-4699-8b7a-0aed9364c96e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:13.374814 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3542ae9a-f5e0-4699-8b7a-0aed9364c96e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:13.375628 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3542ae9a-f5e0-4699-8b7a-0aed9364c96e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:13.376066 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3542ae9a-f5e0-4699-8b7a-0aed9364c96e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:13.520673 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3542ae9a-f5e0-4699-8b7a-0aed9364c96e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:13.529145 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3542ae9a-f5e0-4699-8b7a-0aed9364c96e tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1451 microversion: 2.1 time: 0.166219 Jul 25 20:13:13.529909 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1659/3465] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:13 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:15.290884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-ddbd3237-112f-4a38-94da-12e87d877dc1 req-6c1a7272-c32f-4988-a82d-50732d781cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ee6a46-cc90-475a-9b0e-6f87456c66f4", "tag": "b5e67aa3-0f8d-4e34-aeb3-caf5f9d6fa5e"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:15.301833 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-ddbd3237-112f-4a38-94da-12e87d877dc1 req-6c1a7272-c32f-4988-a82d-50732d781cc4 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:15.302279 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-ddbd3237-112f-4a38-94da-12e87d877dc1 req-6c1a7272-c32f-4988-a82d-50732d781cc4 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:15.313198 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-ddbd3237-112f-4a38-94da-12e87d877dc1 req-6c1a7272-c32f-4988-a82d-50732d781cc4 service nova] Creating event network-changed:b5e67aa3-0f8d-4e34-aeb3-caf5f9d6fa5e for instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 on hv-cinder-85093 Jul 25 20:13:15.319754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-ddbd3237-112f-4a38-94da-12e87d877dc1 req-6c1a7272-c32f-4988-a82d-50732d781cc4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032416 Jul 25 20:13:15.320351 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1807/3466] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:18.988512 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:13:18.989113 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 20:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:14:45.696341 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:14:45.696981 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 20:14:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:15:01.102937 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b4deb0b3-dde3-4696-a0b9-aea96b173a8c tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:01.104329 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b4deb0b3-dde3-4696-a0b9-aea96b173a8c tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:01.104486 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9ce3868-c733-42b7-81b3-e48191fea9eb] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 20:15:01.104968 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:01.106390 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG dbcounter [-] [117952] Writing DB stats nova_cell1:SELECT=54 {{(pid=117952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:01.107995 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=22 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:01.108653 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=50 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:01.112264 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4deb0b3-dde3-4696-a0b9-aea96b173a8c tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:01.112706 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4deb0b3-dde3-4696-a0b9-aea96b173a8c tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:01.113716 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4deb0b3-dde3-4696-a0b9-aea96b173a8c tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:01.114381 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4deb0b3-dde3-4696-a0b9-aea96b173a8c tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:01.142200 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b4deb0b3-dde3-4696-a0b9-aea96b173a8c tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:15:01.182455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-25f40bc1-019b-445d-bdd5-6291397edbb6 req-b8390baf-7124-4788-bee0-38db012842c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ee6a46-cc90-475a-9b0e-6f87456c66f4", "tag": "b5e67aa3-0f8d-4e34-aeb3-caf5f9d6fa5e"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:01.200838 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-25f40bc1-019b-445d-bdd5-6291397edbb6 req-b8390baf-7124-4788-bee0-38db012842c4 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:01.201513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-25f40bc1-019b-445d-bdd5-6291397edbb6 req-b8390baf-7124-4788-bee0-38db012842c4 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:01.217065 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-25f40bc1-019b-445d-bdd5-6291397edbb6 req-b8390baf-7124-4788-bee0-38db012842c4 service nova] Creating event network-changed:b5e67aa3-0f8d-4e34-aeb3-caf5f9d6fa5e for instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 on hv-cinder-85093 Jul 25 20:15:01.223637 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-25f40bc1-019b-445d-bdd5-6291397edbb6 req-b8390baf-7124-4788-bee0-38db012842c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122768 Jul 25 20:15:01.225945 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1808/3467] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:15:01.236491 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b4deb0b3-dde3-4696-a0b9-aea96b173a8c tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 204 len: 0 microversion: 2.1 time: 0.138148 Jul 25 20:15:01.237091 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1660/3468] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:15:01 2022] DELETE /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:15:01.247102 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-df0a6807-2837-4219-b5c5-b4d486486f7d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:01.248579 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-df0a6807-2837-4219-b5c5-b4d486486f7d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:01.259951 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df0a6807-2837-4219-b5c5-b4d486486f7d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:01.260816 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df0a6807-2837-4219-b5c5-b4d486486f7d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:01.262516 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df0a6807-2837-4219-b5c5-b4d486486f7d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:01.263111 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-df0a6807-2837-4219-b5c5-b4d486486f7d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:01.696559 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-df0a6807-2837-4219-b5c5-b4d486486f7d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:01.704411 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-df0a6807-2837-4219-b5c5-b4d486486f7d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1576 microversion: 2.1 time: 0.462609 Jul 25 20:15:01.705122 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1809/3469] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:01 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1576 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:02.727856 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f32329d-9c5c-4568-8081-4e8d4ea54573 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:02.728788 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9f32329d-9c5c-4568-8081-4e8d4ea54573 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:02.735318 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f32329d-9c5c-4568-8081-4e8d4ea54573 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:02.735804 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f32329d-9c5c-4568-8081-4e8d4ea54573 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:02.736573 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f32329d-9c5c-4568-8081-4e8d4ea54573 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:02.737008 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f32329d-9c5c-4568-8081-4e8d4ea54573 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:02.914740 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9f32329d-9c5c-4568-8081-4e8d4ea54573 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:02.922140 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9f32329d-9c5c-4568-8081-4e8d4ea54573 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1576 microversion: 2.1 time: 0.199406 Jul 25 20:15:02.922701 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1661/3470] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:02 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:03.943523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ba97d423-eaec-44e2-a4e2-2bb92630b66d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:03.944146 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ba97d423-eaec-44e2-a4e2-2bb92630b66d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:03.952428 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba97d423-eaec-44e2-a4e2-2bb92630b66d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:03.952886 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba97d423-eaec-44e2-a4e2-2bb92630b66d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:03.953660 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba97d423-eaec-44e2-a4e2-2bb92630b66d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:03.954099 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ba97d423-eaec-44e2-a4e2-2bb92630b66d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:03.960821 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9ce3868-c733-42b7-81b3-e48191fea9eb] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48556. Jul 25 20:15:04.104884 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ba97d423-eaec-44e2-a4e2-2bb92630b66d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:04.113432 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ba97d423-eaec-44e2-a4e2-2bb92630b66d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1457 microversion: 2.1 time: 0.173655 Jul 25 20:15:04.114023 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1810/3471] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:03 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1457 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:04.248895 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-f88e9578-4671-4910-bb3a-ee77c85564a1 req-5b4a4109-99cb-4583-a591-7b92f5855ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ee6a46-cc90-475a-9b0e-6f87456c66f4", "name": "network-vif-deleted", "tag": "b5e67aa3-0f8d-4e34-aeb3-caf5f9d6fa5e"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:04.258996 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-f88e9578-4671-4910-bb3a-ee77c85564a1 req-5b4a4109-99cb-4583-a591-7b92f5855ccb service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:04.259442 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-f88e9578-4671-4910-bb3a-ee77c85564a1 req-5b4a4109-99cb-4583-a591-7b92f5855ccb service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:04.271474 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-f88e9578-4671-4910-bb3a-ee77c85564a1 req-5b4a4109-99cb-4583-a591-7b92f5855ccb service nova] Creating event network-vif-deleted:b5e67aa3-0f8d-4e34-aeb3-caf5f9d6fa5e for instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 on hv-cinder-85093 Jul 25 20:15:04.276815 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-f88e9578-4671-4910-bb3a-ee77c85564a1 req-5b4a4109-99cb-4583-a591-7b92f5855ccb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103345 Jul 25 20:15:04.277441 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1662/3472] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:05.136303 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:05.136917 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:05.143688 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.144139 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.144905 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.145360 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.180483 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.181125 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.181586 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.objects.instance [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lazy-loading 'fault' on Instance uuid 41ee6a46-cc90-475a-9b0e-6f87456c66f4 {{(pid=117952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:15:05.224990 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:05.232790 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-ef3ff4e5-65eb-4eff-b431-a63ec576449b tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 200 len: 1230 microversion: 2.1 time: 0.100842 Jul 25 20:15:05.233355 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1811/3473] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:05 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:06.255112 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f3d7d25-074a-44a8-a79c-70dba34e2531 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:06.255901 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9f3d7d25-074a-44a8-a79c-70dba34e2531 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 41ee6a46-cc90-475a-9b0e-6f87456c66f4] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:06.263057 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f3d7d25-074a-44a8-a79c-70dba34e2531 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:06.263534 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f3d7d25-074a-44a8-a79c-70dba34e2531 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:06.264326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f3d7d25-074a-44a8-a79c-70dba34e2531 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:06.265464 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f3d7d25-074a-44a8-a79c-70dba34e2531 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:06.280143 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-9f3d7d25-074a-44a8-a79c-70dba34e2531 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] HTTP exception thrown: Instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 could not be found. Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f3d7d25-074a-44a8-a79c-70dba34e2531 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Request method failure captured: Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 HTTP/1.1 Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3vgE4UcQiZqEoYIVeNG6rXdP8594uiMMkStsY8UW0W1aWDaGdLtTOwBR75SamLVO3yWVuVCR9dPsXCaUqieMVKRlxWROwyuJWLV1-vGpVWuhWh_61TX1E6tR4EtNhYF1AxaZYDKsGXLVrw4JZA9UYBXp7EnxWdFKU0ZR07faOpoDVhE Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: b6986405c7974cc8bdf5d0c470926c1f Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:15:06.281773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b6986405c7974cc8bdf5d0c470926c1f", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: b6986405c7974cc8bdf5d0c470926c1f Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-TestVolumeBootPattern-714955116-project Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 8143c33eabd74b1b9edc84e8ff155903 Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestVolumeBootPattern-714955116-project Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 could not be found. Jul 25 20:15:06.283227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '41ee6a46-cc90-475a-9b0e-6f87456c66f4'} Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 could not be found. Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:06.284096 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 could not be found. Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 could not be found. Jul 25 20:15:06.285344 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:15:06.286559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f3d7d25-074a-44a8-a79c-70dba34e2531 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Returning 404 to user: Instance 41ee6a46-cc90-475a-9b0e-6f87456c66f4 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:06.286559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9f3d7d25-074a-44a8-a79c-70dba34e2531 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4" status: 404 len: 111 microversion: 2.1 time: 0.032687 Jul 25 20:15:06.286559 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1663/3474] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:06 2022] GET /compute/v2.1/servers/41ee6a46-cc90-475a-9b0e-6f87456c66f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:09.365403 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-3296ef2d-6155-45e9-b98e-b146dede49fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:09.365924 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3296ef2d-6155-45e9-b98e-b146dede49fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:09.368580 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-e6f6b616-3fa5-43a8-a738-ad71461c3823 req-5a37eecf-a36a-43e6-8aaa-e900e9683246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd910d63-b30c-46b8-8ab2-d2a76e2e35d6", "tag": "01d88f12-4c16-4b1d-a7fb-03006cbdf79d"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:09.373477 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3296ef2d-6155-45e9-b98e-b146dede49fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:09.373918 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3296ef2d-6155-45e9-b98e-b146dede49fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:09.374681 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3296ef2d-6155-45e9-b98e-b146dede49fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:09.375113 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-3296ef2d-6155-45e9-b98e-b146dede49fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:09.379480 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e6f6b616-3fa5-43a8-a738-ad71461c3823 req-5a37eecf-a36a-43e6-8aaa-e900e9683246 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:09.380227 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e6f6b616-3fa5-43a8-a738-ad71461c3823 req-5a37eecf-a36a-43e6-8aaa-e900e9683246 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:09.392321 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-e6f6b616-3fa5-43a8-a738-ad71461c3823 req-5a37eecf-a36a-43e6-8aaa-e900e9683246 service nova] Creating event network-changed:01d88f12-4c16-4b1d-a7fb-03006cbdf79d for instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 on hv-cinder-85093 Jul 25 20:15:09.397546 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-e6f6b616-3fa5-43a8-a738-ad71461c3823 req-5a37eecf-a36a-43e6-8aaa-e900e9683246 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033366 Jul 25 20:15:09.399280 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1664/3475] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:09.403797 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-3296ef2d-6155-45e9-b98e-b146dede49fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Going to try to terminate instance {{(pid=117952) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:15:09.498305 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-3296ef2d-6155-45e9-b98e-b146dede49fd tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 204 len: 0 microversion: 2.1 time: 0.136356 Jul 25 20:15:09.502958 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1812/3476] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:15:09 2022] DELETE /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:15:09.509156 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0aa5704b-552b-457b-8cad-48a6a30a0cd4 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:09.510001 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0aa5704b-552b-457b-8cad-48a6a30a0cd4 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:09.516699 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0aa5704b-552b-457b-8cad-48a6a30a0cd4 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:09.517415 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0aa5704b-552b-457b-8cad-48a6a30a0cd4 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:09.518185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0aa5704b-552b-457b-8cad-48a6a30a0cd4 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:09.518655 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0aa5704b-552b-457b-8cad-48a6a30a0cd4 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:09.656447 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0aa5704b-552b-457b-8cad-48a6a30a0cd4 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:09.664014 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0aa5704b-552b-457b-8cad-48a6a30a0cd4 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1576 microversion: 2.1 time: 0.159949 Jul 25 20:15:09.664579 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1665/3477] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:09 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:10.686995 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-49801c87-6bcd-43f8-8b73-6b2323f0d803 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:10.687749 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-49801c87-6bcd-43f8-8b73-6b2323f0d803 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:10.694271 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49801c87-6bcd-43f8-8b73-6b2323f0d803 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:10.694723 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49801c87-6bcd-43f8-8b73-6b2323f0d803 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:10.695484 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49801c87-6bcd-43f8-8b73-6b2323f0d803 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:10.696049 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-49801c87-6bcd-43f8-8b73-6b2323f0d803 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:10.830852 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.policy [None req-49801c87-6bcd-43f8-8b73-6b2323f0d803 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117952) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:10.839044 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-49801c87-6bcd-43f8-8b73-6b2323f0d803 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1576 microversion: 2.1 time: 0.156238 Jul 25 20:15:10.839638 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1813/3478] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:10 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:11.860610 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-55ecbc16-9c56-45cf-9f05-29c7fb9b8517 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:11.861213 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-55ecbc16-9c56-45cf-9f05-29c7fb9b8517 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:11.868426 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55ecbc16-9c56-45cf-9f05-29c7fb9b8517 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:11.868878 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55ecbc16-9c56-45cf-9f05-29c7fb9b8517 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:11.869682 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55ecbc16-9c56-45cf-9f05-29c7fb9b8517 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:11.870097 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55ecbc16-9c56-45cf-9f05-29c7fb9b8517 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:12.006472 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-55ecbc16-9c56-45cf-9f05-29c7fb9b8517 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:12.014648 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-55ecbc16-9c56-45cf-9f05-29c7fb9b8517 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1457 microversion: 2.1 time: 0.157915 Jul 25 20:15:12.015229 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1666/3479] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:11 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1457 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:12.266694 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [req-158f78f1-ae3a-4696-9356-575080216131 req-30c4ac0f-5d0a-400f-aa92-f4714edae0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd910d63-b30c-46b8-8ab2-d2a76e2e35d6", "name": "network-vif-deleted", "tag": "01d88f12-4c16-4b1d-a7fb-03006cbdf79d"}]} {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:12.277946 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-158f78f1-ae3a-4696-9356-575080216131 req-30c4ac0f-5d0a-400f-aa92-f4714edae0b3 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:12.278389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [req-158f78f1-ae3a-4696-9356-575080216131 req-30c4ac0f-5d0a-400f-aa92-f4714edae0b3 service nova] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:12.290523 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.compute.server_external_events [req-158f78f1-ae3a-4696-9356-575080216131 req-30c4ac0f-5d0a-400f-aa92-f4714edae0b3 service nova] Creating event network-vif-deleted:01d88f12-4c16-4b1d-a7fb-03006cbdf79d for instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 on hv-cinder-85093 Jul 25 20:15:12.295389 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [req-158f78f1-ae3a-4696-9356-575080216131 req-30c4ac0f-5d0a-400f-aa92-f4714edae0b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032624 Jul 25 20:15:12.296247 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1814/3480] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:13.035773 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:13.036539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:13.044326 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:13.044777 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:13.045539 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:13.045980 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:13.079680 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:13.080130 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:13.080576 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lazy-loading 'fault' on Instance uuid dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:15:13.123649 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8143c33eabd74b1b9edc84e8ff155903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6986405c7974cc8bdf5d0c470926c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:13.132244 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-61555689-af50-415c-826a-797f6d0352d3 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 200 len: 1229 microversion: 2.1 time: 0.100318 Jul 25 20:15:13.133776 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1667/3481] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:13 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:14.157661 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2dd58f9c-b78b-4421-9aef-a2e4130bf20d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:14.158683 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-2dd58f9c-b78b-4421-9aef-a2e4130bf20d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: dd910d63-b30c-46b8-8ab2-d2a76e2e35d6] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:14.164982 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2dd58f9c-b78b-4421-9aef-a2e4130bf20d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:14.165434 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2dd58f9c-b78b-4421-9aef-a2e4130bf20d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:14.166419 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2dd58f9c-b78b-4421-9aef-a2e4130bf20d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:14.166730 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-2dd58f9c-b78b-4421-9aef-a2e4130bf20d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:14.183896 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-2dd58f9c-b78b-4421-9aef-a2e4130bf20d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] HTTP exception thrown: Instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 could not be found. Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2dd58f9c-b78b-4421-9aef-a2e4130bf20d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Request method failure captured: Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 HTTP/1.1 Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3vgE4UcQiZqEoYIVeNG6rXdP8594uiMMkStsY8UW0W1aWDaGdLtTOwBR75SamLVO3yWVuVCR9dPsXCaUqieMVKRlxWROwyuJWLV1-vGpVWuhWh_61TX1E6tR4EtNhYF1AxaZYDKsGXLVrw4JZA9UYBXp7EnxWdFKU0ZR07faOpoDVhE Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: b6986405c7974cc8bdf5d0c470926c1f Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:15:14.185490 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b6986405c7974cc8bdf5d0c470926c1f", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: b6986405c7974cc8bdf5d0c470926c1f Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-TestVolumeBootPattern-714955116-project Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 8143c33eabd74b1b9edc84e8ff155903 Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-TestVolumeBootPattern-714955116-project Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 could not be found. Jul 25 20:15:14.186897 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': 'dd910d63-b30c-46b8-8ab2-d2a76e2e35d6'} Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 could not be found. Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:14.187731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 could not be found. Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 could not be found. Jul 25 20:15:14.188957 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.189916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-2dd58f9c-b78b-4421-9aef-a2e4130bf20d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Returning 404 to user: Instance dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:14.189916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-2dd58f9c-b78b-4421-9aef-a2e4130bf20d tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6" status: 404 len: 111 microversion: 2.1 time: 0.034793 Jul 25 20:15:14.189916 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1815/3482] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:14 2022] GET /compute/v2.1/servers/dd910d63-b30c-46b8-8ab2-d2a76e2e35d6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:14.643425 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e49836de-ec3b-4f68-aef1-ff1d3ac6fffc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:14.643951 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e49836de-ec3b-4f68-aef1-ff1d3ac6fffc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:14.651038 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e49836de-ec3b-4f68-aef1-ff1d3ac6fffc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:14.651488 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e49836de-ec3b-4f68-aef1-ff1d3ac6fffc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:14.652270 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e49836de-ec3b-4f68-aef1-ff1d3ac6fffc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:14.652709 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e49836de-ec3b-4f68-aef1-ff1d3ac6fffc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:14.666958 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-e49836de-ec3b-4f68-aef1-ff1d3ac6fffc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] HTTP exception thrown: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e49836de-ec3b-4f68-aef1-ff1d3ac6fffc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Request method failure captured: Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 HTTP/1.1 Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.18 Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi3vgE4UcQiZqEoYIVeNG6rXdP8594uiMMkStsY8UW0W1aWDaGdLtTOwBR75SamLVO3yWVuVCR9dPsXCaUqieMVKRlxWROwyuJWLV1-vGpVWuhWh_61TX1E6tR4EtNhYF1AxaZYDKsGXLVrw4JZA9UYBXp7EnxWdFKU0ZR07faOpoDVhE Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Id: b6986405c7974cc8bdf5d0c470926c1f Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 25 20:15:14.668645 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b6986405c7974cc8bdf5d0c470926c1f", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: b6986405c7974cc8bdf5d0c470926c1f Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User: tempest-TestVolumeBootPattern-714955116-project Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Id: 8143c33eabd74b1b9edc84e8ff155903 Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestVolumeBootPattern-714955116-project Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: method: > Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: exception: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:15:14.670074 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '386cc182-5e6f-4f83-9789-9365b06c5ed7'} Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:14.670875 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:15:14.672278 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.673549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e49836de-ec3b-4f68-aef1-ff1d3ac6fffc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Returning 404 to user: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:14.673549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e49836de-ec3b-4f68-aef1-ff1d3ac6fffc tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "DELETE /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 404 len: 111 microversion: 2.1 time: 0.030534 Jul 25 20:15:14.673549 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1668/3483] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Jul 25 20:15:14 2022] DELETE /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:14.678752 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9aed1947-9480-4b5a-8a31-dc2bf1c7e1f0 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '>' {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:14.679455 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.compute.api [None req-9aed1947-9480-4b5a-8a31-dc2bf1c7e1f0 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] [instance: 386cc182-5e6f-4f83-9789-9365b06c5ed7] Fetching instance by UUID {{(pid=117952) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:14.685513 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9aed1947-9480-4b5a-8a31-dc2bf1c7e1f0 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:14.685955 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9aed1947-9480-4b5a-8a31-dc2bf1c7e1f0 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:14.686704 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9aed1947-9480-4b5a-8a31-dc2bf1c7e1f0 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:14.687133 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG oslo_concurrency.lockutils [None req-9aed1947-9480-4b5a-8a31-dc2bf1c7e1f0 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Lock "ccbefd05-b701-4978-bc0c-e210af40d93d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:14.703731 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.wsgi [None req-9aed1947-9480-4b5a-8a31-dc2bf1c7e1f0 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] HTTP exception thrown: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9aed1947-9480-4b5a-8a31-dc2bf1c7e1f0 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Request method failure captured: Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: request: GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 HTTP/1.1 Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept: application/json Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Accept-Encoding: identity Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Connection: close Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Length: 0 Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Content-Type: application/json Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Host: 10.222.0.18 Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Openstack-System-Scope: None Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Auth-Token: gAAAAABi3vgE4UcQiZqEoYIVeNG6rXdP8594uiMMkStsY8UW0W1aWDaGdLtTOwBR75SamLVO3yWVuVCR9dPsXCaUqieMVKRlxWROwyuJWLV1-vGpVWuhWh_61TX1E6tR4EtNhYF1AxaZYDKsGXLVrw4JZA9UYBXp7EnxWdFKU0ZR07faOpoDVhE Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Id: None Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Domain-Name: None Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Identity-Status: Confirmed Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Is-Admin-Project: True Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Id: default Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Domain-Name: Default Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Id: b6986405c7974cc8bdf5d0c470926c1f Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Project-Name: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Role: member,reader Jul 25 20:15:14.705280 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Roles: member,reader Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6986405c7974cc8bdf5d0c470926c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b6986405c7974cc8bdf5d0c470926c1f", "adminURL": "http://10.222.0.18:8080"}]}] Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Id: b6986405c7974cc8bdf5d0c470926c1f Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-Tenant-Name: tempest-TestVolumeBootPattern-714955116 Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User: tempest-TestVolumeBootPattern-714955116-project Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Id: default Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Domain-Name: Default Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Id: 8143c33eabd74b1b9edc84e8ff155903 Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: X-User-Name: tempest-TestVolumeBootPattern-714955116-project Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: method: > Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: exception: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:15:14.706659 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: action_args: {'id': '386cc182-5e6f-4f83-9789-9365b06c5ed7'} Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: {{(pid=117952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:14.707413 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. Jul 25 20:15:14.708754 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: ERROR nova.api.openstack.wsgi Jul 25 20:15:14.709913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: DEBUG nova.api.openstack.wsgi [None req-9aed1947-9480-4b5a-8a31-dc2bf1c7e1f0 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Returning 404 to user: Instance 386cc182-5e6f-4f83-9789-9365b06c5ed7 could not be found. {{(pid=117952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:14.709913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO nova.api.openstack.requestlog [None req-9aed1947-9480-4b5a-8a31-dc2bf1c7e1f0 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7" status: 404 len: 111 microversion: 2.1 time: 0.031667 Jul 25 20:15:14.709913 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: [pid: 117952|app: 0|req: 1816/3484] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:14 2022] GET /compute/v2.1/servers/386cc182-5e6f-4f83-9789-9365b06c5ed7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:16.012813 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ec885c0f-4265-40d3-9411-d54510030f23 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] Calling method '.version_select at 0x7feb0c3d11f0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:16.042043 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ec885c0f-4265-40d3-9411-d54510030f23 tempest-TestVolumeBootPattern-714955116 tempest-TestVolumeBootPattern-714955116-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-546487680" status: 202 len: 0 microversion: 2.1 time: 0.032936 Jul 25 20:15:16.042643 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1669/3485] 10.222.0.18 () {58 vars in 1260 bytes} [Mon Jul 25 20:15:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-546487680 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:16:38.997322 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:16:38.998073 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 20:16:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:17:42.989276 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:17:42.990070 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 20:17:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:18:05.704649 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:18:05.705293 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 20:18:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:18:39.086850 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:18:39.087700 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 20:18:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:19:59.006185 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:19:59.006823 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 20:19:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:20:25.213999 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:20:25.214532 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 20:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:20:34.631377 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:20:34.632026 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 20:20:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:21:02.997241 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:21:02.998388 dv-cinder-850939-1-iscsi devstack@n-api.service[117951]: Mon Jul 25 20:21:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:21:25.714063 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:21:25.714924 dv-cinder-850939-1-iscsi devstack@n-api.service[117952]: Mon Jul 25 20:21:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!